Jul 06 20:35:19.057003 ip-10-0-140-125 systemd[1]: Starting Kubernetes Kubelet... Jul 06 20:35:19.483717 ip-10-0-140-125 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:35:19.483717 ip-10-0-140-125 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 20:35:19.483717 ip-10-0-140-125 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:35:19.483717 ip-10-0-140-125 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 20:35:19.483717 ip-10-0-140-125 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:35:19.485624 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.485538 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 20:35:19.491259 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491240 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:35:19.491259 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491258 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:35:19.491364 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491262 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:35:19.491364 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491265 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:35:19.491364 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491268 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:35:19.491364 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491271 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:35:19.491364 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491274 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:35:19.491364 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491277 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:35:19.491364 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491280 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:35:19.491364 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491282 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:35:19.491364 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491286 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:35:19.491364 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491289 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:35:19.491364 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491292 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:35:19.491364 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491295 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:35:19.491364 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491302 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:35:19.491364 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491305 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:35:19.491364 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491308 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:35:19.491364 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491311 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:35:19.491364 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491313 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:35:19.491364 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491317 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:35:19.491364 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491321 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:35:19.491832 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491324 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:35:19.491832 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491327 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:35:19.491832 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491330 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:35:19.491832 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491332 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:35:19.491832 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491335 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:35:19.491832 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491337 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:35:19.491832 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491340 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:35:19.491832 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491343 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:35:19.491832 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491345 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:35:19.491832 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491348 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:35:19.491832 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491351 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:35:19.491832 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491353 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:35:19.491832 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491356 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:35:19.491832 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491358 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:35:19.491832 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491361 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:35:19.491832 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491364 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:35:19.491832 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491367 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:35:19.491832 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491370 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:35:19.491832 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491373 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:35:19.491832 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491376 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:35:19.492316 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491379 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:35:19.492316 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491383 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:35:19.492316 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491386 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:35:19.492316 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491390 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:35:19.492316 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491393 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:35:19.492316 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491395 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:35:19.492316 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491398 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:35:19.492316 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491400 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:35:19.492316 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491403 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:35:19.492316 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491405 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:35:19.492316 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491408 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:35:19.492316 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491410 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:35:19.492316 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491413 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:35:19.492316 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491415 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:35:19.492316 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491418 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:35:19.492316 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491420 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:35:19.492316 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491422 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:35:19.492316 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491425 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:35:19.492316 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491433 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:35:19.492808 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491436 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:35:19.492808 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491438 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:35:19.492808 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491441 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:35:19.492808 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491443 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:35:19.492808 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491446 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:35:19.492808 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491448 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:35:19.492808 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491451 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:35:19.492808 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491454 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:35:19.492808 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491456 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:35:19.492808 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491459 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:35:19.492808 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491462 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:35:19.492808 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491465 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:35:19.492808 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491467 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:35:19.492808 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491470 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:35:19.492808 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491473 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:35:19.492808 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491478 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:35:19.492808 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491482 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:35:19.492808 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491485 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:35:19.492808 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491488 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:35:19.492808 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491490 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:35:19.493451 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491493 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:35:19.493451 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491495 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:35:19.493451 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491498 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:35:19.493451 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491500 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:35:19.493451 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491502 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:35:19.493451 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491505 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:35:19.493451 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491507 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:35:19.493451 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491510 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:35:19.493451 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491513 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:35:19.493451 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491515 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:35:19.493451 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491518 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:35:19.493451 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491520 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:35:19.493451 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491523 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:35:19.493451 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491525 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:35:19.493451 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491528 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:35:19.493451 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491531 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:35:19.493451 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491533 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:35:19.493451 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491535 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:35:19.493451 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.491538 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:35:19.493451 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492276 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:35:19.494217 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492284 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:35:19.494217 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492289 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:35:19.494217 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492294 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:35:19.494217 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492297 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:35:19.494217 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492300 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:35:19.494217 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492303 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:35:19.494217 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492305 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:35:19.494217 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492309 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:35:19.494217 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492311 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:35:19.494217 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492314 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:35:19.494217 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492317 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:35:19.494217 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492320 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:35:19.494217 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492323 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:35:19.494217 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492326 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:35:19.494217 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492329 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:35:19.494217 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492332 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:35:19.494217 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492334 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:35:19.494217 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492337 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:35:19.494217 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492339 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:35:19.494217 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492342 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:35:19.494901 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492344 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:35:19.494901 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492347 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:35:19.494901 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492349 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:35:19.494901 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492352 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:35:19.494901 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492355 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:35:19.494901 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492358 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:35:19.494901 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492360 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:35:19.494901 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492363 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:35:19.494901 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492366 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:35:19.494901 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492368 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:35:19.494901 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492371 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:35:19.494901 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492374 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:35:19.494901 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492377 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:35:19.494901 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492379 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:35:19.494901 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492382 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:35:19.494901 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492385 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:35:19.494901 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492387 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:35:19.494901 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492390 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:35:19.494901 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492392 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:35:19.494901 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492395 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:35:19.495386 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492397 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:35:19.495386 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492400 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:35:19.495386 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492404 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:35:19.495386 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492408 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:35:19.495386 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492411 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:35:19.495386 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492414 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:35:19.495386 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492417 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:35:19.495386 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492420 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:35:19.495386 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492423 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:35:19.495386 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492425 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:35:19.495386 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492428 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:35:19.495386 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492431 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:35:19.495386 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492433 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:35:19.495386 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492436 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:35:19.495386 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492438 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:35:19.495386 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492442 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:35:19.495386 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492445 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:35:19.495386 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492448 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:35:19.495386 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492450 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:35:19.495870 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492453 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:35:19.495870 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492456 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:35:19.495870 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492459 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:35:19.495870 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492461 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:35:19.495870 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492465 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:35:19.495870 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492468 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:35:19.495870 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492470 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:35:19.495870 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492473 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:35:19.495870 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492475 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:35:19.495870 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492478 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:35:19.495870 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492481 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:35:19.495870 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492485 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:35:19.495870 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492487 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:35:19.495870 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492490 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:35:19.495870 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492492 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:35:19.495870 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492495 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:35:19.495870 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492497 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:35:19.495870 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492501 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:35:19.495870 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492504 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:35:19.495870 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492506 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:35:19.496349 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492509 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:35:19.496349 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492511 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:35:19.496349 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492513 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:35:19.496349 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492516 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:35:19.496349 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492518 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:35:19.496349 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492521 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:35:19.496349 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492523 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:35:19.496349 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492525 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:35:19.496349 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492528 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:35:19.496349 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492531 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:35:19.496349 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492533 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:35:19.496349 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492536 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:35:19.496349 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492538 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:35:19.496349 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492541 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:35:19.496349 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492543 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:35:19.496349 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492546 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:35:19.496349 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492549 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:35:19.496349 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492551 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:35:19.496349 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.492554 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:35:19.496349 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493851 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:35:19.496849 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493872 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:35:19.496849 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493877 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:35:19.496849 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493881 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:35:19.496849 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493886 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:35:19.496849 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493890 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:35:19.496849 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493895 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:35:19.496849 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493899 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:35:19.496849 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493903 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:35:19.496849 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493907 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:35:19.496849 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493911 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:35:19.496849 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493915 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:35:19.496849 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493919 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:35:19.496849 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493928 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:35:19.496849 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493932 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:35:19.496849 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493936 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:35:19.496849 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493940 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:35:19.496849 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493945 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:35:19.496849 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493949 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:35:19.496849 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493953 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:35:19.497310 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493957 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:35:19.497310 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493961 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:35:19.497310 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493965 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:35:19.497310 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493970 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:35:19.497310 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493974 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:35:19.497310 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493978 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:35:19.497310 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493989 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:35:19.497310 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.493996 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:35:19.497310 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494000 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:35:19.497310 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494005 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:35:19.497310 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494010 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:35:19.497310 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494014 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:35:19.497310 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494020 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:35:19.497310 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494026 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:35:19.497310 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494030 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:35:19.497310 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494034 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:35:19.497310 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494037 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:35:19.497310 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494040 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:35:19.497310 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494046 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:35:19.497310 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494049 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:35:19.497835 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494052 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:35:19.497835 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494055 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:35:19.497835 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494057 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:35:19.497835 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494060 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:35:19.497835 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494063 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:35:19.497835 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494067 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:35:19.497835 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494071 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:35:19.497835 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494074 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:35:19.497835 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494077 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:35:19.497835 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494080 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:35:19.497835 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494085 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:35:19.497835 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494089 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:35:19.497835 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494093 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:35:19.497835 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494097 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:35:19.497835 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494102 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:35:19.497835 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494106 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:35:19.497835 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494110 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:35:19.497835 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494114 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:35:19.497835 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494118 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:35:19.498295 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494123 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:35:19.498295 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494129 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:35:19.498295 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494133 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:35:19.498295 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494138 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:35:19.498295 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494147 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:35:19.498295 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494151 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:35:19.498295 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494155 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:35:19.498295 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494161 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:35:19.498295 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494165 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:35:19.498295 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494168 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:35:19.498295 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494172 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:35:19.498295 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494176 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:35:19.498295 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494180 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:35:19.498295 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494186 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:35:19.498295 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494191 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:35:19.498295 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494195 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:35:19.498295 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494203 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:35:19.498295 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494207 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:35:19.498295 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494230 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:35:19.498295 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494234 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:35:19.498931 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494252 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:35:19.498931 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494256 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:35:19.498931 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494373 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:35:19.498931 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494377 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:35:19.498931 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494380 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:35:19.498931 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494383 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:35:19.498931 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494385 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:35:19.498931 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494388 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:35:19.498931 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494391 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:35:19.498931 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494394 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:35:19.498931 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494396 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:35:19.498931 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494401 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:35:19.498931 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494404 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:35:19.498931 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494406 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:35:19.498931 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494409 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:35:19.498931 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494413 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:35:19.498931 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494415 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:35:19.498931 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494418 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:35:19.498931 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494423 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.494425 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494501 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494509 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494516 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494522 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494528 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494532 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494539 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494544 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494547 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494550 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494554 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494557 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494560 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494563 2577 flags.go:64] FLAG: --cgroup-root="" Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494566 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494569 2577 flags.go:64] FLAG: --client-ca-file="" Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494572 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494574 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494579 2577 flags.go:64] FLAG: --cluster-domain="" Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494582 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494584 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494587 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 20:35:19.499402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494591 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494594 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494597 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494600 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494604 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494607 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494610 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494612 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494618 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494621 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494625 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494628 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494630 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494633 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494636 2577 flags.go:64] FLAG: --enable-server="true" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494639 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494645 2577 flags.go:64] FLAG: --event-burst="100" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494648 2577 flags.go:64] FLAG: --event-qps="50" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494651 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494654 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494657 2577 flags.go:64] FLAG: --eviction-hard="" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494660 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494663 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494666 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494669 2577 flags.go:64] FLAG: --eviction-soft="" Jul 06 20:35:19.500033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494672 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494674 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494677 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494680 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494683 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494685 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494688 2577 flags.go:64] FLAG: --feature-gates="" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494692 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494695 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494698 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494701 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494704 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494707 2577 flags.go:64] FLAG: --help="false" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494710 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-140-125.ec2.internal" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494713 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494717 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494720 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494723 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494726 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494729 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494731 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494734 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494737 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 20:35:19.500632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494741 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494744 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494747 2577 flags.go:64] FLAG: --kube-reserved="" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494750 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494752 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494755 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494777 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494780 2577 flags.go:64] FLAG: --lock-file="" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494783 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494786 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494789 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494794 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494797 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494801 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494804 2577 flags.go:64] FLAG: --logging-format="text" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494807 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494810 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494813 2577 flags.go:64] FLAG: --manifest-url="" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494815 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494821 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494834 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494839 2577 flags.go:64] FLAG: --max-pods="110" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494841 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494844 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494849 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 20:35:19.501242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494852 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494854 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494857 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494860 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494867 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494870 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494873 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494877 2577 flags.go:64] FLAG: --pod-cidr="" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494880 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494885 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494888 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494891 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494894 2577 flags.go:64] FLAG: --port="10250" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494897 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494900 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09287ac3ec89290d4" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494903 2577 flags.go:64] FLAG: --qos-reserved="" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494906 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494909 2577 flags.go:64] FLAG: --register-node="true" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494912 2577 flags.go:64] FLAG: --register-with-taints="" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494916 2577 flags.go:64] FLAG: --registry-burst="10" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494919 2577 flags.go:64] FLAG: --registry-qps="5" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494922 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494925 2577 flags.go:64] FLAG: --reserved-memory="" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494929 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494931 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 20:35:19.501883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494934 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494937 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494940 2577 flags.go:64] FLAG: --runonce="false" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494942 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494945 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494948 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494951 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494954 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494957 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494960 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494963 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494965 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494968 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494971 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494975 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494978 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494980 2577 flags.go:64] FLAG: --system-cgroups="" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494983 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494988 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494991 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494994 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.494998 2577 flags.go:64] FLAG: --tls-min-version="" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.495001 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.495003 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.495006 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 20:35:19.502489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.495009 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 20:35:19.503126 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.495012 2577 flags.go:64] FLAG: --v="2" Jul 06 20:35:19.503126 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.495016 2577 flags.go:64] FLAG: --version="false" Jul 06 20:35:19.503126 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.495019 2577 flags.go:64] FLAG: --vmodule="" Jul 06 20:35:19.503126 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.495029 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 20:35:19.503126 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.495032 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 20:35:19.503126 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495149 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:35:19.503126 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495153 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:35:19.503126 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495156 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:35:19.503126 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495158 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:35:19.503126 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495161 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:35:19.503126 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495163 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:35:19.503126 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495166 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:35:19.503126 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495168 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:35:19.503126 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495171 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:35:19.503126 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495174 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:35:19.503126 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495176 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:35:19.503126 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495179 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:35:19.503126 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495182 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:35:19.503126 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495184 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:35:19.503126 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495187 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:35:19.503126 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495191 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:35:19.503669 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495193 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:35:19.503669 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495196 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:35:19.503669 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495199 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:35:19.503669 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495201 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:35:19.503669 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495204 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:35:19.503669 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495206 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:35:19.503669 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495209 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:35:19.503669 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495211 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:35:19.503669 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495214 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:35:19.503669 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495216 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:35:19.503669 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495218 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:35:19.503669 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495221 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:35:19.503669 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495223 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:35:19.503669 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495226 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:35:19.503669 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495228 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:35:19.503669 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495232 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:35:19.503669 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495234 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:35:19.503669 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495236 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:35:19.503669 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495239 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:35:19.503669 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495243 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:35:19.504166 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495246 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:35:19.504166 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495248 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:35:19.504166 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495251 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:35:19.504166 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495253 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:35:19.504166 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495256 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:35:19.504166 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495258 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:35:19.504166 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495261 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:35:19.504166 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495263 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:35:19.504166 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495265 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:35:19.504166 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495268 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:35:19.504166 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495270 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:35:19.504166 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495274 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:35:19.504166 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495276 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:35:19.504166 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495279 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:35:19.504166 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495281 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:35:19.504166 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495284 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:35:19.504166 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495286 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:35:19.504166 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495290 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:35:19.504166 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495293 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:35:19.504617 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495296 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:35:19.504617 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495299 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:35:19.504617 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495302 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:35:19.504617 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495305 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:35:19.504617 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495308 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:35:19.504617 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495311 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:35:19.504617 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495313 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:35:19.504617 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495316 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:35:19.504617 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495318 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:35:19.504617 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495321 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:35:19.504617 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495324 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:35:19.504617 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495326 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:35:19.504617 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495329 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:35:19.504617 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495331 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:35:19.504617 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495334 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:35:19.504617 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495336 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:35:19.504617 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495338 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:35:19.504617 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495341 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:35:19.504617 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495345 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:35:19.505088 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495348 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:35:19.505088 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495351 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:35:19.505088 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495354 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:35:19.505088 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495357 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:35:19.505088 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495359 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:35:19.505088 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495363 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:35:19.505088 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495366 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:35:19.505088 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495368 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:35:19.505088 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495370 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:35:19.505088 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495373 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:35:19.505088 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495375 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:35:19.505088 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495378 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:35:19.505088 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495380 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:35:19.505088 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495383 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:35:19.505088 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495385 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:35:19.505088 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495388 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:35:19.505088 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495390 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:35:19.505088 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495393 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:35:19.505088 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495395 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:35:19.505088 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495398 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:35:19.505571 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495401 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:35:19.505571 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495403 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:35:19.505571 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495405 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:35:19.505571 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495408 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:35:19.505571 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.495411 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:35:19.505571 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.495937 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:35:19.505571 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.502607 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 20:35:19.505571 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.502623 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 20:35:19.505571 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.502643 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 20:35:19.505571 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.502649 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 20:35:19.505571 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502700 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:35:19.505571 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502705 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:35:19.505571 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502708 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:35:19.505571 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502711 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:35:19.505933 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502713 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:35:19.505933 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502716 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:35:19.505933 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502719 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:35:19.505933 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502721 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:35:19.505933 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502724 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:35:19.505933 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502727 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:35:19.505933 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502730 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:35:19.505933 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502733 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:35:19.505933 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502735 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:35:19.505933 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502738 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:35:19.505933 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502740 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:35:19.505933 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502743 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:35:19.505933 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502745 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:35:19.505933 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502750 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:35:19.505933 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502754 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:35:19.505933 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502776 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:35:19.505933 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502781 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:35:19.505933 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502784 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:35:19.505933 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502787 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:35:19.505933 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502790 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:35:19.506425 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502793 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:35:19.506425 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502795 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:35:19.506425 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502798 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:35:19.506425 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502801 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:35:19.506425 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502804 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:35:19.506425 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502811 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:35:19.506425 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502814 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:35:19.506425 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502817 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:35:19.506425 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502820 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:35:19.506425 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502830 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:35:19.506425 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502833 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:35:19.506425 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502836 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:35:19.506425 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502838 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:35:19.506425 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502841 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:35:19.506425 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502843 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:35:19.506425 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502847 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:35:19.506425 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502851 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:35:19.506425 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502854 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:35:19.506425 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502857 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:35:19.506945 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502859 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:35:19.506945 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502861 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:35:19.506945 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502864 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:35:19.506945 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502866 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:35:19.506945 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502869 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:35:19.506945 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502871 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:35:19.506945 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502874 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:35:19.506945 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502876 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:35:19.506945 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502879 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:35:19.506945 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502881 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:35:19.506945 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502884 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:35:19.506945 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502886 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:35:19.506945 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502888 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:35:19.506945 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502891 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:35:19.506945 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502893 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:35:19.506945 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502896 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:35:19.506945 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502898 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:35:19.506945 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502901 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:35:19.506945 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502904 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:35:19.506945 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502908 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:35:19.507422 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502910 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:35:19.507422 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502913 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:35:19.507422 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502915 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:35:19.507422 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502918 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:35:19.507422 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502921 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:35:19.507422 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502923 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:35:19.507422 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502925 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:35:19.507422 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502928 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:35:19.507422 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502931 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:35:19.507422 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502934 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:35:19.507422 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502936 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:35:19.507422 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502939 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:35:19.507422 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502941 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:35:19.507422 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502943 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:35:19.507422 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502946 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:35:19.507422 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502949 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:35:19.507422 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502951 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:35:19.507422 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502954 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:35:19.507422 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502956 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:35:19.507422 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502959 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:35:19.507972 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502961 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:35:19.507972 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502964 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:35:19.507972 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502966 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:35:19.507972 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502969 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:35:19.507972 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502971 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:35:19.507972 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502973 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:35:19.507972 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502977 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:35:19.507972 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502979 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:35:19.507972 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502981 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:35:19.507972 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502985 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:35:19.507972 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502987 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:35:19.507972 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502991 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:35:19.507972 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502995 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:35:19.507972 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.502998 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:35:19.507972 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503001 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:35:19.507972 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503003 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:35:19.508352 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.503008 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:35:19.508352 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503116 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:35:19.508352 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503120 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:35:19.508352 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503123 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:35:19.508352 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503126 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:35:19.508352 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503129 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:35:19.508352 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503132 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:35:19.508352 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503136 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:35:19.508352 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503140 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:35:19.508352 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503144 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:35:19.508352 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503146 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:35:19.508352 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503149 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:35:19.508352 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503151 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:35:19.508352 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503154 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:35:19.508352 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503156 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:35:19.508724 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503158 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:35:19.508724 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503161 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:35:19.508724 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503163 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:35:19.508724 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503166 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:35:19.508724 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503168 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:35:19.508724 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503171 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:35:19.508724 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503173 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:35:19.508724 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503175 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:35:19.508724 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503178 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:35:19.508724 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503180 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:35:19.508724 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503183 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:35:19.508724 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503186 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:35:19.508724 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503188 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:35:19.508724 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503190 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:35:19.508724 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503194 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:35:19.508724 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503196 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:35:19.508724 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503198 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:35:19.508724 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503201 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:35:19.508724 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503203 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:35:19.508724 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503206 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:35:19.509223 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503208 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:35:19.509223 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503210 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:35:19.509223 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503213 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:35:19.509223 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503215 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:35:19.509223 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503218 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:35:19.509223 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503220 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:35:19.509223 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503223 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:35:19.509223 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503225 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:35:19.509223 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503228 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:35:19.509223 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503230 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:35:19.509223 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503234 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:35:19.509223 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503237 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:35:19.509223 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503239 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:35:19.509223 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503242 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:35:19.509223 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503244 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:35:19.509223 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503247 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:35:19.509223 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503249 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:35:19.509223 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503251 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:35:19.509223 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503254 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:35:19.509223 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503256 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:35:19.509692 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503259 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:35:19.509692 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503261 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:35:19.509692 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503264 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:35:19.509692 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503266 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:35:19.509692 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503269 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:35:19.509692 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503272 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:35:19.509692 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503276 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:35:19.509692 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503279 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:35:19.509692 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503282 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:35:19.509692 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503285 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:35:19.509692 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503287 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:35:19.509692 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503290 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:35:19.509692 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503293 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:35:19.509692 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503295 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:35:19.509692 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503297 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:35:19.509692 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503300 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:35:19.509692 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503302 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:35:19.509692 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503305 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:35:19.509692 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503307 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:35:19.510157 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503310 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:35:19.510157 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503312 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:35:19.510157 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503314 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:35:19.510157 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503317 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:35:19.510157 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503319 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:35:19.510157 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503322 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:35:19.510157 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503324 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:35:19.510157 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503326 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:35:19.510157 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503329 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:35:19.510157 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503331 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:35:19.510157 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503334 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:35:19.510157 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503336 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:35:19.510157 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503339 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:35:19.510157 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503341 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:35:19.510157 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503344 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:35:19.510157 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503346 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:35:19.510157 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503349 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:35:19.510157 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503351 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:35:19.510157 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503354 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:35:19.510157 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503356 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:35:19.510652 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503358 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:35:19.510652 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503361 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:35:19.510652 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503364 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:35:19.510652 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503366 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:35:19.510652 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503369 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:35:19.510652 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:19.503371 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:35:19.510652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.503376 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:35:19.510652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.503509 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 20:35:19.510652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.505645 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 20:35:19.510652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.506996 2577 server.go:1019] "Starting client certificate rotation" Jul 06 20:35:19.510652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.507103 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 20:35:19.510652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.507143 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 20:35:19.510652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.509386 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 20:35:19.511002 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.510514 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 20:35:19.522002 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.521985 2577 log.go:25] "Validated CRI v1 runtime API" Jul 06 20:35:19.525236 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.525218 2577 log.go:25] "Validated CRI v1 image API" Jul 06 20:35:19.526753 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.526733 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 20:35:19.529296 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.529278 2577 fs.go:135] Filesystem UUIDs: map[3b6ed5fa-6f00-43af-aaf5-9bababdf11d6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 fd07887a-c29a-488a-9270-c32ff9f5d6c9:/dev/nvme0n1p3] Jul 06 20:35:19.529347 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.529296 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 20:35:19.535505 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.535388 2577 manager.go:216] Machine: {Timestamp:2026-07-06 20:35:19.534120899 +0000 UTC m=+0.353266498 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100096 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fe3ec678403f75813301cdc5e189c SystemUUID:ec2fe3ec-6784-03f7-5813-301cdc5e189c BootID:98242d3e-d538-4047-967b-5b1d21437317 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f8:70:ca:8b:1b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f8:70:ca:8b:1b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:21:74:20:3a:4e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 20:35:19.535505 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.535496 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 20:35:19.535660 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.535640 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 20:35:19.537183 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.537157 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 20:35:19.537347 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.537184 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-125.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 20:35:19.537976 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.537964 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 20:35:19.538028 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.537982 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 20:35:19.538028 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.537992 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 20:35:19.538658 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.538647 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 20:35:19.539260 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.539243 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 20:35:19.539956 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.539942 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 20:35:19.543259 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.543247 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 06 20:35:19.543381 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.543371 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 20:35:19.543409 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.543401 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 06 20:35:19.543446 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.543413 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 20:35:19.543446 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.543438 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 20:35:19.543497 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.543452 2577 kubelet.go:398] "Adding apiserver pod source" Jul 06 20:35:19.543497 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.543464 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 20:35:19.543818 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.543806 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 20:35:19.543850 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.543825 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 20:35:19.545864 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.545850 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 20:35:19.547660 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.547647 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 20:35:19.547706 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.547685 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 20:35:19.549056 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.549045 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 20:35:19.549094 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.549061 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 20:35:19.549094 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.549068 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 20:35:19.549094 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.549073 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 20:35:19.549094 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.549082 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 20:35:19.549094 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.549088 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 20:35:19.549094 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.549096 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 20:35:19.549244 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.549102 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 20:35:19.549244 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.549108 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 20:35:19.549244 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.549113 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 20:35:19.549244 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.549121 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 20:35:19.549244 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.549127 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 20:35:19.549745 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.549736 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 20:35:19.549745 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.549745 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 20:35:19.553375 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.553362 2577 server.go:1268] "Started kubelet" Jul 06 20:35:19.553587 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.553571 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-125.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 20:35:19.553652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.553609 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 20:35:19.553652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.553639 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 20:35:19.554344 ip-10-0-140-125 systemd[1]: Started Kubernetes Kubelet. Jul 06 20:35:19.554513 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:19.554343 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 20:35:19.554513 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:19.554342 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-125.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 20:35:19.554513 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.554343 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 20:35:19.555306 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.555279 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 20:35:19.556672 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.556658 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 06 20:35:19.558459 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:19.558439 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 20:35:19.559233 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:19.558266 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-125.ec2.internal.18bfcdaccf05b40f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-125.ec2.internal,UID:ip-10-0-140-125.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-125.ec2.internal,},FirstTimestamp:2026-07-06 20:35:19.553332239 +0000 UTC m=+0.372477843,LastTimestamp:2026-07-06 20:35:19.553332239 +0000 UTC m=+0.372477843,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-125.ec2.internal,}" Jul 06 20:35:19.559363 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.559350 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gswfb" Jul 06 20:35:19.561833 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.561818 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 20:35:19.561962 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.561938 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 20:35:19.562053 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:19.561941 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 06 20:35:19.562665 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.562491 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 20:35:19.562886 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.562807 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 20:35:19.563224 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.563208 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 20:35:19.563292 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.563220 2577 factory.go:55] Registering systemd factory Jul 06 20:35:19.563292 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.563281 2577 factory.go:223] Registration of the systemd container factory successfully Jul 06 20:35:19.565499 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.565130 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 06 20:35:19.565499 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.565142 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 06 20:35:19.565499 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:19.565300 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-125.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 20:35:19.565499 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:19.565403 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 20:35:19.566399 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.566375 2577 factory.go:153] Registering CRI-O factory Jul 06 20:35:19.566399 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.566397 2577 factory.go:223] Registration of the crio container factory successfully Jul 06 20:35:19.566531 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.566443 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 20:35:19.566531 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.566461 2577 factory.go:103] Registering Raw factory Jul 06 20:35:19.566531 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.566473 2577 manager.go:1196] Started watching for new ooms in manager Jul 06 20:35:19.566963 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.566952 2577 manager.go:349] Starting recovery of all containers Jul 06 20:35:19.567517 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.567494 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gswfb" Jul 06 20:35:19.576852 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.576700 2577 manager.go:354] Recovery completed Jul 06 20:35:19.580678 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.580665 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:35:19.582877 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.582855 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:35:19.582969 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.582892 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:35:19.582969 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.582906 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:35:19.583565 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.583546 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 20:35:19.583565 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.583563 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:35:19.583701 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.583566 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 20:35:19.583701 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.583648 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 06 20:35:19.584315 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.584296 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:35:19.584398 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.584327 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:35:19.584398 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.584342 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:35:19.584863 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.584850 2577 policy_none.go:49] "None policy: Start" Jul 06 20:35:19.584918 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.584872 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 20:35:19.584918 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.584887 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 20:35:19.586028 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.586015 2577 policy_none.go:47] "Start" Jul 06 20:35:19.627928 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.627899 2577 manager.go:337] "Starting Device Plugin manager" Jul 06 20:35:19.628039 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:19.627943 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 20:35:19.628039 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.627957 2577 server.go:87] "Starting device plugin registration server" Jul 06 20:35:19.628262 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.628249 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 20:35:19.628297 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.628267 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 20:35:19.628369 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.628352 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 20:35:19.628452 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.628438 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 20:35:19.628498 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.628453 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 20:35:19.629036 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:19.629015 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 20:35:19.629129 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:19.629070 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-125.ec2.internal\" not found" Jul 06 20:35:19.695121 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.695080 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 20:35:19.696473 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.696455 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 20:35:19.696528 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.696504 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 20:35:19.696568 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.696535 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 20:35:19.696609 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:19.696578 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 20:35:19.699116 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.699093 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:35:19.729162 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.729121 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:35:19.730428 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.730409 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:35:19.730534 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.730446 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:35:19.730534 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.730460 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:35:19.730534 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.730489 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-125.ec2.internal" Jul 06 20:35:19.738076 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.738027 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-125.ec2.internal" Jul 06 20:35:19.738076 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:19.738051 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-125.ec2.internal\": node \"ip-10-0-140-125.ec2.internal\" not found" Jul 06 20:35:19.747924 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:19.747903 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 06 20:35:19.797483 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.797455 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-125.ec2.internal"] Jul 06 20:35:19.797606 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.797534 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:35:19.799117 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.799102 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:35:19.799203 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.799137 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:35:19.799203 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.799151 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:35:19.800603 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.800587 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:35:19.800714 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.800696 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" Jul 06 20:35:19.800788 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.800733 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:35:19.802213 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.802198 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:35:19.802266 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.802226 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:35:19.802266 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.802237 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:35:19.802744 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.802731 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:35:19.802844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.802776 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:35:19.802844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.802793 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:35:19.803886 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.803870 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-125.ec2.internal" Jul 06 20:35:19.803972 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.803901 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:35:19.805773 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.805742 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:35:19.805849 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.805786 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:35:19.805849 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.805797 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:35:19.829351 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:19.829329 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-125.ec2.internal\" not found" node="ip-10-0-140-125.ec2.internal" Jul 06 20:35:19.833680 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:19.833664 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-125.ec2.internal\" not found" node="ip-10-0-140-125.ec2.internal" Jul 06 20:35:19.848256 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:19.848231 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 06 20:35:19.867219 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.867190 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/07cc2de8cb98e91a5f3c674fe90aba6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal\" (UID: \"07cc2de8cb98e91a5f3c674fe90aba6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" Jul 06 20:35:19.867307 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.867230 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07cc2de8cb98e91a5f3c674fe90aba6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal\" (UID: \"07cc2de8cb98e91a5f3c674fe90aba6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" Jul 06 20:35:19.867307 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.867250 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/73d7c4a409d43abc3672000c2f9d10d0-config\") pod \"kube-apiserver-proxy-ip-10-0-140-125.ec2.internal\" (UID: \"73d7c4a409d43abc3672000c2f9d10d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-125.ec2.internal" Jul 06 20:35:19.948401 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:19.948354 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 06 20:35:19.967839 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.967811 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/73d7c4a409d43abc3672000c2f9d10d0-config\") pod \"kube-apiserver-proxy-ip-10-0-140-125.ec2.internal\" (UID: \"73d7c4a409d43abc3672000c2f9d10d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-125.ec2.internal" Jul 06 20:35:19.967918 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.967842 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/07cc2de8cb98e91a5f3c674fe90aba6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal\" (UID: \"07cc2de8cb98e91a5f3c674fe90aba6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" Jul 06 20:35:19.967918 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.967864 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07cc2de8cb98e91a5f3c674fe90aba6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal\" (UID: \"07cc2de8cb98e91a5f3c674fe90aba6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" Jul 06 20:35:19.968012 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.967926 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/73d7c4a409d43abc3672000c2f9d10d0-config\") pod \"kube-apiserver-proxy-ip-10-0-140-125.ec2.internal\" (UID: \"73d7c4a409d43abc3672000c2f9d10d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-125.ec2.internal" Jul 06 20:35:19.968012 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.967955 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/07cc2de8cb98e91a5f3c674fe90aba6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal\" (UID: \"07cc2de8cb98e91a5f3c674fe90aba6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" Jul 06 20:35:19.968012 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:19.967926 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07cc2de8cb98e91a5f3c674fe90aba6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal\" (UID: \"07cc2de8cb98e91a5f3c674fe90aba6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" Jul 06 20:35:20.049277 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:20.049186 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 06 20:35:20.132795 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:20.132741 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" Jul 06 20:35:20.137301 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:20.137137 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-125.ec2.internal" Jul 06 20:35:20.149781 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:20.149751 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 06 20:35:20.250383 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:20.250339 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 06 20:35:20.350992 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:20.350911 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 06 20:35:20.451779 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:20.451741 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 06 20:35:20.508497 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:20.508465 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 20:35:20.509124 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:20.508633 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 20:35:20.552214 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:20.552166 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 06 20:35:20.569499 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:20.569460 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 20:30:20 +0000 UTC" deadline="2028-04-07 22:35:19.25518275 +0000 UTC" Jul 06 20:35:20.569499 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:20.569487 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15385h59m58.685698845s" Jul 06 20:35:20.653135 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:20.653016 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 06 20:35:20.754273 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:20.754231 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 06 20:35:20.769617 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:20.769583 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07cc2de8cb98e91a5f3c674fe90aba6e.slice/crio-a838630aa4204e9139f484b969c266da65f19a7b79482eb95ba472bea7893dc4 WatchSource:0}: Error finding container a838630aa4204e9139f484b969c266da65f19a7b79482eb95ba472bea7893dc4: Status 404 returned error can't find the container with id a838630aa4204e9139f484b969c266da65f19a7b79482eb95ba472bea7893dc4 Jul 06 20:35:20.775022 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:20.775002 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:35:20.784922 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:20.784905 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:35:20.854543 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:20.854501 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 06 20:35:20.881651 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:20.881617 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d7c4a409d43abc3672000c2f9d10d0.slice/crio-495114d908cef4069a1c7f3f85d179af82dab032d0257339d02b07d7e565c3c2 WatchSource:0}: Error finding container 495114d908cef4069a1c7f3f85d179af82dab032d0257339d02b07d7e565c3c2: Status 404 returned error can't find the container with id 495114d908cef4069a1c7f3f85d179af82dab032d0257339d02b07d7e565c3c2 Jul 06 20:35:20.957473 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:20.957398 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 06 20:35:20.960123 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:20.960106 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:35:21.058544 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:21.058494 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-125.ec2.internal\" not found" Jul 06 20:35:21.092061 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.092037 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:35:21.162911 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.162872 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" Jul 06 20:35:21.175543 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.175514 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 20:35:21.176534 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.176517 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-125.ec2.internal" Jul 06 20:35:21.185261 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.185241 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 20:35:21.544631 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.544597 2577 apiserver.go:52] "Watching apiserver" Jul 06 20:35:21.554646 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.552262 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 20:35:21.554646 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.553137 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-drdm6","kube-system/kube-apiserver-proxy-ip-10-0-140-125.ec2.internal","openshift-dns/node-resolver-f8xd2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal","openshift-multus/multus-xpwf2","openshift-multus/network-metrics-daemon-sw6qp","openshift-network-diagnostics/network-check-target-2w6mq","openshift-ovn-kubernetes/ovnkube-node-j8722","kube-system/global-pull-secret-syncer-qrmdw","kube-system/konnectivity-agent-28l4w","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp","openshift-cluster-node-tuning-operator/tuned-6g2rz","openshift-image-registry/node-ca-gvgt6","openshift-multus/multus-additional-cni-plugins-hhlrw"] Jul 06 20:35:21.556417 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.555839 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-28l4w" Jul 06 20:35:21.557786 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.557341 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gvgt6" Jul 06 20:35:21.558669 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.558643 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f8xd2" Jul 06 20:35:21.559711 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.559336 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 20:35:21.559711 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.559566 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 20:35:21.559711 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.559610 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v8mrf\"" Jul 06 20:35:21.561041 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.560666 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.561041 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.560764 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 20:35:21.561041 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.561001 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 20:35:21.562369 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.561848 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.562369 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.561965 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rhgxp\"" Jul 06 20:35:21.562369 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.562019 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 20:35:21.562369 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.561851 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 20:35:21.562369 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.562142 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 20:35:21.562369 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.562309 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kk25g\"" Jul 06 20:35:21.564193 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.563198 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:21.564193 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.563269 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 20:35:21.564193 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:21.563267 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw6qp" podUID="e3eec97f-a1ba-4160-ab43-ce2fda50659b" Jul 06 20:35:21.564193 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.563931 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 20:35:21.565695 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.564558 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rsgp7\"" Jul 06 20:35:21.565695 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.564569 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 20:35:21.565695 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.564708 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:21.565695 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:21.564806 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrmdw" podUID="20f81617-cdb7-4364-b3de-43e1a7fc32d2" Jul 06 20:35:21.565695 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.564931 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 20:35:21.565695 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.565109 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 20:35:21.565695 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.565263 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 20:35:21.565695 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.565498 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 20:35:21.565695 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.565541 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qvfkj\"" Jul 06 20:35:21.570344 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.566491 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:21.570344 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:21.566574 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w6mq" podUID="d4af3c2d-fc4f-4558-9f58-826f7ccc10f0" Jul 06 20:35:21.570344 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.568926 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.570344 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.569704 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-drdm6" Jul 06 20:35:21.573516 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.571500 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 20:35:21.573516 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.571878 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.573516 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.572351 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 20:35:21.573516 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.572570 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c9vwp\"" Jul 06 20:35:21.573516 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.572647 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 20:35:21.573516 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.572754 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 20:35:21.573516 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.572903 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 20:35:21.573516 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.573019 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.573516 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.573190 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 20:35:21.574100 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.573982 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 20:35:21.574100 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.573994 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:35:21.574407 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.574314 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 20:35:21.574505 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.574406 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ch9rz\"" Jul 06 20:35:21.575375 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.575040 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 20:35:21.575747 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.575722 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:35:21.576235 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576162 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.576235 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576187 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-host-run-k8s-cni-cncf-io\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.576382 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576246 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-multus-conf-dir\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.576382 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576275 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q27r2\" (UniqueName: \"kubernetes.io/projected/216749c6-ecf4-44ab-a86c-a72f5d91747e-kube-api-access-q27r2\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.576382 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576301 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20f81617-cdb7-4364-b3de-43e1a7fc32d2-dbus\") pod \"global-pull-secret-syncer-qrmdw\" (UID: \"20f81617-cdb7-4364-b3de-43e1a7fc32d2\") " pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:21.576382 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576319 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xstm\" (UniqueName: \"kubernetes.io/projected/a71ef46f-aee4-4690-9668-324e344d1818-kube-api-access-8xstm\") pod \"node-ca-gvgt6\" (UID: \"a71ef46f-aee4-4690-9668-324e344d1818\") " pod="openshift-image-registry/node-ca-gvgt6" Jul 06 20:35:21.576382 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576364 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-cni-binary-copy\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.576643 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576405 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.576643 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576451 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-cnibin\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.576643 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576479 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-os-release\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.576643 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576502 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/216749c6-ecf4-44ab-a86c-a72f5d91747e-cni-binary-copy\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.576643 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576528 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret\") pod \"global-pull-secret-syncer-qrmdw\" (UID: \"20f81617-cdb7-4364-b3de-43e1a7fc32d2\") " pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:21.576643 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576552 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs\") pod \"network-metrics-daemon-sw6qp\" (UID: \"e3eec97f-a1ba-4160-ab43-ce2fda50659b\") " pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:21.576643 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576597 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a71ef46f-aee4-4690-9668-324e344d1818-host\") pod \"node-ca-gvgt6\" (UID: \"a71ef46f-aee4-4690-9668-324e344d1818\") " pod="openshift-image-registry/node-ca-gvgt6" Jul 06 20:35:21.576643 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576623 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-host-var-lib-kubelet\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.577069 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576646 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20f81617-cdb7-4364-b3de-43e1a7fc32d2-kubelet-config\") pod \"global-pull-secret-syncer-qrmdw\" (UID: \"20f81617-cdb7-4364-b3de-43e1a7fc32d2\") " pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:21.577069 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576671 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l62j9\" (UniqueName: \"kubernetes.io/projected/e3eec97f-a1ba-4160-ab43-ce2fda50659b-kube-api-access-l62j9\") pod \"network-metrics-daemon-sw6qp\" (UID: \"e3eec97f-a1ba-4160-ab43-ce2fda50659b\") " pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:21.577069 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576710 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-host-run-netns\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.577069 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576735 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-cnibin\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.577069 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576767 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-os-release\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.577069 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576801 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/634f80f3-2281-4cea-aa6d-d2d1062a85de-agent-certs\") pod \"konnectivity-agent-28l4w\" (UID: \"634f80f3-2281-4cea-aa6d-d2d1062a85de\") " pod="kube-system/konnectivity-agent-28l4w" Jul 06 20:35:21.577069 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576826 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/29c1a80a-f71a-441d-95e2-d93c4af98b05-hosts-file\") pod \"node-resolver-f8xd2\" (UID: \"29c1a80a-f71a-441d-95e2-d93c4af98b05\") " pod="openshift-dns/node-resolver-f8xd2" Jul 06 20:35:21.577069 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-system-cni-dir\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.577069 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576953 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frqgd\" (UniqueName: \"kubernetes.io/projected/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-kube-api-access-frqgd\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.577069 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.576983 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-host-var-lib-cni-multus\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.577069 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.577023 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/634f80f3-2281-4cea-aa6d-d2d1062a85de-konnectivity-ca\") pod \"konnectivity-agent-28l4w\" (UID: \"634f80f3-2281-4cea-aa6d-d2d1062a85de\") " pod="kube-system/konnectivity-agent-28l4w" Jul 06 20:35:21.577069 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.577050 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s2cq\" (UniqueName: \"kubernetes.io/projected/29c1a80a-f71a-441d-95e2-d93c4af98b05-kube-api-access-8s2cq\") pod \"node-resolver-f8xd2\" (UID: \"29c1a80a-f71a-441d-95e2-d93c4af98b05\") " pod="openshift-dns/node-resolver-f8xd2" Jul 06 20:35:21.577645 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.577074 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.577645 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.577111 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-system-cni-dir\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.577645 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.577137 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-multus-socket-dir-parent\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.577645 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.577170 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/216749c6-ecf4-44ab-a86c-a72f5d91747e-multus-daemon-config\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.577645 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.577195 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-host-run-multus-certs\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.577645 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.577218 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-etc-kubernetes\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.577645 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.577266 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a71ef46f-aee4-4690-9668-324e344d1818-serviceca\") pod \"node-ca-gvgt6\" (UID: \"a71ef46f-aee4-4690-9668-324e344d1818\") " pod="openshift-image-registry/node-ca-gvgt6" Jul 06 20:35:21.577645 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.577289 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29c1a80a-f71a-441d-95e2-d93c4af98b05-tmp-dir\") pod \"node-resolver-f8xd2\" (UID: \"29c1a80a-f71a-441d-95e2-d93c4af98b05\") " pod="openshift-dns/node-resolver-f8xd2" Jul 06 20:35:21.577645 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.577314 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-multus-cni-dir\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.577645 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.577338 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-host-var-lib-cni-bin\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.577645 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.577376 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-hostroot\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.578168 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.577843 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 20:35:21.578168 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.577859 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 20:35:21.578168 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.577876 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 20:35:21.580330 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.580307 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-km7t8\"" Jul 06 20:35:21.580970 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.580878 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x9zlt\"" Jul 06 20:35:21.582908 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.582883 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 20:35:21.598053 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.598025 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4wr4j" Jul 06 20:35:21.606583 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.606557 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4wr4j" Jul 06 20:35:21.665045 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.665021 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 20:35:21.677713 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.677685 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-cni-binary-copy\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.677865 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.677717 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-cnibin\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.677865 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.677737 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/216749c6-ecf4-44ab-a86c-a72f5d91747e-cni-binary-copy\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.677865 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.677842 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-cnibin\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.678046 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.677898 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs\") pod \"network-metrics-daemon-sw6qp\" (UID: \"e3eec97f-a1ba-4160-ab43-ce2fda50659b\") " pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:21.678046 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.677941 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-host-run-netns\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.678046 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.677975 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be-registration-dir\") pod \"aws-ebs-csi-driver-node-nprkp\" (UID: \"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.678046 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678005 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-lib-modules\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.678046 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678041 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-host-var-lib-kubelet\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.678293 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678070 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20f81617-cdb7-4364-b3de-43e1a7fc32d2-kubelet-config\") pod \"global-pull-secret-syncer-qrmdw\" (UID: \"20f81617-cdb7-4364-b3de-43e1a7fc32d2\") " pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:21.678293 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678105 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l62j9\" (UniqueName: \"kubernetes.io/projected/e3eec97f-a1ba-4160-ab43-ce2fda50659b-kube-api-access-l62j9\") pod \"network-metrics-daemon-sw6qp\" (UID: \"e3eec97f-a1ba-4160-ab43-ce2fda50659b\") " pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:21.678293 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:21.678114 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:21.678293 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678130 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-sys\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.678293 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678188 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/634f80f3-2281-4cea-aa6d-d2d1062a85de-agent-certs\") pod \"konnectivity-agent-28l4w\" (UID: \"634f80f3-2281-4cea-aa6d-d2d1062a85de\") " pod="kube-system/konnectivity-agent-28l4w" Jul 06 20:35:21.678293 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678224 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/29c1a80a-f71a-441d-95e2-d93c4af98b05-hosts-file\") pod \"node-resolver-f8xd2\" (UID: \"29c1a80a-f71a-441d-95e2-d93c4af98b05\") " pod="openshift-dns/node-resolver-f8xd2" Jul 06 20:35:21.678293 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678252 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be-device-dir\") pod \"aws-ebs-csi-driver-node-nprkp\" (UID: \"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.678652 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:21.678320 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs podName:e3eec97f-a1ba-4160-ab43-ce2fda50659b nodeName:}" failed. No retries permitted until 2026-07-06 20:35:22.178296872 +0000 UTC m=+2.997442482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs") pod "network-metrics-daemon-sw6qp" (UID: "e3eec97f-a1ba-4160-ab43-ce2fda50659b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:21.678652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678346 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20f81617-cdb7-4364-b3de-43e1a7fc32d2-kubelet-config\") pod \"global-pull-secret-syncer-qrmdw\" (UID: \"20f81617-cdb7-4364-b3de-43e1a7fc32d2\") " pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:21.678652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678364 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ffj5\" (UniqueName: \"kubernetes.io/projected/7e0461f6-131b-4abf-a2ba-aa052aaeab10-kube-api-access-5ffj5\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.678652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678402 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-host-var-lib-cni-multus\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.678652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678461 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-host-var-lib-cni-multus\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.678652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678497 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-cni-binary-copy\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.678652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678504 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-host-var-lib-kubelet\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.678652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678499 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/216749c6-ecf4-44ab-a86c-a72f5d91747e-cni-binary-copy\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.678652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-host-slash\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.678652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678586 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dec8ac44-a1bb-46a0-b8df-f74d8f2eed41-host-slash\") pod \"iptables-alerter-drdm6\" (UID: \"dec8ac44-a1bb-46a0-b8df-f74d8f2eed41\") " pod="openshift-network-operator/iptables-alerter-drdm6" Jul 06 20:35:21.678652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678614 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfq6w\" (UniqueName: \"kubernetes.io/projected/e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be-kube-api-access-vfq6w\") pod \"aws-ebs-csi-driver-node-nprkp\" (UID: \"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.678652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678627 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/29c1a80a-f71a-441d-95e2-d93c4af98b05-hosts-file\") pod \"node-resolver-f8xd2\" (UID: \"29c1a80a-f71a-441d-95e2-d93c4af98b05\") " pod="openshift-dns/node-resolver-f8xd2" Jul 06 20:35:21.678652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678643 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7e0461f6-131b-4abf-a2ba-aa052aaeab10-etc-tuned\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.679298 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678685 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/634f80f3-2281-4cea-aa6d-d2d1062a85de-konnectivity-ca\") pod \"konnectivity-agent-28l4w\" (UID: \"634f80f3-2281-4cea-aa6d-d2d1062a85de\") " pod="kube-system/konnectivity-agent-28l4w" Jul 06 20:35:21.679298 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678711 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.679298 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-system-cni-dir\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.679298 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678766 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-multus-socket-dir-parent\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.679298 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678792 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/216749c6-ecf4-44ab-a86c-a72f5d91747e-multus-daemon-config\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.679298 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678829 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 20:35:21.679298 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678817 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-host-run-multus-certs\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.679298 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678883 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-system-cni-dir\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.679298 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678890 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a7932580-f409-41e2-b455-6391cdabe96f-ovnkube-config\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.679298 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.678959 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-multus-socket-dir-parent\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.679298 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679066 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7932580-f409-41e2-b455-6391cdabe96f-ovn-node-metrics-cert\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.679298 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679103 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.679298 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679105 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a71ef46f-aee4-4690-9668-324e344d1818-serviceca\") pod \"node-ca-gvgt6\" (UID: \"a71ef46f-aee4-4690-9668-324e344d1818\") " pod="openshift-image-registry/node-ca-gvgt6" Jul 06 20:35:21.679298 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679230 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29c1a80a-f71a-441d-95e2-d93c4af98b05-tmp-dir\") pod \"node-resolver-f8xd2\" (UID: \"29c1a80a-f71a-441d-95e2-d93c4af98b05\") " pod="openshift-dns/node-resolver-f8xd2" Jul 06 20:35:21.679298 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679251 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-multus-cni-dir\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.679298 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679278 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-run-ovn\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.679298 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679306 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dec8ac44-a1bb-46a0-b8df-f74d8f2eed41-iptables-alerter-script\") pod \"iptables-alerter-drdm6\" (UID: \"dec8ac44-a1bb-46a0-b8df-f74d8f2eed41\") " pod="openshift-network-operator/iptables-alerter-drdm6" Jul 06 20:35:21.680012 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679363 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/634f80f3-2281-4cea-aa6d-d2d1062a85de-konnectivity-ca\") pod \"konnectivity-agent-28l4w\" (UID: \"634f80f3-2281-4cea-aa6d-d2d1062a85de\") " pod="kube-system/konnectivity-agent-28l4w" Jul 06 20:35:21.680012 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679390 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-host-var-lib-cni-bin\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.680012 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679437 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbh6p\" (UniqueName: \"kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p\") pod \"network-check-target-2w6mq\" (UID: \"d4af3c2d-fc4f-4558-9f58-826f7ccc10f0\") " pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:21.680012 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679463 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-etc-modprobe-d\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.680012 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-host-run-k8s-cni-cncf-io\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.680012 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679526 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20f81617-cdb7-4364-b3de-43e1a7fc32d2-dbus\") pod \"global-pull-secret-syncer-qrmdw\" (UID: \"20f81617-cdb7-4364-b3de-43e1a7fc32d2\") " pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:21.680012 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679530 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a71ef46f-aee4-4690-9668-324e344d1818-serviceca\") pod \"node-ca-gvgt6\" (UID: \"a71ef46f-aee4-4690-9668-324e344d1818\") " pod="openshift-image-registry/node-ca-gvgt6" Jul 06 20:35:21.680012 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679595 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-var-lib-openvswitch\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.680012 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679600 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-host-run-k8s-cni-cncf-io\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.680012 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679627 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-etc-openvswitch\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.680012 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679656 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-host-cni-netd\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.680012 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679677 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sd6j\" (UniqueName: \"kubernetes.io/projected/dec8ac44-a1bb-46a0-b8df-f74d8f2eed41-kube-api-access-2sd6j\") pod \"iptables-alerter-drdm6\" (UID: \"dec8ac44-a1bb-46a0-b8df-f74d8f2eed41\") " pod="openshift-network-operator/iptables-alerter-drdm6" Jul 06 20:35:21.680012 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679687 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-host-var-lib-cni-bin\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.680012 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679697 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be-sys-fs\") pod \"aws-ebs-csi-driver-node-nprkp\" (UID: \"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.680012 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679718 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-var-lib-kubelet\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.680012 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679656 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-host-run-multus-certs\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.680012 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679754 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xstm\" (UniqueName: \"kubernetes.io/projected/a71ef46f-aee4-4690-9668-324e344d1818-kube-api-access-8xstm\") pod \"node-ca-gvgt6\" (UID: \"a71ef46f-aee4-4690-9668-324e344d1818\") " pod="openshift-image-registry/node-ca-gvgt6" Jul 06 20:35:21.680626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679771 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.680626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679791 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-os-release\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.680626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679825 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20f81617-cdb7-4364-b3de-43e1a7fc32d2-dbus\") pod \"global-pull-secret-syncer-qrmdw\" (UID: \"20f81617-cdb7-4364-b3de-43e1a7fc32d2\") " pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:21.680626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679817 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret\") pod \"global-pull-secret-syncer-qrmdw\" (UID: \"20f81617-cdb7-4364-b3de-43e1a7fc32d2\") " pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:21.680626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679855 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-host-cni-bin\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.680626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679872 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a7932580-f409-41e2-b455-6391cdabe96f-ovnkube-script-lib\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.680626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679887 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-etc-kubernetes\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.680626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679906 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-etc-systemd\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.680626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679916 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/216749c6-ecf4-44ab-a86c-a72f5d91747e-multus-daemon-config\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.680626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679974 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a71ef46f-aee4-4690-9668-324e344d1818-host\") pod \"node-ca-gvgt6\" (UID: \"a71ef46f-aee4-4690-9668-324e344d1818\") " pod="openshift-image-registry/node-ca-gvgt6" Jul 06 20:35:21.680626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.679924 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a71ef46f-aee4-4690-9668-324e344d1818-host\") pod \"node-ca-gvgt6\" (UID: \"a71ef46f-aee4-4690-9668-324e344d1818\") " pod="openshift-image-registry/node-ca-gvgt6" Jul 06 20:35:21.680626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680080 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29c1a80a-f71a-441d-95e2-d93c4af98b05-tmp-dir\") pod \"node-resolver-f8xd2\" (UID: \"29c1a80a-f71a-441d-95e2-d93c4af98b05\") " pod="openshift-dns/node-resolver-f8xd2" Jul 06 20:35:21.680626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680148 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-multus-cni-dir\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.680626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680172 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-run-openvswitch\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.680626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680200 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a7932580-f409-41e2-b455-6391cdabe96f-env-overrides\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.680626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680219 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frqgd\" (UniqueName: \"kubernetes.io/projected/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-kube-api-access-frqgd\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.680626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680259 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-log-socket\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.681476 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680277 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-host-run-netns\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.681476 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680296 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.681476 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-cnibin\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.681476 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-os-release\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.681476 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680385 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-os-release\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.681476 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680399 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-host-run-netns\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.681476 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680573 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-os-release\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.681476 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680612 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-system-cni-dir\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.681476 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680649 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-etc-sysconfig\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.681476 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:21.680662 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:21.681476 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680680 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-cnibin\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.681476 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:21.680719 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret podName:20f81617-cdb7-4364-b3de-43e1a7fc32d2 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:22.180697381 +0000 UTC m=+2.999842974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret") pod "global-pull-secret-syncer-qrmdw" (UID: "20f81617-cdb7-4364-b3de-43e1a7fc32d2") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:21.681476 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680729 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-system-cni-dir\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.681476 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680752 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-systemd-units\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.681476 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680796 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be-etc-selinux\") pod \"aws-ebs-csi-driver-node-nprkp\" (UID: \"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.681476 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680815 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-etc-sysctl-d\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.681476 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680853 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-run\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.682384 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680888 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s2cq\" (UniqueName: \"kubernetes.io/projected/29c1a80a-f71a-441d-95e2-d93c4af98b05-kube-api-access-8s2cq\") pod \"node-resolver-f8xd2\" (UID: \"29c1a80a-f71a-441d-95e2-d93c4af98b05\") " pod="openshift-dns/node-resolver-f8xd2" Jul 06 20:35:21.682384 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680930 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-etc-kubernetes\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.682384 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.680989 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-host-run-ovn-kubernetes\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.682384 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.681048 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-etc-sysctl-conf\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.682384 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.681076 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-etc-kubernetes\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.682384 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.681129 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-run-systemd\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.682384 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.681158 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-node-log\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.682384 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.681201 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.682384 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.681224 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc2rm\" (UniqueName: \"kubernetes.io/projected/a7932580-f409-41e2-b455-6391cdabe96f-kube-api-access-nc2rm\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.682384 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.681288 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nprkp\" (UID: \"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.682384 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.681355 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-host\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.682384 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.681377 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e0461f6-131b-4abf-a2ba-aa052aaeab10-tmp\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.682384 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.681398 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-hostroot\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.682384 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.681429 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-host-kubelet\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.682384 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.681460 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-hostroot\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.682384 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.681516 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.682384 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.681546 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-multus-conf-dir\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.683240 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.681571 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q27r2\" (UniqueName: \"kubernetes.io/projected/216749c6-ecf4-44ab-a86c-a72f5d91747e-kube-api-access-q27r2\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.683240 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.681596 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be-socket-dir\") pod \"aws-ebs-csi-driver-node-nprkp\" (UID: \"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.683240 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.681634 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/216749c6-ecf4-44ab-a86c-a72f5d91747e-multus-conf-dir\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.683240 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.682216 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.683715 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.683697 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/634f80f3-2281-4cea-aa6d-d2d1062a85de-agent-certs\") pod \"konnectivity-agent-28l4w\" (UID: \"634f80f3-2281-4cea-aa6d-d2d1062a85de\") " pod="kube-system/konnectivity-agent-28l4w" Jul 06 20:35:21.687070 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.687046 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l62j9\" (UniqueName: \"kubernetes.io/projected/e3eec97f-a1ba-4160-ab43-ce2fda50659b-kube-api-access-l62j9\") pod \"network-metrics-daemon-sw6qp\" (UID: \"e3eec97f-a1ba-4160-ab43-ce2fda50659b\") " pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:21.688734 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.688710 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xstm\" (UniqueName: \"kubernetes.io/projected/a71ef46f-aee4-4690-9668-324e344d1818-kube-api-access-8xstm\") pod \"node-ca-gvgt6\" (UID: \"a71ef46f-aee4-4690-9668-324e344d1818\") " pod="openshift-image-registry/node-ca-gvgt6" Jul 06 20:35:21.689501 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.689478 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s2cq\" (UniqueName: \"kubernetes.io/projected/29c1a80a-f71a-441d-95e2-d93c4af98b05-kube-api-access-8s2cq\") pod \"node-resolver-f8xd2\" (UID: \"29c1a80a-f71a-441d-95e2-d93c4af98b05\") " pod="openshift-dns/node-resolver-f8xd2" Jul 06 20:35:21.690270 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.690237 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q27r2\" (UniqueName: \"kubernetes.io/projected/216749c6-ecf4-44ab-a86c-a72f5d91747e-kube-api-access-q27r2\") pod \"multus-xpwf2\" (UID: \"216749c6-ecf4-44ab-a86c-a72f5d91747e\") " pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.690476 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.690456 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frqgd\" (UniqueName: \"kubernetes.io/projected/edad7ba3-27f4-4301-a1e0-02ed562c8ca9-kube-api-access-frqgd\") pod \"multus-additional-cni-plugins-hhlrw\" (UID: \"edad7ba3-27f4-4301-a1e0-02ed562c8ca9\") " pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.707517 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.707462 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-125.ec2.internal" event={"ID":"73d7c4a409d43abc3672000c2f9d10d0","Type":"ContainerStarted","Data":"495114d908cef4069a1c7f3f85d179af82dab032d0257339d02b07d7e565c3c2"} Jul 06 20:35:21.708961 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.708926 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" event={"ID":"07cc2de8cb98e91a5f3c674fe90aba6e","Type":"ContainerStarted","Data":"a838630aa4204e9139f484b969c266da65f19a7b79482eb95ba472bea7893dc4"} Jul 06 20:35:21.782544 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.782510 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-host-run-netns\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.782544 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.782545 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be-registration-dir\") pod \"aws-ebs-csi-driver-node-nprkp\" (UID: \"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.782760 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.782562 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-lib-modules\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.782760 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.782591 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-sys\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.782760 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.782615 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be-device-dir\") pod \"aws-ebs-csi-driver-node-nprkp\" (UID: \"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.782760 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.782634 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ffj5\" (UniqueName: \"kubernetes.io/projected/7e0461f6-131b-4abf-a2ba-aa052aaeab10-kube-api-access-5ffj5\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.782760 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.782657 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-host-slash\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.782760 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.782681 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dec8ac44-a1bb-46a0-b8df-f74d8f2eed41-host-slash\") pod \"iptables-alerter-drdm6\" (UID: \"dec8ac44-a1bb-46a0-b8df-f74d8f2eed41\") " pod="openshift-network-operator/iptables-alerter-drdm6" Jul 06 20:35:21.782760 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.782705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfq6w\" (UniqueName: \"kubernetes.io/projected/e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be-kube-api-access-vfq6w\") pod \"aws-ebs-csi-driver-node-nprkp\" (UID: \"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.782760 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.782722 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7e0461f6-131b-4abf-a2ba-aa052aaeab10-etc-tuned\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.782760 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.782740 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a7932580-f409-41e2-b455-6391cdabe96f-ovnkube-config\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.782760 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.782754 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7932580-f409-41e2-b455-6391cdabe96f-ovn-node-metrics-cert\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.783253 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.782774 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-run-ovn\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.783253 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.782911 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-host-slash\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.783253 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.782954 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-host-run-netns\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.783253 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.782999 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be-registration-dir\") pod \"aws-ebs-csi-driver-node-nprkp\" (UID: \"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.783253 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.783099 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-lib-modules\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.783253 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.783133 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-sys\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.783253 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.783172 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be-device-dir\") pod \"aws-ebs-csi-driver-node-nprkp\" (UID: \"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.785765 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.783720 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dec8ac44-a1bb-46a0-b8df-f74d8f2eed41-host-slash\") pod \"iptables-alerter-drdm6\" (UID: \"dec8ac44-a1bb-46a0-b8df-f74d8f2eed41\") " pod="openshift-network-operator/iptables-alerter-drdm6" Jul 06 20:35:21.785765 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.783795 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-run-ovn\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.785765 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.783829 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dec8ac44-a1bb-46a0-b8df-f74d8f2eed41-iptables-alerter-script\") pod \"iptables-alerter-drdm6\" (UID: \"dec8ac44-a1bb-46a0-b8df-f74d8f2eed41\") " pod="openshift-network-operator/iptables-alerter-drdm6" Jul 06 20:35:21.785765 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.783887 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbh6p\" (UniqueName: \"kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p\") pod \"network-check-target-2w6mq\" (UID: \"d4af3c2d-fc4f-4558-9f58-826f7ccc10f0\") " pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:21.785765 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.783915 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-etc-modprobe-d\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.785765 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.783945 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-var-lib-openvswitch\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.785765 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.783975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-etc-openvswitch\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.785765 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784001 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-host-cni-netd\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.785765 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784025 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sd6j\" (UniqueName: \"kubernetes.io/projected/dec8ac44-a1bb-46a0-b8df-f74d8f2eed41-kube-api-access-2sd6j\") pod \"iptables-alerter-drdm6\" (UID: \"dec8ac44-a1bb-46a0-b8df-f74d8f2eed41\") " pod="openshift-network-operator/iptables-alerter-drdm6" Jul 06 20:35:21.785765 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784052 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be-sys-fs\") pod \"aws-ebs-csi-driver-node-nprkp\" (UID: \"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.785765 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784074 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-var-lib-kubelet\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.785765 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784111 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-host-cni-bin\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.785765 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784142 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a7932580-f409-41e2-b455-6391cdabe96f-ovnkube-script-lib\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.785765 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784150 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-etc-modprobe-d\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.785765 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784166 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-etc-kubernetes\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.785765 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784191 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-etc-systemd\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.785765 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784250 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-etc-systemd\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.786758 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784299 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-var-lib-openvswitch\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.786758 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784344 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-etc-openvswitch\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.786758 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784358 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a7932580-f409-41e2-b455-6391cdabe96f-ovnkube-config\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.786758 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784388 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-host-cni-netd\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.786758 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784580 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be-sys-fs\") pod \"aws-ebs-csi-driver-node-nprkp\" (UID: \"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.786758 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784639 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-var-lib-kubelet\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.786758 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784690 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-host-cni-bin\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.786758 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784716 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dec8ac44-a1bb-46a0-b8df-f74d8f2eed41-iptables-alerter-script\") pod \"iptables-alerter-drdm6\" (UID: \"dec8ac44-a1bb-46a0-b8df-f74d8f2eed41\") " pod="openshift-network-operator/iptables-alerter-drdm6" Jul 06 20:35:21.786758 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784758 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-run-openvswitch\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.786758 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a7932580-f409-41e2-b455-6391cdabe96f-env-overrides\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.786758 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784825 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-log-socket\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.786758 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784864 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-etc-kubernetes\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.786758 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784883 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-etc-sysconfig\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.786758 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784911 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-systemd-units\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.786758 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784937 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be-etc-selinux\") pod \"aws-ebs-csi-driver-node-nprkp\" (UID: \"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.786758 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784960 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-etc-sysctl-d\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.786758 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.784984 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-run\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.787591 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785011 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-host-run-ovn-kubernetes\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.787591 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785036 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-etc-sysctl-conf\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.787591 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785060 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-run-systemd\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.787591 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785090 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-node-log\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.787591 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785119 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.787591 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785147 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc2rm\" (UniqueName: \"kubernetes.io/projected/a7932580-f409-41e2-b455-6391cdabe96f-kube-api-access-nc2rm\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.787591 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785171 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nprkp\" (UID: \"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.787591 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785197 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-host\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.787591 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785203 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a7932580-f409-41e2-b455-6391cdabe96f-ovnkube-script-lib\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.787591 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785221 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e0461f6-131b-4abf-a2ba-aa052aaeab10-tmp\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.787591 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785235 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a7932580-f409-41e2-b455-6391cdabe96f-env-overrides\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.787591 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785248 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-host-kubelet\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.787591 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785263 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-run-openvswitch\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.787591 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785291 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-host-kubelet\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.787591 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785291 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be-socket-dir\") pod \"aws-ebs-csi-driver-node-nprkp\" (UID: \"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.787591 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785325 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-run-systemd\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.787591 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785355 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-node-log\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.788353 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785392 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-etc-sysctl-conf\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.788353 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785392 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.788353 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785414 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be-socket-dir\") pod \"aws-ebs-csi-driver-node-nprkp\" (UID: \"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.788353 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785440 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-log-socket\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.788353 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785451 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nprkp\" (UID: \"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.788353 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785501 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-host\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.788353 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785554 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be-etc-selinux\") pod \"aws-ebs-csi-driver-node-nprkp\" (UID: \"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.788353 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785600 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-etc-sysconfig\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.788353 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785637 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-systemd-units\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.788353 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785681 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-run\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.788353 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785719 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7932580-f409-41e2-b455-6391cdabe96f-host-run-ovn-kubernetes\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.788353 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.785719 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7e0461f6-131b-4abf-a2ba-aa052aaeab10-etc-sysctl-d\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.789232 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.789039 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e0461f6-131b-4abf-a2ba-aa052aaeab10-tmp\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.789232 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.789080 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7e0461f6-131b-4abf-a2ba-aa052aaeab10-etc-tuned\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.790722 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:21.790360 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:35:21.790722 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:21.790387 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:35:21.790722 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:21.790402 2577 projected.go:196] Error preparing data for projected volume kube-api-access-wbh6p for pod openshift-network-diagnostics/network-check-target-2w6mq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:21.790722 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:21.790478 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p podName:d4af3c2d-fc4f-4558-9f58-826f7ccc10f0 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:22.290459922 +0000 UTC m=+3.109605513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wbh6p" (UniqueName: "kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p") pod "network-check-target-2w6mq" (UID: "d4af3c2d-fc4f-4558-9f58-826f7ccc10f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:21.791932 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.791816 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7932580-f409-41e2-b455-6391cdabe96f-ovn-node-metrics-cert\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.792745 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.792719 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ffj5\" (UniqueName: \"kubernetes.io/projected/7e0461f6-131b-4abf-a2ba-aa052aaeab10-kube-api-access-5ffj5\") pod \"tuned-6g2rz\" (UID: \"7e0461f6-131b-4abf-a2ba-aa052aaeab10\") " pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:21.793538 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.793514 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sd6j\" (UniqueName: \"kubernetes.io/projected/dec8ac44-a1bb-46a0-b8df-f74d8f2eed41-kube-api-access-2sd6j\") pod \"iptables-alerter-drdm6\" (UID: \"dec8ac44-a1bb-46a0-b8df-f74d8f2eed41\") " pod="openshift-network-operator/iptables-alerter-drdm6" Jul 06 20:35:21.793691 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.793535 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfq6w\" (UniqueName: \"kubernetes.io/projected/e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be-kube-api-access-vfq6w\") pod \"aws-ebs-csi-driver-node-nprkp\" (UID: \"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.794470 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.794448 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc2rm\" (UniqueName: \"kubernetes.io/projected/a7932580-f409-41e2-b455-6391cdabe96f-kube-api-access-nc2rm\") pod \"ovnkube-node-j8722\" (UID: \"a7932580-f409-41e2-b455-6391cdabe96f\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.872382 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.872281 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-28l4w" Jul 06 20:35:21.893938 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.893908 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xpwf2" Jul 06 20:35:21.903870 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.903842 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gvgt6" Jul 06 20:35:21.910841 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.910818 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f8xd2" Jul 06 20:35:21.920656 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.920635 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hhlrw" Jul 06 20:35:21.925519 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.925502 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:21.938392 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.938368 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-drdm6" Jul 06 20:35:21.946376 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.946353 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" Jul 06 20:35:21.961077 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:21.961057 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" Jul 06 20:35:22.116229 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:22.116191 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:35:22.189604 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:22.189516 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs\") pod \"network-metrics-daemon-sw6qp\" (UID: \"e3eec97f-a1ba-4160-ab43-ce2fda50659b\") " pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:22.189756 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:22.189618 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret\") pod \"global-pull-secret-syncer-qrmdw\" (UID: \"20f81617-cdb7-4364-b3de-43e1a7fc32d2\") " pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:22.189756 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:22.189690 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:22.189756 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:22.189734 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:22.189756 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:22.189753 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs podName:e3eec97f-a1ba-4160-ab43-ce2fda50659b nodeName:}" failed. No retries permitted until 2026-07-06 20:35:23.189736923 +0000 UTC m=+4.008882514 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs") pod "network-metrics-daemon-sw6qp" (UID: "e3eec97f-a1ba-4160-ab43-ce2fda50659b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:22.189966 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:22.189811 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret podName:20f81617-cdb7-4364-b3de-43e1a7fc32d2 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:23.189792233 +0000 UTC m=+4.008937842 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret") pod "global-pull-secret-syncer-qrmdw" (UID: "20f81617-cdb7-4364-b3de-43e1a7fc32d2") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:22.391151 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:22.391111 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbh6p\" (UniqueName: \"kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p\") pod \"network-check-target-2w6mq\" (UID: \"d4af3c2d-fc4f-4558-9f58-826f7ccc10f0\") " pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:22.391354 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:22.391310 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:35:22.391354 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:22.391331 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:35:22.391354 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:22.391350 2577 projected.go:196] Error preparing data for projected volume kube-api-access-wbh6p for pod openshift-network-diagnostics/network-check-target-2w6mq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:22.391500 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:22.391410 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p podName:d4af3c2d-fc4f-4558-9f58-826f7ccc10f0 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:23.391391235 +0000 UTC m=+4.210536845 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wbh6p" (UniqueName: "kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p") pod "network-check-target-2w6mq" (UID: "d4af3c2d-fc4f-4558-9f58-826f7ccc10f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:22.610460 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:22.610415 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:30:22 +0000 UTC" deadline="2028-02-28 06:15:36.10032742 +0000 UTC" Jul 06 20:35:22.610460 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:22.610452 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14433h40m13.48987833s" Jul 06 20:35:22.697537 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:22.697494 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:22.697701 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:22.697635 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw6qp" podUID="e3eec97f-a1ba-4160-ab43-ce2fda50659b" Jul 06 20:35:22.697701 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:22.697687 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:22.697852 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:22.697805 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrmdw" podUID="20f81617-cdb7-4364-b3de-43e1a7fc32d2" Jul 06 20:35:22.906729 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:22.906685 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29c1a80a_f71a_441d_95e2_d93c4af98b05.slice/crio-b3d5c6f227a5db6bf9746cc6a7f9204c6b9172f43650bd524d30522830e05f0f WatchSource:0}: Error finding container b3d5c6f227a5db6bf9746cc6a7f9204c6b9172f43650bd524d30522830e05f0f: Status 404 returned error can't find the container with id b3d5c6f227a5db6bf9746cc6a7f9204c6b9172f43650bd524d30522830e05f0f Jul 06 20:35:22.909831 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:22.909757 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7932580_f409_41e2_b455_6391cdabe96f.slice/crio-cb4971a5a26ab7107dea61734b1c296311148e60ad8c6066cd8ac6f273636ebe WatchSource:0}: Error finding container cb4971a5a26ab7107dea61734b1c296311148e60ad8c6066cd8ac6f273636ebe: Status 404 returned error can't find the container with id cb4971a5a26ab7107dea61734b1c296311148e60ad8c6066cd8ac6f273636ebe Jul 06 20:35:22.919866 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:22.919667 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0461f6_131b_4abf_a2ba_aa052aaeab10.slice/crio-50db3ef3bf69d229215651020ee659d5126cdf92e48c7ce8fe775b6ab2e93cdf WatchSource:0}: Error finding container 50db3ef3bf69d229215651020ee659d5126cdf92e48c7ce8fe775b6ab2e93cdf: Status 404 returned error can't find the container with id 50db3ef3bf69d229215651020ee659d5126cdf92e48c7ce8fe775b6ab2e93cdf Jul 06 20:35:22.921377 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:22.921251 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod216749c6_ecf4_44ab_a86c_a72f5d91747e.slice/crio-fbbc253f7304ec91d4929055f0cb198a893acf0653cd30c1fe5556092dac21d5 WatchSource:0}: Error finding container fbbc253f7304ec91d4929055f0cb198a893acf0653cd30c1fe5556092dac21d5: Status 404 returned error can't find the container with id fbbc253f7304ec91d4929055f0cb198a893acf0653cd30c1fe5556092dac21d5 Jul 06 20:35:22.922279 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:22.922221 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec8ac44_a1bb_46a0_b8df_f74d8f2eed41.slice/crio-e76d028f9f8f6d8dd9b74a95f86fa3bf4c67fe5b3b34520f6c0fea2396f53e7d WatchSource:0}: Error finding container e76d028f9f8f6d8dd9b74a95f86fa3bf4c67fe5b3b34520f6c0fea2396f53e7d: Status 404 returned error can't find the container with id e76d028f9f8f6d8dd9b74a95f86fa3bf4c67fe5b3b34520f6c0fea2396f53e7d Jul 06 20:35:22.923744 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:22.923710 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedad7ba3_27f4_4301_a1e0_02ed562c8ca9.slice/crio-c202892dfeed1e6272cfb199c928545cf371388e07bff57902199c72bfb3fab9 WatchSource:0}: Error finding container c202892dfeed1e6272cfb199c928545cf371388e07bff57902199c72bfb3fab9: Status 404 returned error can't find the container with id c202892dfeed1e6272cfb199c928545cf371388e07bff57902199c72bfb3fab9 Jul 06 20:35:22.924954 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:22.924862 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod634f80f3_2281_4cea_aa6d_d2d1062a85de.slice/crio-dbfd941453ae81f80f60e094a8ba220f77afeb06a5f943d2dedc6d8b6daaa6d5 WatchSource:0}: Error finding container dbfd941453ae81f80f60e094a8ba220f77afeb06a5f943d2dedc6d8b6daaa6d5: Status 404 returned error can't find the container with id dbfd941453ae81f80f60e094a8ba220f77afeb06a5f943d2dedc6d8b6daaa6d5 Jul 06 20:35:22.939787 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:22.939734 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda71ef46f_aee4_4690_9668_324e344d1818.slice/crio-1796f4d6b9dbee41db7a9cc56f6f43dae3d550f53559a0b22c270dff77bc5b2c WatchSource:0}: Error finding container 1796f4d6b9dbee41db7a9cc56f6f43dae3d550f53559a0b22c270dff77bc5b2c: Status 404 returned error can't find the container with id 1796f4d6b9dbee41db7a9cc56f6f43dae3d550f53559a0b22c270dff77bc5b2c Jul 06 20:35:22.941052 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:22.941018 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6b3b0f8_f721_4cb8_bc93_2a2c2511f0be.slice/crio-2440bea629c5e6a2b0c5fb8966e1bec19267361df36b2565f1dc85f2396ae6b5 WatchSource:0}: Error finding container 2440bea629c5e6a2b0c5fb8966e1bec19267361df36b2565f1dc85f2396ae6b5: Status 404 returned error can't find the container with id 2440bea629c5e6a2b0c5fb8966e1bec19267361df36b2565f1dc85f2396ae6b5 Jul 06 20:35:23.196524 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:23.196501 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs\") pod \"network-metrics-daemon-sw6qp\" (UID: \"e3eec97f-a1ba-4160-ab43-ce2fda50659b\") " pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:23.196630 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:23.196554 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret\") pod \"global-pull-secret-syncer-qrmdw\" (UID: \"20f81617-cdb7-4364-b3de-43e1a7fc32d2\") " pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:23.197023 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:23.196993 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:23.197174 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:23.197065 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:23.197174 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:23.197082 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs podName:e3eec97f-a1ba-4160-ab43-ce2fda50659b nodeName:}" failed. No retries permitted until 2026-07-06 20:35:25.19706035 +0000 UTC m=+6.016205942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs") pod "network-metrics-daemon-sw6qp" (UID: "e3eec97f-a1ba-4160-ab43-ce2fda50659b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:23.197174 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:23.197139 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret podName:20f81617-cdb7-4364-b3de-43e1a7fc32d2 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:25.197120475 +0000 UTC m=+6.016266064 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret") pod "global-pull-secret-syncer-qrmdw" (UID: "20f81617-cdb7-4364-b3de-43e1a7fc32d2") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:23.397587 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:23.397548 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbh6p\" (UniqueName: \"kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p\") pod \"network-check-target-2w6mq\" (UID: \"d4af3c2d-fc4f-4558-9f58-826f7ccc10f0\") " pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:23.397857 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:23.397817 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:35:23.397857 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:23.397849 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:35:23.398009 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:23.397865 2577 projected.go:196] Error preparing data for projected volume kube-api-access-wbh6p for pod openshift-network-diagnostics/network-check-target-2w6mq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:23.398009 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:23.397927 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p podName:d4af3c2d-fc4f-4558-9f58-826f7ccc10f0 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:25.397905927 +0000 UTC m=+6.217051517 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wbh6p" (UniqueName: "kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p") pod "network-check-target-2w6mq" (UID: "d4af3c2d-fc4f-4558-9f58-826f7ccc10f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:23.610871 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:23.610581 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:30:22 +0000 UTC" deadline="2028-04-08 17:17:52.465999582 +0000 UTC" Jul 06 20:35:23.610871 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:23.610640 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15404h42m28.855363663s" Jul 06 20:35:23.699276 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:23.699078 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:23.699276 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:23.699220 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w6mq" podUID="d4af3c2d-fc4f-4558-9f58-826f7ccc10f0" Jul 06 20:35:23.731472 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:23.731432 2577 generic.go:356] "Generic (PLEG): container finished" podID="07cc2de8cb98e91a5f3c674fe90aba6e" containerID="b9ebefa5557ae93989c66d12453da78023640ca8a9819f3a8189f7abac32cb09" exitCode=0 Jul 06 20:35:23.732229 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:23.731676 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" event={"ID":"07cc2de8cb98e91a5f3c674fe90aba6e","Type":"ContainerDied","Data":"b9ebefa5557ae93989c66d12453da78023640ca8a9819f3a8189f7abac32cb09"} Jul 06 20:35:23.744912 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:23.744818 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gvgt6" event={"ID":"a71ef46f-aee4-4690-9668-324e344d1818","Type":"ContainerStarted","Data":"1796f4d6b9dbee41db7a9cc56f6f43dae3d550f53559a0b22c270dff77bc5b2c"} Jul 06 20:35:23.772633 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:23.772596 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xpwf2" event={"ID":"216749c6-ecf4-44ab-a86c-a72f5d91747e","Type":"ContainerStarted","Data":"fbbc253f7304ec91d4929055f0cb198a893acf0653cd30c1fe5556092dac21d5"} Jul 06 20:35:23.783788 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:23.783645 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-28l4w" event={"ID":"634f80f3-2281-4cea-aa6d-d2d1062a85de","Type":"ContainerStarted","Data":"dbfd941453ae81f80f60e094a8ba220f77afeb06a5f943d2dedc6d8b6daaa6d5"} Jul 06 20:35:23.800654 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:23.800581 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-drdm6" event={"ID":"dec8ac44-a1bb-46a0-b8df-f74d8f2eed41","Type":"ContainerStarted","Data":"e76d028f9f8f6d8dd9b74a95f86fa3bf4c67fe5b3b34520f6c0fea2396f53e7d"} Jul 06 20:35:23.815401 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:23.814676 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-125.ec2.internal" event={"ID":"73d7c4a409d43abc3672000c2f9d10d0","Type":"ContainerStarted","Data":"6a1d3b3f9858f7e0311a1ff111831deb4925c880773f3d5c31548892e486d95d"} Jul 06 20:35:23.828945 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:23.828912 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" event={"ID":"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be","Type":"ContainerStarted","Data":"2440bea629c5e6a2b0c5fb8966e1bec19267361df36b2565f1dc85f2396ae6b5"} Jul 06 20:35:23.852284 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:23.852208 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhlrw" event={"ID":"edad7ba3-27f4-4301-a1e0-02ed562c8ca9","Type":"ContainerStarted","Data":"c202892dfeed1e6272cfb199c928545cf371388e07bff57902199c72bfb3fab9"} Jul 06 20:35:23.860857 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:23.860743 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" event={"ID":"7e0461f6-131b-4abf-a2ba-aa052aaeab10","Type":"ContainerStarted","Data":"50db3ef3bf69d229215651020ee659d5126cdf92e48c7ce8fe775b6ab2e93cdf"} Jul 06 20:35:23.879353 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:23.879276 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8722" event={"ID":"a7932580-f409-41e2-b455-6391cdabe96f","Type":"ContainerStarted","Data":"cb4971a5a26ab7107dea61734b1c296311148e60ad8c6066cd8ac6f273636ebe"} Jul 06 20:35:23.904031 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:23.903952 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f8xd2" event={"ID":"29c1a80a-f71a-441d-95e2-d93c4af98b05","Type":"ContainerStarted","Data":"b3d5c6f227a5db6bf9746cc6a7f9204c6b9172f43650bd524d30522830e05f0f"} Jul 06 20:35:24.697785 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:24.697084 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:24.697785 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:24.697236 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw6qp" podUID="e3eec97f-a1ba-4160-ab43-ce2fda50659b" Jul 06 20:35:24.697785 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:24.697635 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:24.697785 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:24.697732 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrmdw" podUID="20f81617-cdb7-4364-b3de-43e1a7fc32d2" Jul 06 20:35:24.922535 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:24.922494 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" event={"ID":"07cc2de8cb98e91a5f3c674fe90aba6e","Type":"ContainerStarted","Data":"7d5ba5ad8cff53848d9fbb535b6fe25cbdd6a473ed9b0428b66d8ed74750f974"} Jul 06 20:35:24.938317 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:24.937005 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-125.ec2.internal" podStartSLOduration=3.936982117 podStartE2EDuration="3.936982117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:35:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:23.834905041 +0000 UTC m=+4.654050654" watchObservedRunningTime="2026-07-06 20:35:24.936982117 +0000 UTC m=+5.756127724" Jul 06 20:35:24.938317 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:24.937195 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-125.ec2.internal" podStartSLOduration=3.9371865169999998 podStartE2EDuration="3.937186517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:35:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:24.937076493 +0000 UTC m=+5.756222105" watchObservedRunningTime="2026-07-06 20:35:24.937186517 +0000 UTC m=+5.756332129" Jul 06 20:35:25.211285 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:25.210959 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret\") pod \"global-pull-secret-syncer-qrmdw\" (UID: \"20f81617-cdb7-4364-b3de-43e1a7fc32d2\") " pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:25.211285 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:25.211035 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs\") pod \"network-metrics-daemon-sw6qp\" (UID: \"e3eec97f-a1ba-4160-ab43-ce2fda50659b\") " pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:25.211285 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:25.211204 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:25.211285 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:25.211205 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:25.211285 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:25.211271 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs podName:e3eec97f-a1ba-4160-ab43-ce2fda50659b nodeName:}" failed. No retries permitted until 2026-07-06 20:35:29.211248553 +0000 UTC m=+10.030394157 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs") pod "network-metrics-daemon-sw6qp" (UID: "e3eec97f-a1ba-4160-ab43-ce2fda50659b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:25.211285 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:25.211293 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret podName:20f81617-cdb7-4364-b3de-43e1a7fc32d2 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:29.211282599 +0000 UTC m=+10.030428200 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret") pod "global-pull-secret-syncer-qrmdw" (UID: "20f81617-cdb7-4364-b3de-43e1a7fc32d2") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:25.413305 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:25.412582 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbh6p\" (UniqueName: \"kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p\") pod \"network-check-target-2w6mq\" (UID: \"d4af3c2d-fc4f-4558-9f58-826f7ccc10f0\") " pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:25.413305 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:25.412791 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:35:25.413305 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:25.412833 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:35:25.413305 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:25.412848 2577 projected.go:196] Error preparing data for projected volume kube-api-access-wbh6p for pod openshift-network-diagnostics/network-check-target-2w6mq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:25.413305 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:25.412913 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p podName:d4af3c2d-fc4f-4558-9f58-826f7ccc10f0 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:29.412893761 +0000 UTC m=+10.232039352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wbh6p" (UniqueName: "kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p") pod "network-check-target-2w6mq" (UID: "d4af3c2d-fc4f-4558-9f58-826f7ccc10f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:25.697178 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:25.697092 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:25.697435 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:25.697235 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w6mq" podUID="d4af3c2d-fc4f-4558-9f58-826f7ccc10f0" Jul 06 20:35:26.697705 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:26.697665 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:26.698187 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:26.697839 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrmdw" podUID="20f81617-cdb7-4364-b3de-43e1a7fc32d2" Jul 06 20:35:26.698245 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:26.698192 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:26.698306 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:26.698276 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw6qp" podUID="e3eec97f-a1ba-4160-ab43-ce2fda50659b" Jul 06 20:35:27.699000 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:27.698913 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:27.699454 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:27.699038 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w6mq" podUID="d4af3c2d-fc4f-4558-9f58-826f7ccc10f0" Jul 06 20:35:28.697211 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:28.697140 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:28.697211 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:28.697161 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:28.697451 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:28.697269 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrmdw" podUID="20f81617-cdb7-4364-b3de-43e1a7fc32d2" Jul 06 20:35:28.697524 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:28.697442 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw6qp" podUID="e3eec97f-a1ba-4160-ab43-ce2fda50659b" Jul 06 20:35:29.245736 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:29.245698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs\") pod \"network-metrics-daemon-sw6qp\" (UID: \"e3eec97f-a1ba-4160-ab43-ce2fda50659b\") " pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:29.246156 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:29.245797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret\") pod \"global-pull-secret-syncer-qrmdw\" (UID: \"20f81617-cdb7-4364-b3de-43e1a7fc32d2\") " pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:29.246156 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:29.245927 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:29.246156 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:29.245975 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret podName:20f81617-cdb7-4364-b3de-43e1a7fc32d2 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:37.245961682 +0000 UTC m=+18.065107268 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret") pod "global-pull-secret-syncer-qrmdw" (UID: "20f81617-cdb7-4364-b3de-43e1a7fc32d2") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:29.246366 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:29.246342 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:29.246498 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:29.246398 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs podName:e3eec97f-a1ba-4160-ab43-ce2fda50659b nodeName:}" failed. No retries permitted until 2026-07-06 20:35:37.246380165 +0000 UTC m=+18.065525766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs") pod "network-metrics-daemon-sw6qp" (UID: "e3eec97f-a1ba-4160-ab43-ce2fda50659b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:29.447772 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:29.447643 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbh6p\" (UniqueName: \"kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p\") pod \"network-check-target-2w6mq\" (UID: \"d4af3c2d-fc4f-4558-9f58-826f7ccc10f0\") " pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:29.447945 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:29.447843 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:35:29.447945 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:29.447867 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:35:29.447945 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:29.447876 2577 projected.go:196] Error preparing data for projected volume kube-api-access-wbh6p for pod openshift-network-diagnostics/network-check-target-2w6mq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:29.447945 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:29.447943 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p podName:d4af3c2d-fc4f-4558-9f58-826f7ccc10f0 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:37.447923255 +0000 UTC m=+18.267068844 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wbh6p" (UniqueName: "kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p") pod "network-check-target-2w6mq" (UID: "d4af3c2d-fc4f-4558-9f58-826f7ccc10f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:29.697732 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:29.697647 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:29.697904 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:29.697775 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w6mq" podUID="d4af3c2d-fc4f-4558-9f58-826f7ccc10f0" Jul 06 20:35:30.697426 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:30.697333 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:30.697426 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:30.697383 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:30.697959 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:30.697489 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw6qp" podUID="e3eec97f-a1ba-4160-ab43-ce2fda50659b" Jul 06 20:35:30.697959 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:30.697578 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrmdw" podUID="20f81617-cdb7-4364-b3de-43e1a7fc32d2" Jul 06 20:35:31.697482 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:31.697446 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:31.697926 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:31.697629 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w6mq" podUID="d4af3c2d-fc4f-4558-9f58-826f7ccc10f0" Jul 06 20:35:32.697666 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:32.697635 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:32.698159 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:32.697801 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw6qp" podUID="e3eec97f-a1ba-4160-ab43-ce2fda50659b" Jul 06 20:35:32.698159 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:32.697836 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:32.698159 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:32.697951 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrmdw" podUID="20f81617-cdb7-4364-b3de-43e1a7fc32d2" Jul 06 20:35:33.697258 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:33.697222 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:33.697449 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:33.697354 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w6mq" podUID="d4af3c2d-fc4f-4558-9f58-826f7ccc10f0" Jul 06 20:35:34.697584 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:34.697554 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:34.698044 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:34.697554 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:34.698044 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:34.697693 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw6qp" podUID="e3eec97f-a1ba-4160-ab43-ce2fda50659b" Jul 06 20:35:34.698044 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:34.697795 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrmdw" podUID="20f81617-cdb7-4364-b3de-43e1a7fc32d2" Jul 06 20:35:35.696848 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:35.696812 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:35.697050 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:35.696955 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w6mq" podUID="d4af3c2d-fc4f-4558-9f58-826f7ccc10f0" Jul 06 20:35:36.696974 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:36.696939 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:36.697448 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:36.697073 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw6qp" podUID="e3eec97f-a1ba-4160-ab43-ce2fda50659b" Jul 06 20:35:36.697448 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:36.697104 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:36.697448 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:36.697175 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrmdw" podUID="20f81617-cdb7-4364-b3de-43e1a7fc32d2" Jul 06 20:35:37.311466 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:37.311425 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret\") pod \"global-pull-secret-syncer-qrmdw\" (UID: \"20f81617-cdb7-4364-b3de-43e1a7fc32d2\") " pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:37.311649 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:37.311476 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs\") pod \"network-metrics-daemon-sw6qp\" (UID: \"e3eec97f-a1ba-4160-ab43-ce2fda50659b\") " pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:37.311649 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:37.311581 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:37.311649 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:37.311582 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:37.311649 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:37.311636 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs podName:e3eec97f-a1ba-4160-ab43-ce2fda50659b nodeName:}" failed. No retries permitted until 2026-07-06 20:35:53.311621988 +0000 UTC m=+34.130767574 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs") pod "network-metrics-daemon-sw6qp" (UID: "e3eec97f-a1ba-4160-ab43-ce2fda50659b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:37.311649 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:37.311649 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret podName:20f81617-cdb7-4364-b3de-43e1a7fc32d2 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:53.311643645 +0000 UTC m=+34.130789231 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret") pod "global-pull-secret-syncer-qrmdw" (UID: "20f81617-cdb7-4364-b3de-43e1a7fc32d2") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:37.512736 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:37.512699 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbh6p\" (UniqueName: \"kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p\") pod \"network-check-target-2w6mq\" (UID: \"d4af3c2d-fc4f-4558-9f58-826f7ccc10f0\") " pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:37.512933 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:37.512905 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:35:37.513069 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:37.512941 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:35:37.513069 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:37.512955 2577 projected.go:196] Error preparing data for projected volume kube-api-access-wbh6p for pod openshift-network-diagnostics/network-check-target-2w6mq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:37.513069 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:37.513012 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p podName:d4af3c2d-fc4f-4558-9f58-826f7ccc10f0 nodeName:}" failed. No retries permitted until 2026-07-06 20:35:53.512995483 +0000 UTC m=+34.332141070 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wbh6p" (UniqueName: "kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p") pod "network-check-target-2w6mq" (UID: "d4af3c2d-fc4f-4558-9f58-826f7ccc10f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:37.696971 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:37.696903 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:37.697103 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:37.696998 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w6mq" podUID="d4af3c2d-fc4f-4558-9f58-826f7ccc10f0" Jul 06 20:35:38.697419 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:38.697379 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:38.697869 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:38.697514 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw6qp" podUID="e3eec97f-a1ba-4160-ab43-ce2fda50659b" Jul 06 20:35:38.697869 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:38.697583 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:38.697869 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:38.697683 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrmdw" podUID="20f81617-cdb7-4364-b3de-43e1a7fc32d2" Jul 06 20:35:39.698869 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:39.698832 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:39.699292 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:39.698953 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w6mq" podUID="d4af3c2d-fc4f-4558-9f58-826f7ccc10f0" Jul 06 20:35:40.697451 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:40.697414 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:40.697634 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:40.697541 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw6qp" podUID="e3eec97f-a1ba-4160-ab43-ce2fda50659b" Jul 06 20:35:40.697634 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:40.697601 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:40.697752 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:40.697718 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrmdw" podUID="20f81617-cdb7-4364-b3de-43e1a7fc32d2" Jul 06 20:35:41.697325 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:41.697291 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:41.697902 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:41.697429 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w6mq" podUID="d4af3c2d-fc4f-4558-9f58-826f7ccc10f0" Jul 06 20:35:42.697342 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:42.697163 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:42.698078 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:42.697216 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:42.698078 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:42.697427 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw6qp" podUID="e3eec97f-a1ba-4160-ab43-ce2fda50659b" Jul 06 20:35:42.698078 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:42.697546 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrmdw" podUID="20f81617-cdb7-4364-b3de-43e1a7fc32d2" Jul 06 20:35:42.960280 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:42.960042 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-28l4w" event={"ID":"634f80f3-2281-4cea-aa6d-d2d1062a85de","Type":"ContainerStarted","Data":"5e85c89a051c71e2fef2a52565d978ed9b5fbb3346134867104d758472585479"} Jul 06 20:35:42.961413 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:42.961392 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" event={"ID":"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be","Type":"ContainerStarted","Data":"6197aa89c0397c114d7022996c5bb87a727f273d82476428ba0779ba2ee539cf"} Jul 06 20:35:42.965989 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:42.965391 2577 generic.go:356] "Generic (PLEG): container finished" podID="edad7ba3-27f4-4301-a1e0-02ed562c8ca9" containerID="d1b6ae80414b3d5af52976c88a497d9931047f95588dc30511d4939010e087eb" exitCode=0 Jul 06 20:35:42.965989 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:42.965479 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhlrw" event={"ID":"edad7ba3-27f4-4301-a1e0-02ed562c8ca9","Type":"ContainerDied","Data":"d1b6ae80414b3d5af52976c88a497d9931047f95588dc30511d4939010e087eb"} Jul 06 20:35:42.968303 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:42.968272 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" event={"ID":"7e0461f6-131b-4abf-a2ba-aa052aaeab10","Type":"ContainerStarted","Data":"ae4dfc64e8e4dd2d2750c073ab058642609dc065d0f846f4a5a110cedd5edf5b"} Jul 06 20:35:42.970953 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:42.970932 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/ovn-acl-logging/0.log" Jul 06 20:35:42.971626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:42.971278 2577 generic.go:356] "Generic (PLEG): container finished" podID="a7932580-f409-41e2-b455-6391cdabe96f" containerID="d7c1aed09c60a367258c506ca1663626c80f6fc45eb3201728bc1d4547e138d1" exitCode=1 Jul 06 20:35:42.971626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:42.971317 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8722" event={"ID":"a7932580-f409-41e2-b455-6391cdabe96f","Type":"ContainerStarted","Data":"87def1194c729c2058873b13d8689617a53379973c7ffcbe939982ea3015a54a"} Jul 06 20:35:42.971626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:42.971441 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8722" event={"ID":"a7932580-f409-41e2-b455-6391cdabe96f","Type":"ContainerStarted","Data":"69a562d34b9760a448d2c2727a3015f649fbf164a969830c62c8f9682aef802d"} Jul 06 20:35:42.971626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:42.971496 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8722" event={"ID":"a7932580-f409-41e2-b455-6391cdabe96f","Type":"ContainerDied","Data":"d7c1aed09c60a367258c506ca1663626c80f6fc45eb3201728bc1d4547e138d1"} Jul 06 20:35:42.971626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:42.971545 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8722" event={"ID":"a7932580-f409-41e2-b455-6391cdabe96f","Type":"ContainerStarted","Data":"9e9e1eb5b3be8766c28a175bcf2e6a5c6feb045f8287dedef76447a747126eae"} Jul 06 20:35:42.973338 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:42.973305 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f8xd2" event={"ID":"29c1a80a-f71a-441d-95e2-d93c4af98b05","Type":"ContainerStarted","Data":"43ea36c377e24309e0a93fb3466bf7b29bdf8b277eb2a321946b7c4b8f8b813b"} Jul 06 20:35:42.974931 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:42.974907 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gvgt6" event={"ID":"a71ef46f-aee4-4690-9668-324e344d1818","Type":"ContainerStarted","Data":"377e8f53e5fb7e9ad5e825856086b4463d894813f71dc7851cef897f58ede409"} Jul 06 20:35:42.976527 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:42.976506 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xpwf2" event={"ID":"216749c6-ecf4-44ab-a86c-a72f5d91747e","Type":"ContainerStarted","Data":"112bbc46ea04e3ce3a05c7f9a7efe157f9b9c81216b366d5b9bd2e7cf7b0572b"} Jul 06 20:35:42.991590 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:42.991531 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-28l4w" podStartSLOduration=3.725511142 podStartE2EDuration="22.991517247s" totalImagesPullingTime="19.266006105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:42.97691399 +0000 UTC m=+23.796059599" watchObservedRunningTime="2026-07-06 20:35:42.991517247 +0000 UTC m=+23.810662854" Jul 06 20:35:42.991858 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:42.991828 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gvgt6" podStartSLOduration=3.727713031 podStartE2EDuration="22.991818355s" totalImagesPullingTime="19.264105324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:42.991356814 +0000 UTC m=+23.810502421" watchObservedRunningTime="2026-07-06 20:35:42.991818355 +0000 UTC m=+23.810963963" Jul 06 20:35:43.039640 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:43.039584 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xpwf2" podStartSLOduration=3.720534968 podStartE2EDuration="23.039561411s" totalImagesPullingTime="19.319026443s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:43.038624316 +0000 UTC m=+23.857769926" watchObservedRunningTime="2026-07-06 20:35:43.039561411 +0000 UTC m=+23.858707020" Jul 06 20:35:43.054182 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:43.054142 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6g2rz" podStartSLOduration=3.772265764 podStartE2EDuration="23.054129356s" totalImagesPullingTime="19.281863592s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:43.053926248 +0000 UTC m=+23.873071856" watchObservedRunningTime="2026-07-06 20:35:43.054129356 +0000 UTC m=+23.873274964" Jul 06 20:35:43.068571 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:43.068516 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-f8xd2" podStartSLOduration=3.773792887 podStartE2EDuration="23.068501111s" totalImagesPullingTime="19.294708224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:43.068181915 +0000 UTC m=+23.887327525" watchObservedRunningTime="2026-07-06 20:35:43.068501111 +0000 UTC m=+23.887646719" Jul 06 20:35:43.195435 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:43.195356 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:43.281640 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:43.281609 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:43.576732 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:43.576706 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 20:35:43.646852 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:43.646745 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T20:35:43.576728089Z","UUID":"453080b3-f02e-4d6a-a101-9955f6206fd1","Handler":null,"Name":"","Endpoint":""} Jul 06 20:35:43.648442 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:43.648420 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 20:35:43.648560 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:43.648460 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 20:35:43.699225 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:43.697686 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:43.699225 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:43.697826 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w6mq" podUID="d4af3c2d-fc4f-4558-9f58-826f7ccc10f0" Jul 06 20:35:43.983279 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:43.983202 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/ovn-acl-logging/0.log" Jul 06 20:35:43.984123 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:43.984094 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8722" event={"ID":"a7932580-f409-41e2-b455-6391cdabe96f","Type":"ContainerStarted","Data":"60b10fe867b07adbb86108367f04bf1f26210e83c37cd1f12d90fc238862d594"} Jul 06 20:35:43.984214 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:43.984186 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8722" event={"ID":"a7932580-f409-41e2-b455-6391cdabe96f","Type":"ContainerStarted","Data":"b38fbde8d1ade0d2c16669f992e55a3d42f0fd21d362080b803e2073ce1c3e83"} Jul 06 20:35:43.986001 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:43.985947 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-drdm6" event={"ID":"dec8ac44-a1bb-46a0-b8df-f74d8f2eed41","Type":"ContainerStarted","Data":"77a7287835e7415daef2870872e863a91b671aabba282a17e88d4fc65d88104b"} Jul 06 20:35:43.988551 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:43.988515 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" event={"ID":"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be","Type":"ContainerStarted","Data":"78fd64489875ec52d67120e7be0b949bd6dff10521cc4f2935647fd7efcac4fb"} Jul 06 20:35:44.001632 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:44.001580 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-drdm6" podStartSLOduration=4.732958749 podStartE2EDuration="24.001562762s" totalImagesPullingTime="19.268604013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:44.001547716 +0000 UTC m=+24.820693324" watchObservedRunningTime="2026-07-06 20:35:44.001562762 +0000 UTC m=+24.820708388" Jul 06 20:35:44.121170 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:44.121116 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:44.221352 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:44.221300 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:44.697774 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:44.697518 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:44.697933 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:44.697532 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:44.697933 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:44.697839 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw6qp" podUID="e3eec97f-a1ba-4160-ab43-ce2fda50659b" Jul 06 20:35:44.697933 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:44.697862 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrmdw" podUID="20f81617-cdb7-4364-b3de-43e1a7fc32d2" Jul 06 20:35:44.764701 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:44.764673 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-28l4w" Jul 06 20:35:44.765255 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:44.765240 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-28l4w" Jul 06 20:35:44.993647 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:44.993552 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" event={"ID":"e6b3b0f8-f721-4cb8-bc93-2a2c2511f0be","Type":"ContainerStarted","Data":"79d6ea9fea7bc95b6d5f62c5993f78549b3663a15069bd280e2f8c5ebd286dcb"} Jul 06 20:35:45.697184 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:45.697112 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:45.697338 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:45.697242 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w6mq" podUID="d4af3c2d-fc4f-4558-9f58-826f7ccc10f0" Jul 06 20:35:46.000064 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:45.999991 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/ovn-acl-logging/0.log" Jul 06 20:35:46.000530 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:46.000406 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8722" event={"ID":"a7932580-f409-41e2-b455-6391cdabe96f","Type":"ContainerStarted","Data":"505b86ffc2bd357aa82bd343e1d8b03335a808f621d70db017b32d42c52ef6cb"} Jul 06 20:35:46.000530 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:46.000509 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 20:35:46.083064 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:46.083028 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:46.182753 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:46.182707 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:46.697265 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:46.697228 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:46.697461 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:46.697367 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw6qp" podUID="e3eec97f-a1ba-4160-ab43-ce2fda50659b" Jul 06 20:35:46.697461 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:46.697423 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:46.697575 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:46.697543 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrmdw" podUID="20f81617-cdb7-4364-b3de-43e1a7fc32d2" Jul 06 20:35:47.696974 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:47.696802 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:47.697663 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:47.697053 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w6mq" podUID="d4af3c2d-fc4f-4558-9f58-826f7ccc10f0" Jul 06 20:35:47.775156 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:47.775121 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:47.871338 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:47.871298 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:48.006404 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:48.006331 2577 generic.go:356] "Generic (PLEG): container finished" podID="edad7ba3-27f4-4301-a1e0-02ed562c8ca9" containerID="9e792addf00f40d8fc5aff73f69fc4fb3761877ca516ff7ab273f0efb968b368" exitCode=0 Jul 06 20:35:48.006544 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:48.006422 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhlrw" event={"ID":"edad7ba3-27f4-4301-a1e0-02ed562c8ca9","Type":"ContainerDied","Data":"9e792addf00f40d8fc5aff73f69fc4fb3761877ca516ff7ab273f0efb968b368"} Jul 06 20:35:48.010076 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:48.010060 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/ovn-acl-logging/0.log" Jul 06 20:35:48.010416 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:48.010392 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8722" event={"ID":"a7932580-f409-41e2-b455-6391cdabe96f","Type":"ContainerStarted","Data":"b3acfaec80d8fb2a64b6cacd1c09b7b774d1a04dfefb5654320fed1731187144"} Jul 06 20:35:48.010635 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:48.010592 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:48.010747 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:48.010659 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:48.010747 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:48.010697 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:48.010896 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:48.010882 2577 scope.go:117] "RemoveContainer" containerID="d7c1aed09c60a367258c506ca1663626c80f6fc45eb3201728bc1d4547e138d1" Jul 06 20:35:48.027902 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:48.027884 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:48.027993 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:48.027984 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:35:48.033820 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:48.030611 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nprkp" podStartSLOduration=7.057921353 podStartE2EDuration="28.030598309s" totalImagesPullingTime="20.972676956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:35:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:45.012275523 +0000 UTC m=+25.831421132" watchObservedRunningTime="2026-07-06 20:35:48.030598309 +0000 UTC m=+28.849743917" Jul 06 20:35:48.305857 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:48.305827 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:48.316639 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:48.316618 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-28l4w" Jul 06 20:35:48.316774 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:48.316746 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 20:35:48.317117 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:48.317104 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-28l4w" Jul 06 20:35:48.423994 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:48.423962 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:48.495077 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:48.495051 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:48.696974 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:48.696900 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:48.697135 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:48.697037 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw6qp" podUID="e3eec97f-a1ba-4160-ab43-ce2fda50659b" Jul 06 20:35:48.697135 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:48.697092 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:48.697481 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:48.697211 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrmdw" podUID="20f81617-cdb7-4364-b3de-43e1a7fc32d2" Jul 06 20:35:49.016638 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:49.016567 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/ovn-acl-logging/0.log" Jul 06 20:35:49.016991 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:49.016963 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8722" event={"ID":"a7932580-f409-41e2-b455-6391cdabe96f","Type":"ContainerStarted","Data":"79e09d9f657befa433d9fac68fc260a76926953ac7afe8853ec2b2c7f84b5ff5"} Jul 06 20:35:49.019199 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:49.019170 2577 generic.go:356] "Generic (PLEG): container finished" podID="edad7ba3-27f4-4301-a1e0-02ed562c8ca9" containerID="a061904944aa95af003c26b0c15489044dc9d967b40fd1579e5c75cd3a66a81d" exitCode=0 Jul 06 20:35:49.019449 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:49.019329 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhlrw" event={"ID":"edad7ba3-27f4-4301-a1e0-02ed562c8ca9","Type":"ContainerDied","Data":"a061904944aa95af003c26b0c15489044dc9d967b40fd1579e5c75cd3a66a81d"} Jul 06 20:35:49.053715 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:49.053672 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j8722" podStartSLOduration=9.367672027 podStartE2EDuration="29.053658687s" totalImagesPullingTime="19.68598666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:49.053189053 +0000 UTC m=+29.872334672" watchObservedRunningTime="2026-07-06 20:35:49.053658687 +0000 UTC m=+29.872804343" Jul 06 20:35:49.334246 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:49.334068 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qrmdw"] Jul 06 20:35:49.334383 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:49.334352 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:49.334462 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:49.334440 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrmdw" podUID="20f81617-cdb7-4364-b3de-43e1a7fc32d2" Jul 06 20:35:49.334599 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:49.334578 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sw6qp"] Jul 06 20:35:49.334682 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:49.334672 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:49.334841 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:49.334823 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw6qp" podUID="e3eec97f-a1ba-4160-ab43-ce2fda50659b" Jul 06 20:35:49.340508 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:49.340482 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2w6mq"] Jul 06 20:35:49.340609 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:49.340580 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:49.340674 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:49.340657 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w6mq" podUID="d4af3c2d-fc4f-4558-9f58-826f7ccc10f0" Jul 06 20:35:49.374621 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:49.374588 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:49.470884 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:49.470829 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:50.023194 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:50.023118 2577 generic.go:356] "Generic (PLEG): container finished" podID="edad7ba3-27f4-4301-a1e0-02ed562c8ca9" containerID="3e48e4d3f03634017c121db772bc5925c565f97b4de574dfdb7f93ddc87e8fd9" exitCode=0 Jul 06 20:35:50.023634 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:50.023201 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhlrw" event={"ID":"edad7ba3-27f4-4301-a1e0-02ed562c8ca9","Type":"ContainerDied","Data":"3e48e4d3f03634017c121db772bc5925c565f97b4de574dfdb7f93ddc87e8fd9"} Jul 06 20:35:50.697082 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:50.697048 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:50.697264 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:50.697185 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w6mq" podUID="d4af3c2d-fc4f-4558-9f58-826f7ccc10f0" Jul 06 20:35:51.697524 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:51.697449 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:51.697524 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:51.697467 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:51.697974 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:51.697578 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrmdw" podUID="20f81617-cdb7-4364-b3de-43e1a7fc32d2" Jul 06 20:35:51.697974 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:51.697673 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw6qp" podUID="e3eec97f-a1ba-4160-ab43-ce2fda50659b" Jul 06 20:35:51.978281 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:51.978201 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:52.697556 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:52.697518 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:52.698178 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:52.697632 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w6mq" podUID="d4af3c2d-fc4f-4558-9f58-826f7ccc10f0" Jul 06 20:35:53.327098 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:53.327059 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret\") pod \"global-pull-secret-syncer-qrmdw\" (UID: \"20f81617-cdb7-4364-b3de-43e1a7fc32d2\") " pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:53.327312 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:53.327131 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs\") pod \"network-metrics-daemon-sw6qp\" (UID: \"e3eec97f-a1ba-4160-ab43-ce2fda50659b\") " pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:53.327312 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:53.327213 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:53.327312 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:53.327274 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret podName:20f81617-cdb7-4364-b3de-43e1a7fc32d2 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:25.327258542 +0000 UTC m=+66.146404131 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret") pod "global-pull-secret-syncer-qrmdw" (UID: "20f81617-cdb7-4364-b3de-43e1a7fc32d2") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:35:53.327312 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:53.327213 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:53.327537 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:53.327390 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs podName:e3eec97f-a1ba-4160-ab43-ce2fda50659b nodeName:}" failed. No retries permitted until 2026-07-06 20:36:25.32736916 +0000 UTC m=+66.146514751 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs") pod "network-metrics-daemon-sw6qp" (UID: "e3eec97f-a1ba-4160-ab43-ce2fda50659b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:35:53.529173 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:53.529128 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbh6p\" (UniqueName: \"kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p\") pod \"network-check-target-2w6mq\" (UID: \"d4af3c2d-fc4f-4558-9f58-826f7ccc10f0\") " pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:53.529373 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:53.529301 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:35:53.529373 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:53.529331 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:35:53.529373 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:53.529347 2577 projected.go:196] Error preparing data for projected volume kube-api-access-wbh6p for pod openshift-network-diagnostics/network-check-target-2w6mq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:53.529531 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:53.529432 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p podName:d4af3c2d-fc4f-4558-9f58-826f7ccc10f0 nodeName:}" failed. No retries permitted until 2026-07-06 20:36:25.529416615 +0000 UTC m=+66.348562221 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wbh6p" (UniqueName: "kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p") pod "network-check-target-2w6mq" (UID: "d4af3c2d-fc4f-4558-9f58-826f7ccc10f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:35:53.697493 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:53.697422 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:53.697674 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:53.697422 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:53.697674 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:53.697559 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qrmdw" podUID="20f81617-cdb7-4364-b3de-43e1a7fc32d2" Jul 06 20:35:53.697674 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:53.697638 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sw6qp" podUID="e3eec97f-a1ba-4160-ab43-ce2fda50659b" Jul 06 20:35:54.697657 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:54.697625 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:54.697808 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:54.697747 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w6mq" podUID="d4af3c2d-fc4f-4558-9f58-826f7ccc10f0" Jul 06 20:35:54.972840 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:54.972657 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-125.ec2.internal" event="NodeReady" Jul 06 20:35:54.972953 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:54.972941 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 20:35:55.017194 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.017113 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4dr8s"] Jul 06 20:35:55.029313 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.029290 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6vmbc"] Jul 06 20:35:55.029434 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.029420 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4dr8s" Jul 06 20:35:55.032261 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.032232 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h5jj9\"" Jul 06 20:35:55.032391 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.032275 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 20:35:55.032391 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.032280 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 20:35:55.037741 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.037405 2577 generic.go:356] "Generic (PLEG): container finished" podID="edad7ba3-27f4-4301-a1e0-02ed562c8ca9" containerID="5d9164c27ecd232c0d846dd625aa07ca55581542528c6de86de720602afbcce5" exitCode=0 Jul 06 20:35:55.045532 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.045373 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6vmbc"] Jul 06 20:35:55.045532 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.045459 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4dr8s"] Jul 06 20:35:55.045532 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.045489 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhlrw" event={"ID":"edad7ba3-27f4-4301-a1e0-02ed562c8ca9","Type":"ContainerDied","Data":"5d9164c27ecd232c0d846dd625aa07ca55581542528c6de86de720602afbcce5"} Jul 06 20:35:55.045532 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.045498 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6vmbc" Jul 06 20:35:55.048179 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.048160 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 20:35:55.048290 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.048178 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 20:35:55.048411 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.048398 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 20:35:55.049065 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.049049 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c2j6x\"" Jul 06 20:35:55.139805 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.139775 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/978b822b-4b60-4700-b98e-4ba141cdb13f-config-volume\") pod \"dns-default-4dr8s\" (UID: \"978b822b-4b60-4700-b98e-4ba141cdb13f\") " pod="openshift-dns/dns-default-4dr8s" Jul 06 20:35:55.139943 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.139815 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs26g\" (UniqueName: \"kubernetes.io/projected/5f6abc31-2ae7-4ece-a13c-119c410ad425-kube-api-access-xs26g\") pod \"ingress-canary-6vmbc\" (UID: \"5f6abc31-2ae7-4ece-a13c-119c410ad425\") " pod="openshift-ingress-canary/ingress-canary-6vmbc" Jul 06 20:35:55.139993 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.139972 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdpbz\" (UniqueName: \"kubernetes.io/projected/978b822b-4b60-4700-b98e-4ba141cdb13f-kube-api-access-mdpbz\") pod \"dns-default-4dr8s\" (UID: \"978b822b-4b60-4700-b98e-4ba141cdb13f\") " pod="openshift-dns/dns-default-4dr8s" Jul 06 20:35:55.140060 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.140036 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls\") pod \"dns-default-4dr8s\" (UID: \"978b822b-4b60-4700-b98e-4ba141cdb13f\") " pod="openshift-dns/dns-default-4dr8s" Jul 06 20:35:55.140189 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.140175 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f6abc31-2ae7-4ece-a13c-119c410ad425-cert\") pod \"ingress-canary-6vmbc\" (UID: \"5f6abc31-2ae7-4ece-a13c-119c410ad425\") " pod="openshift-ingress-canary/ingress-canary-6vmbc" Jul 06 20:35:55.140225 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.140207 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/978b822b-4b60-4700-b98e-4ba141cdb13f-tmp-dir\") pod \"dns-default-4dr8s\" (UID: \"978b822b-4b60-4700-b98e-4ba141cdb13f\") " pod="openshift-dns/dns-default-4dr8s" Jul 06 20:35:55.147740 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.147709 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:55.240886 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.240864 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f6abc31-2ae7-4ece-a13c-119c410ad425-cert\") pod \"ingress-canary-6vmbc\" (UID: \"5f6abc31-2ae7-4ece-a13c-119c410ad425\") " pod="openshift-ingress-canary/ingress-canary-6vmbc" Jul 06 20:35:55.241006 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.240895 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/978b822b-4b60-4700-b98e-4ba141cdb13f-tmp-dir\") pod \"dns-default-4dr8s\" (UID: \"978b822b-4b60-4700-b98e-4ba141cdb13f\") " pod="openshift-dns/dns-default-4dr8s" Jul 06 20:35:55.241076 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.241053 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/978b822b-4b60-4700-b98e-4ba141cdb13f-config-volume\") pod \"dns-default-4dr8s\" (UID: \"978b822b-4b60-4700-b98e-4ba141cdb13f\") " pod="openshift-dns/dns-default-4dr8s" Jul 06 20:35:55.241130 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.241084 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs26g\" (UniqueName: \"kubernetes.io/projected/5f6abc31-2ae7-4ece-a13c-119c410ad425-kube-api-access-xs26g\") pod \"ingress-canary-6vmbc\" (UID: \"5f6abc31-2ae7-4ece-a13c-119c410ad425\") " pod="openshift-ingress-canary/ingress-canary-6vmbc" Jul 06 20:35:55.241130 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.241117 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdpbz\" (UniqueName: \"kubernetes.io/projected/978b822b-4b60-4700-b98e-4ba141cdb13f-kube-api-access-mdpbz\") pod \"dns-default-4dr8s\" (UID: \"978b822b-4b60-4700-b98e-4ba141cdb13f\") " pod="openshift-dns/dns-default-4dr8s" Jul 06 20:35:55.241223 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.241169 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/978b822b-4b60-4700-b98e-4ba141cdb13f-tmp-dir\") pod \"dns-default-4dr8s\" (UID: \"978b822b-4b60-4700-b98e-4ba141cdb13f\") " pod="openshift-dns/dns-default-4dr8s" Jul 06 20:35:55.241223 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.241203 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls\") pod \"dns-default-4dr8s\" (UID: \"978b822b-4b60-4700-b98e-4ba141cdb13f\") " pod="openshift-dns/dns-default-4dr8s" Jul 06 20:35:55.241317 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:55.241302 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:35:55.241369 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:55.241359 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls podName:978b822b-4b60-4700-b98e-4ba141cdb13f nodeName:}" failed. No retries permitted until 2026-07-06 20:35:55.741340328 +0000 UTC m=+36.560485922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls") pod "dns-default-4dr8s" (UID: "978b822b-4b60-4700-b98e-4ba141cdb13f") : secret "dns-default-metrics-tls" not found Jul 06 20:35:55.241646 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.241628 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/978b822b-4b60-4700-b98e-4ba141cdb13f-config-volume\") pod \"dns-default-4dr8s\" (UID: \"978b822b-4b60-4700-b98e-4ba141cdb13f\") " pod="openshift-dns/dns-default-4dr8s" Jul 06 20:35:55.245512 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.245493 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f6abc31-2ae7-4ece-a13c-119c410ad425-cert\") pod \"ingress-canary-6vmbc\" (UID: \"5f6abc31-2ae7-4ece-a13c-119c410ad425\") " pod="openshift-ingress-canary/ingress-canary-6vmbc" Jul 06 20:35:55.251803 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.251781 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdpbz\" (UniqueName: \"kubernetes.io/projected/978b822b-4b60-4700-b98e-4ba141cdb13f-kube-api-access-mdpbz\") pod \"dns-default-4dr8s\" (UID: \"978b822b-4b60-4700-b98e-4ba141cdb13f\") " pod="openshift-dns/dns-default-4dr8s" Jul 06 20:35:55.251883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.251786 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs26g\" (UniqueName: \"kubernetes.io/projected/5f6abc31-2ae7-4ece-a13c-119c410ad425-kube-api-access-xs26g\") pod \"ingress-canary-6vmbc\" (UID: \"5f6abc31-2ae7-4ece-a13c-119c410ad425\") " pod="openshift-ingress-canary/ingress-canary-6vmbc" Jul 06 20:35:55.353169 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.353132 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6vmbc" Jul 06 20:35:55.526590 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.526466 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6vmbc"] Jul 06 20:35:55.531046 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:35:55.531018 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f6abc31_2ae7_4ece_a13c_119c410ad425.slice/crio-1791b3b4154088e541a95f9fbcaa7ba5f6c660c897b0494238568c084e3021ee WatchSource:0}: Error finding container 1791b3b4154088e541a95f9fbcaa7ba5f6c660c897b0494238568c084e3021ee: Status 404 returned error can't find the container with id 1791b3b4154088e541a95f9fbcaa7ba5f6c660c897b0494238568c084e3021ee Jul 06 20:35:55.697132 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.697047 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:35:55.697282 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.697237 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:35:55.699888 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.699867 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 20:35:55.700280 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.699970 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 20:35:55.700280 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.700015 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hq9zz\"" Jul 06 20:35:55.744931 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:55.744895 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls\") pod \"dns-default-4dr8s\" (UID: \"978b822b-4b60-4700-b98e-4ba141cdb13f\") " pod="openshift-dns/dns-default-4dr8s" Jul 06 20:35:55.745088 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:55.745028 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:35:55.745088 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:55.745079 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls podName:978b822b-4b60-4700-b98e-4ba141cdb13f nodeName:}" failed. No retries permitted until 2026-07-06 20:35:56.745066026 +0000 UTC m=+37.564211611 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls") pod "dns-default-4dr8s" (UID: "978b822b-4b60-4700-b98e-4ba141cdb13f") : secret "dns-default-metrics-tls" not found Jul 06 20:35:56.040604 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:56.040519 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6vmbc" event={"ID":"5f6abc31-2ae7-4ece-a13c-119c410ad425","Type":"ContainerStarted","Data":"1791b3b4154088e541a95f9fbcaa7ba5f6c660c897b0494238568c084e3021ee"} Jul 06 20:35:56.043441 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:56.043415 2577 generic.go:356] "Generic (PLEG): container finished" podID="edad7ba3-27f4-4301-a1e0-02ed562c8ca9" containerID="f5f66dd8f6c851350d973f21cf7c30f8b6fc21d84d84fb519121023f05db2105" exitCode=0 Jul 06 20:35:56.043565 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:56.043451 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhlrw" event={"ID":"edad7ba3-27f4-4301-a1e0-02ed562c8ca9","Type":"ContainerDied","Data":"f5f66dd8f6c851350d973f21cf7c30f8b6fc21d84d84fb519121023f05db2105"} Jul 06 20:35:56.697798 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:56.697743 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:35:56.700950 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:56.700927 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zzq7f\"" Jul 06 20:35:56.701363 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:56.700992 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 20:35:56.701363 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:56.700927 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 20:35:56.753140 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:56.753107 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls\") pod \"dns-default-4dr8s\" (UID: \"978b822b-4b60-4700-b98e-4ba141cdb13f\") " pod="openshift-dns/dns-default-4dr8s" Jul 06 20:35:56.753304 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:56.753242 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:35:56.753350 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:56.753307 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls podName:978b822b-4b60-4700-b98e-4ba141cdb13f nodeName:}" failed. No retries permitted until 2026-07-06 20:35:58.753288895 +0000 UTC m=+39.572434480 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls") pod "dns-default-4dr8s" (UID: "978b822b-4b60-4700-b98e-4ba141cdb13f") : secret "dns-default-metrics-tls" not found Jul 06 20:35:57.050183 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:57.050154 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhlrw" event={"ID":"edad7ba3-27f4-4301-a1e0-02ed562c8ca9","Type":"ContainerStarted","Data":"2d08cb9e25f3a6ff47fb9cf30cbe65c5a4f7c7c09bf64e33a11f218295b9c5d9"} Jul 06 20:35:57.080569 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:57.080517 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hhlrw" podStartSLOduration=7.516966087 podStartE2EDuration="37.080498469s" totalImagesPullingTime="29.563532382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:35:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:57.079103913 +0000 UTC m=+37.898249521" watchObservedRunningTime="2026-07-06 20:35:57.080498469 +0000 UTC m=+37.899644079" Jul 06 20:35:57.206715 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:57.206680 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:57.276500 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:57.276466 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:58.769831 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:58.769803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls\") pod \"dns-default-4dr8s\" (UID: \"978b822b-4b60-4700-b98e-4ba141cdb13f\") " pod="openshift-dns/dns-default-4dr8s" Jul 06 20:35:58.770433 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:58.769952 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:35:58.770433 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:35:58.770017 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls podName:978b822b-4b60-4700-b98e-4ba141cdb13f nodeName:}" failed. No retries permitted until 2026-07-06 20:36:02.77000097 +0000 UTC m=+43.589146556 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls") pod "dns-default-4dr8s" (UID: "978b822b-4b60-4700-b98e-4ba141cdb13f") : secret "dns-default-metrics-tls" not found Jul 06 20:35:59.057067 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:59.057035 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6vmbc" event={"ID":"5f6abc31-2ae7-4ece-a13c-119c410ad425","Type":"ContainerStarted","Data":"e4a2545f4c943b28500951d2b8f64c6cf76e23ab6f9615bb5044fc7d9523f0b4"} Jul 06 20:35:59.074713 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:35:59.074672 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6vmbc" podStartSLOduration=1.389628792 podStartE2EDuration="4.074659395s" totalImagesPullingTime="2.685030603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:59.073450845 +0000 UTC m=+39.892596453" watchObservedRunningTime="2026-07-06 20:35:59.074659395 +0000 UTC m=+39.893805002" Jul 06 20:36:00.633582 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:00.633552 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:36:00.708994 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:00.708961 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:36:02.794332 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:02.794290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls\") pod \"dns-default-4dr8s\" (UID: \"978b822b-4b60-4700-b98e-4ba141cdb13f\") " pod="openshift-dns/dns-default-4dr8s" Jul 06 20:36:02.794747 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:36:02.794445 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:36:02.794747 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:36:02.794513 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls podName:978b822b-4b60-4700-b98e-4ba141cdb13f nodeName:}" failed. No retries permitted until 2026-07-06 20:36:10.794496841 +0000 UTC m=+51.613642426 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls") pod "dns-default-4dr8s" (UID: "978b822b-4b60-4700-b98e-4ba141cdb13f") : secret "dns-default-metrics-tls" not found Jul 06 20:36:04.541472 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:04.541428 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:36:04.667961 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:04.667923 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:36:04.938980 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:04.938941 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:36:05.044017 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:05.043977 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:36:08.536705 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:08.536662 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:36:08.706807 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:08.706753 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:36:10.848080 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:10.848046 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls\") pod \"dns-default-4dr8s\" (UID: \"978b822b-4b60-4700-b98e-4ba141cdb13f\") " pod="openshift-dns/dns-default-4dr8s" Jul 06 20:36:10.848522 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:36:10.848156 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:36:10.848522 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:36:10.848220 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls podName:978b822b-4b60-4700-b98e-4ba141cdb13f nodeName:}" failed. No retries permitted until 2026-07-06 20:36:26.848203937 +0000 UTC m=+67.667349523 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls") pod "dns-default-4dr8s" (UID: "978b822b-4b60-4700-b98e-4ba141cdb13f") : secret "dns-default-metrics-tls" not found Jul 06 20:36:10.907126 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:10.907094 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:36:11.008263 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:11.008226 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:36:20.034490 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:20.034461 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8722" Jul 06 20:36:20.190347 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:20.190308 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:36:20.287201 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:20.287116 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:36:25.349400 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:25.349354 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs\") pod \"network-metrics-daemon-sw6qp\" (UID: \"e3eec97f-a1ba-4160-ab43-ce2fda50659b\") " pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:36:25.349809 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:25.349420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret\") pod \"global-pull-secret-syncer-qrmdw\" (UID: \"20f81617-cdb7-4364-b3de-43e1a7fc32d2\") " pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:36:25.351967 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:25.351947 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 20:36:25.352076 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:25.352060 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 20:36:25.360008 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:36:25.359988 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 20:36:25.360088 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:36:25.360076 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs podName:e3eec97f-a1ba-4160-ab43-ce2fda50659b nodeName:}" failed. No retries permitted until 2026-07-06 20:37:29.360053629 +0000 UTC m=+130.179199226 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs") pod "network-metrics-daemon-sw6qp" (UID: "e3eec97f-a1ba-4160-ab43-ce2fda50659b") : secret "metrics-daemon-secret" not found Jul 06 20:36:25.363358 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:25.363329 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20f81617-cdb7-4364-b3de-43e1a7fc32d2-original-pull-secret\") pod \"global-pull-secret-syncer-qrmdw\" (UID: \"20f81617-cdb7-4364-b3de-43e1a7fc32d2\") " pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:36:25.415557 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:25.415521 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qrmdw" Jul 06 20:36:25.555094 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:25.554308 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbh6p\" (UniqueName: \"kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p\") pod \"network-check-target-2w6mq\" (UID: \"d4af3c2d-fc4f-4558-9f58-826f7ccc10f0\") " pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:36:25.557897 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:25.557642 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 20:36:25.567625 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:25.567601 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 20:36:25.578363 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:25.578334 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbh6p\" (UniqueName: \"kubernetes.io/projected/d4af3c2d-fc4f-4558-9f58-826f7ccc10f0-kube-api-access-wbh6p\") pod \"network-check-target-2w6mq\" (UID: \"d4af3c2d-fc4f-4558-9f58-826f7ccc10f0\") " pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:36:25.605811 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:25.605721 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qrmdw"] Jul 06 20:36:25.609195 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:36:25.609159 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20f81617_cdb7_4364_b3de_43e1a7fc32d2.slice/crio-94abe8f23a12a3c539d8305c001d833d5ffcafd1f78cb432ef543ee859b29da0 WatchSource:0}: Error finding container 94abe8f23a12a3c539d8305c001d833d5ffcafd1f78cb432ef543ee859b29da0: Status 404 returned error can't find the container with id 94abe8f23a12a3c539d8305c001d833d5ffcafd1f78cb432ef543ee859b29da0 Jul 06 20:36:25.811298 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:25.811270 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zzq7f\"" Jul 06 20:36:25.819515 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:25.819488 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:36:25.964911 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:25.964882 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2w6mq"] Jul 06 20:36:25.968040 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:36:25.968010 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4af3c2d_fc4f_4558_9f58_826f7ccc10f0.slice/crio-9663fb0e5579c9a0dc451bb20354342117133338f7ebfc79c475152bfa04afe5 WatchSource:0}: Error finding container 9663fb0e5579c9a0dc451bb20354342117133338f7ebfc79c475152bfa04afe5: Status 404 returned error can't find the container with id 9663fb0e5579c9a0dc451bb20354342117133338f7ebfc79c475152bfa04afe5 Jul 06 20:36:26.119014 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:26.118973 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qrmdw" event={"ID":"20f81617-cdb7-4364-b3de-43e1a7fc32d2","Type":"ContainerStarted","Data":"94abe8f23a12a3c539d8305c001d833d5ffcafd1f78cb432ef543ee859b29da0"} Jul 06 20:36:26.120295 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:26.120260 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2w6mq" event={"ID":"d4af3c2d-fc4f-4558-9f58-826f7ccc10f0","Type":"ContainerStarted","Data":"9663fb0e5579c9a0dc451bb20354342117133338f7ebfc79c475152bfa04afe5"} Jul 06 20:36:26.413428 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:26.413392 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:36:26.477747 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:26.477610 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:36:26.863489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:26.863453 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls\") pod \"dns-default-4dr8s\" (UID: \"978b822b-4b60-4700-b98e-4ba141cdb13f\") " pod="openshift-dns/dns-default-4dr8s" Jul 06 20:36:26.863797 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:36:26.863628 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:36:26.863797 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:36:26.863703 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls podName:978b822b-4b60-4700-b98e-4ba141cdb13f nodeName:}" failed. No retries permitted until 2026-07-06 20:36:58.863685393 +0000 UTC m=+99.682831002 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls") pod "dns-default-4dr8s" (UID: "978b822b-4b60-4700-b98e-4ba141cdb13f") : secret "dns-default-metrics-tls" not found Jul 06 20:36:31.135304 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:31.135265 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2w6mq" event={"ID":"d4af3c2d-fc4f-4558-9f58-826f7ccc10f0","Type":"ContainerStarted","Data":"ffffd27c0cfe2e4c4811551abce2328f3ca923e3e5753e584c596a28677a16a9"} Jul 06 20:36:31.135783 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:31.135406 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:36:31.136656 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:31.136635 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qrmdw" event={"ID":"20f81617-cdb7-4364-b3de-43e1a7fc32d2","Type":"ContainerStarted","Data":"bf766c6cdb3b9cca9a53bdb05641ca4cef7ecdcfd1d127b9ba9b4d34d3e9fd83"} Jul 06 20:36:31.153065 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:31.153012 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2w6mq" podStartSLOduration=66.754257994 podStartE2EDuration="1m11.152998659s" totalImagesPullingTime="4.398740665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:31.152126248 +0000 UTC m=+71.971271886" watchObservedRunningTime="2026-07-06 20:36:31.152998659 +0000 UTC m=+71.972144295" Jul 06 20:36:31.168541 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:31.168487 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qrmdw" podStartSLOduration=66.406959267 podStartE2EDuration="1m11.168473902s" totalImagesPullingTime="4.761514635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:31.168441771 +0000 UTC m=+71.987587381" watchObservedRunningTime="2026-07-06 20:36:31.168473902 +0000 UTC m=+71.987619488" Jul 06 20:36:58.885861 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:36:58.885830 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls\") pod \"dns-default-4dr8s\" (UID: \"978b822b-4b60-4700-b98e-4ba141cdb13f\") " pod="openshift-dns/dns-default-4dr8s" Jul 06 20:36:58.886176 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:36:58.885973 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:36:58.886176 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:36:58.886042 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls podName:978b822b-4b60-4700-b98e-4ba141cdb13f nodeName:}" failed. No retries permitted until 2026-07-06 20:38:02.886026337 +0000 UTC m=+163.705171923 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls") pod "dns-default-4dr8s" (UID: "978b822b-4b60-4700-b98e-4ba141cdb13f") : secret "dns-default-metrics-tls" not found Jul 06 20:37:02.141970 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:02.141937 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2w6mq" Jul 06 20:37:14.911898 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:14.911863 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-hxgk7"] Jul 06 20:37:14.913666 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:14.913644 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" Jul 06 20:37:14.916620 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:14.916603 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mqjw4\"" Jul 06 20:37:14.916774 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:14.916738 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 06 20:37:14.916912 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:14.916897 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 06 20:37:14.917924 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:14.917906 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 20:37:14.918032 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:14.918009 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 20:37:14.922326 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:14.922309 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 06 20:37:14.929779 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:14.929737 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-hxgk7"] Jul 06 20:37:14.992734 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:14.992693 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrvrr\" (UniqueName: \"kubernetes.io/projected/2b9454b2-a95d-49b8-bd43-66f163c3cff8-kube-api-access-rrvrr\") pod \"insights-operator-5c847dcfc4-hxgk7\" (UID: \"2b9454b2-a95d-49b8-bd43-66f163c3cff8\") " pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" Jul 06 20:37:14.992734 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:14.992731 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b9454b2-a95d-49b8-bd43-66f163c3cff8-serving-cert\") pod \"insights-operator-5c847dcfc4-hxgk7\" (UID: \"2b9454b2-a95d-49b8-bd43-66f163c3cff8\") " pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" Jul 06 20:37:14.992975 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:14.992753 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b9454b2-a95d-49b8-bd43-66f163c3cff8-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-hxgk7\" (UID: \"2b9454b2-a95d-49b8-bd43-66f163c3cff8\") " pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" Jul 06 20:37:14.992975 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:14.992849 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b9454b2-a95d-49b8-bd43-66f163c3cff8-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-hxgk7\" (UID: \"2b9454b2-a95d-49b8-bd43-66f163c3cff8\") " pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" Jul 06 20:37:14.992975 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:14.992894 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b9454b2-a95d-49b8-bd43-66f163c3cff8-tmp\") pod \"insights-operator-5c847dcfc4-hxgk7\" (UID: \"2b9454b2-a95d-49b8-bd43-66f163c3cff8\") " pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" Jul 06 20:37:14.992975 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:14.992911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2b9454b2-a95d-49b8-bd43-66f163c3cff8-snapshots\") pod \"insights-operator-5c847dcfc4-hxgk7\" (UID: \"2b9454b2-a95d-49b8-bd43-66f163c3cff8\") " pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" Jul 06 20:37:15.021400 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.021364 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zwvls"] Jul 06 20:37:15.023630 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.023606 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-m8w66"] Jul 06 20:37:15.023746 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.023721 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zwvls" Jul 06 20:37:15.025384 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.025364 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7644b4cf9c-fh2wd"] Jul 06 20:37:15.025502 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.025479 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-m8w66" Jul 06 20:37:15.026620 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.026601 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 20:37:15.026730 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.026644 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 20:37:15.026730 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.026687 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 20:37:15.026972 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.026957 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:37:15.027044 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.026984 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-tbdws\"" Jul 06 20:37:15.027127 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.027110 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:15.028302 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.028285 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 20:37:15.028395 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.028291 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kplsd\"" Jul 06 20:37:15.028515 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.028501 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 20:37:15.028653 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.028637 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:37:15.028706 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.028690 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 20:37:15.029804 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.029783 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 20:37:15.030028 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.030012 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-q8v6k\"" Jul 06 20:37:15.030134 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.030117 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 20:37:15.030213 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.030152 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 20:37:15.030213 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.030161 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 20:37:15.030382 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.030365 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 20:37:15.030382 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.030379 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 20:37:15.033959 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.033939 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 20:37:15.038977 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.038950 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-m8w66"] Jul 06 20:37:15.040045 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.040028 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zwvls"] Jul 06 20:37:15.042338 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.042318 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7644b4cf9c-fh2wd"] Jul 06 20:37:15.093623 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.093594 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32e64091-395a-4a73-b236-50ec25a430ce-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-zwvls\" (UID: \"32e64091-395a-4a73-b236-50ec25a430ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zwvls" Jul 06 20:37:15.093842 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.093628 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-metrics-certs\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:15.093842 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.093653 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b9454b2-a95d-49b8-bd43-66f163c3cff8-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-hxgk7\" (UID: \"2b9454b2-a95d-49b8-bd43-66f163c3cff8\") " pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" Jul 06 20:37:15.093842 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.093671 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-stats-auth\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:15.093842 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.093707 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32e64091-395a-4a73-b236-50ec25a430ce-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-zwvls\" (UID: \"32e64091-395a-4a73-b236-50ec25a430ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zwvls" Jul 06 20:37:15.093842 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.093732 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a829421-0363-40d1-941c-78b3f80a4f95-serving-cert\") pod \"console-operator-68b757fb67-m8w66\" (UID: \"7a829421-0363-40d1-941c-78b3f80a4f95\") " pod="openshift-console-operator/console-operator-68b757fb67-m8w66" Jul 06 20:37:15.093842 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.093753 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwwtg\" (UniqueName: \"kubernetes.io/projected/32e64091-395a-4a73-b236-50ec25a430ce-kube-api-access-cwwtg\") pod \"kube-storage-version-migrator-operator-846bf668f7-zwvls\" (UID: \"32e64091-395a-4a73-b236-50ec25a430ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zwvls" Jul 06 20:37:15.093842 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.093797 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a829421-0363-40d1-941c-78b3f80a4f95-trusted-ca\") pod \"console-operator-68b757fb67-m8w66\" (UID: \"7a829421-0363-40d1-941c-78b3f80a4f95\") " pod="openshift-console-operator/console-operator-68b757fb67-m8w66" Jul 06 20:37:15.093842 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.093820 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-default-certificate\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:15.093842 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.093844 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b9454b2-a95d-49b8-bd43-66f163c3cff8-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-hxgk7\" (UID: \"2b9454b2-a95d-49b8-bd43-66f163c3cff8\") " pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" Jul 06 20:37:15.094192 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.093873 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrxvf\" (UniqueName: \"kubernetes.io/projected/7a829421-0363-40d1-941c-78b3f80a4f95-kube-api-access-jrxvf\") pod \"console-operator-68b757fb67-m8w66\" (UID: \"7a829421-0363-40d1-941c-78b3f80a4f95\") " pod="openshift-console-operator/console-operator-68b757fb67-m8w66" Jul 06 20:37:15.094192 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.093892 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9mw7\" (UniqueName: \"kubernetes.io/projected/582026c2-9714-442b-8550-8a2da38ef9c3-kube-api-access-n9mw7\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:15.094192 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.093909 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a829421-0363-40d1-941c-78b3f80a4f95-config\") pod \"console-operator-68b757fb67-m8w66\" (UID: \"7a829421-0363-40d1-941c-78b3f80a4f95\") " pod="openshift-console-operator/console-operator-68b757fb67-m8w66" Jul 06 20:37:15.094192 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.093944 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b9454b2-a95d-49b8-bd43-66f163c3cff8-tmp\") pod \"insights-operator-5c847dcfc4-hxgk7\" (UID: \"2b9454b2-a95d-49b8-bd43-66f163c3cff8\") " pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" Jul 06 20:37:15.094192 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.093979 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2b9454b2-a95d-49b8-bd43-66f163c3cff8-snapshots\") pod \"insights-operator-5c847dcfc4-hxgk7\" (UID: \"2b9454b2-a95d-49b8-bd43-66f163c3cff8\") " pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" Jul 06 20:37:15.094192 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.094032 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582026c2-9714-442b-8550-8a2da38ef9c3-service-ca-bundle\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:15.094192 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.094093 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrvrr\" (UniqueName: \"kubernetes.io/projected/2b9454b2-a95d-49b8-bd43-66f163c3cff8-kube-api-access-rrvrr\") pod \"insights-operator-5c847dcfc4-hxgk7\" (UID: \"2b9454b2-a95d-49b8-bd43-66f163c3cff8\") " pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" Jul 06 20:37:15.094192 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.094126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b9454b2-a95d-49b8-bd43-66f163c3cff8-serving-cert\") pod \"insights-operator-5c847dcfc4-hxgk7\" (UID: \"2b9454b2-a95d-49b8-bd43-66f163c3cff8\") " pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" Jul 06 20:37:15.094550 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.094320 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b9454b2-a95d-49b8-bd43-66f163c3cff8-tmp\") pod \"insights-operator-5c847dcfc4-hxgk7\" (UID: \"2b9454b2-a95d-49b8-bd43-66f163c3cff8\") " pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" Jul 06 20:37:15.094550 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.094326 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b9454b2-a95d-49b8-bd43-66f163c3cff8-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-hxgk7\" (UID: \"2b9454b2-a95d-49b8-bd43-66f163c3cff8\") " pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" Jul 06 20:37:15.094550 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.094536 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2b9454b2-a95d-49b8-bd43-66f163c3cff8-snapshots\") pod \"insights-operator-5c847dcfc4-hxgk7\" (UID: \"2b9454b2-a95d-49b8-bd43-66f163c3cff8\") " pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" Jul 06 20:37:15.094673 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.094646 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b9454b2-a95d-49b8-bd43-66f163c3cff8-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-hxgk7\" (UID: \"2b9454b2-a95d-49b8-bd43-66f163c3cff8\") " pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" Jul 06 20:37:15.096655 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.096633 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b9454b2-a95d-49b8-bd43-66f163c3cff8-serving-cert\") pod \"insights-operator-5c847dcfc4-hxgk7\" (UID: \"2b9454b2-a95d-49b8-bd43-66f163c3cff8\") " pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" Jul 06 20:37:15.101695 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.101674 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrvrr\" (UniqueName: \"kubernetes.io/projected/2b9454b2-a95d-49b8-bd43-66f163c3cff8-kube-api-access-rrvrr\") pod \"insights-operator-5c847dcfc4-hxgk7\" (UID: \"2b9454b2-a95d-49b8-bd43-66f163c3cff8\") " pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" Jul 06 20:37:15.165810 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.165678 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:15.195006 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.194979 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrxvf\" (UniqueName: \"kubernetes.io/projected/7a829421-0363-40d1-941c-78b3f80a4f95-kube-api-access-jrxvf\") pod \"console-operator-68b757fb67-m8w66\" (UID: \"7a829421-0363-40d1-941c-78b3f80a4f95\") " pod="openshift-console-operator/console-operator-68b757fb67-m8w66" Jul 06 20:37:15.195137 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.195008 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9mw7\" (UniqueName: \"kubernetes.io/projected/582026c2-9714-442b-8550-8a2da38ef9c3-kube-api-access-n9mw7\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:15.195137 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.195029 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a829421-0363-40d1-941c-78b3f80a4f95-config\") pod \"console-operator-68b757fb67-m8w66\" (UID: \"7a829421-0363-40d1-941c-78b3f80a4f95\") " pod="openshift-console-operator/console-operator-68b757fb67-m8w66" Jul 06 20:37:15.195318 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.195164 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582026c2-9714-442b-8550-8a2da38ef9c3-service-ca-bundle\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:15.195318 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.195222 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32e64091-395a-4a73-b236-50ec25a430ce-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-zwvls\" (UID: \"32e64091-395a-4a73-b236-50ec25a430ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zwvls" Jul 06 20:37:15.195318 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.195243 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-metrics-certs\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:15.195318 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.195262 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-stats-auth\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:15.195318 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.195288 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32e64091-395a-4a73-b236-50ec25a430ce-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-zwvls\" (UID: \"32e64091-395a-4a73-b236-50ec25a430ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zwvls" Jul 06 20:37:15.195318 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.195312 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a829421-0363-40d1-941c-78b3f80a4f95-serving-cert\") pod \"console-operator-68b757fb67-m8w66\" (UID: \"7a829421-0363-40d1-941c-78b3f80a4f95\") " pod="openshift-console-operator/console-operator-68b757fb67-m8w66" Jul 06 20:37:15.195616 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:15.195339 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/582026c2-9714-442b-8550-8a2da38ef9c3-service-ca-bundle podName:582026c2-9714-442b-8550-8a2da38ef9c3 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:15.69531696 +0000 UTC m=+116.514462546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/582026c2-9714-442b-8550-8a2da38ef9c3-service-ca-bundle") pod "router-default-7644b4cf9c-fh2wd" (UID: "582026c2-9714-442b-8550-8a2da38ef9c3") : configmap references non-existent config key: service-ca.crt Jul 06 20:37:15.195616 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.195394 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwwtg\" (UniqueName: \"kubernetes.io/projected/32e64091-395a-4a73-b236-50ec25a430ce-kube-api-access-cwwtg\") pod \"kube-storage-version-migrator-operator-846bf668f7-zwvls\" (UID: \"32e64091-395a-4a73-b236-50ec25a430ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zwvls" Jul 06 20:37:15.195616 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.195424 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a829421-0363-40d1-941c-78b3f80a4f95-trusted-ca\") pod \"console-operator-68b757fb67-m8w66\" (UID: \"7a829421-0363-40d1-941c-78b3f80a4f95\") " pod="openshift-console-operator/console-operator-68b757fb67-m8w66" Jul 06 20:37:15.195616 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.195456 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-default-certificate\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:15.195616 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:15.195490 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 20:37:15.195616 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:15.195559 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-metrics-certs podName:582026c2-9714-442b-8550-8a2da38ef9c3 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:15.695541139 +0000 UTC m=+116.514686742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-metrics-certs") pod "router-default-7644b4cf9c-fh2wd" (UID: "582026c2-9714-442b-8550-8a2da38ef9c3") : secret "router-metrics-certs-default" not found Jul 06 20:37:15.195948 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.195790 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a829421-0363-40d1-941c-78b3f80a4f95-config\") pod \"console-operator-68b757fb67-m8w66\" (UID: \"7a829421-0363-40d1-941c-78b3f80a4f95\") " pod="openshift-console-operator/console-operator-68b757fb67-m8w66" Jul 06 20:37:15.196201 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.196176 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32e64091-395a-4a73-b236-50ec25a430ce-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-zwvls\" (UID: \"32e64091-395a-4a73-b236-50ec25a430ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zwvls" Jul 06 20:37:15.196664 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.196633 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a829421-0363-40d1-941c-78b3f80a4f95-trusted-ca\") pod \"console-operator-68b757fb67-m8w66\" (UID: \"7a829421-0363-40d1-941c-78b3f80a4f95\") " pod="openshift-console-operator/console-operator-68b757fb67-m8w66" Jul 06 20:37:15.197751 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.197723 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32e64091-395a-4a73-b236-50ec25a430ce-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-zwvls\" (UID: \"32e64091-395a-4a73-b236-50ec25a430ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zwvls" Jul 06 20:37:15.197911 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.197895 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a829421-0363-40d1-941c-78b3f80a4f95-serving-cert\") pod \"console-operator-68b757fb67-m8w66\" (UID: \"7a829421-0363-40d1-941c-78b3f80a4f95\") " pod="openshift-console-operator/console-operator-68b757fb67-m8w66" Jul 06 20:37:15.198401 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.198382 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-default-certificate\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:15.198536 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.198513 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-stats-auth\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:15.204569 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.204549 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrxvf\" (UniqueName: \"kubernetes.io/projected/7a829421-0363-40d1-941c-78b3f80a4f95-kube-api-access-jrxvf\") pod \"console-operator-68b757fb67-m8w66\" (UID: \"7a829421-0363-40d1-941c-78b3f80a4f95\") " pod="openshift-console-operator/console-operator-68b757fb67-m8w66" Jul 06 20:37:15.205010 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.204990 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9mw7\" (UniqueName: \"kubernetes.io/projected/582026c2-9714-442b-8550-8a2da38ef9c3-kube-api-access-n9mw7\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:15.205010 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.205003 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwwtg\" (UniqueName: \"kubernetes.io/projected/32e64091-395a-4a73-b236-50ec25a430ce-kube-api-access-cwwtg\") pod \"kube-storage-version-migrator-operator-846bf668f7-zwvls\" (UID: \"32e64091-395a-4a73-b236-50ec25a430ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zwvls" Jul 06 20:37:15.223066 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.223046 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" Jul 06 20:37:15.335100 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.335066 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zwvls" Jul 06 20:37:15.343745 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.343726 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-m8w66" Jul 06 20:37:15.345488 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.345466 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-hxgk7"] Jul 06 20:37:15.350957 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:37:15.350932 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b9454b2_a95d_49b8_bd43_66f163c3cff8.slice/crio-08bbb9a697cbb28504c785e717234803c104afdb78b4afa940eab05c33a0969b WatchSource:0}: Error finding container 08bbb9a697cbb28504c785e717234803c104afdb78b4afa940eab05c33a0969b: Status 404 returned error can't find the container with id 08bbb9a697cbb28504c785e717234803c104afdb78b4afa940eab05c33a0969b Jul 06 20:37:15.463681 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.463646 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zwvls"] Jul 06 20:37:15.466985 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:37:15.466960 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32e64091_395a_4a73_b236_50ec25a430ce.slice/crio-abf415d1f034fa040ac3c478b3c43da11966be334af9b0136b1d9c76f6ffbb79 WatchSource:0}: Error finding container abf415d1f034fa040ac3c478b3c43da11966be334af9b0136b1d9c76f6ffbb79: Status 404 returned error can't find the container with id abf415d1f034fa040ac3c478b3c43da11966be334af9b0136b1d9c76f6ffbb79 Jul 06 20:37:15.485660 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.485635 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-m8w66"] Jul 06 20:37:15.488891 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:37:15.488866 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a829421_0363_40d1_941c_78b3f80a4f95.slice/crio-013ce23eb24653aa6e485646c12f45c332af06d16b35e32cd1a838a23a643643 WatchSource:0}: Error finding container 013ce23eb24653aa6e485646c12f45c332af06d16b35e32cd1a838a23a643643: Status 404 returned error can't find the container with id 013ce23eb24653aa6e485646c12f45c332af06d16b35e32cd1a838a23a643643 Jul 06 20:37:15.698790 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.698683 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582026c2-9714-442b-8550-8a2da38ef9c3-service-ca-bundle\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:15.698790 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:15.698738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-metrics-certs\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:15.698978 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:15.698851 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/582026c2-9714-442b-8550-8a2da38ef9c3-service-ca-bundle podName:582026c2-9714-442b-8550-8a2da38ef9c3 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:16.698833593 +0000 UTC m=+117.517979184 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/582026c2-9714-442b-8550-8a2da38ef9c3-service-ca-bundle") pod "router-default-7644b4cf9c-fh2wd" (UID: "582026c2-9714-442b-8550-8a2da38ef9c3") : configmap references non-existent config key: service-ca.crt Jul 06 20:37:15.698978 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:15.698888 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 20:37:15.698978 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:15.698939 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-metrics-certs podName:582026c2-9714-442b-8550-8a2da38ef9c3 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:16.69892627 +0000 UTC m=+117.518071856 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-metrics-certs") pod "router-default-7644b4cf9c-fh2wd" (UID: "582026c2-9714-442b-8550-8a2da38ef9c3") : secret "router-metrics-certs-default" not found Jul 06 20:37:16.246631 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:16.246540 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zwvls" event={"ID":"32e64091-395a-4a73-b236-50ec25a430ce","Type":"ContainerStarted","Data":"abf415d1f034fa040ac3c478b3c43da11966be334af9b0136b1d9c76f6ffbb79"} Jul 06 20:37:16.248336 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:16.248298 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-m8w66" event={"ID":"7a829421-0363-40d1-941c-78b3f80a4f95","Type":"ContainerStarted","Data":"013ce23eb24653aa6e485646c12f45c332af06d16b35e32cd1a838a23a643643"} Jul 06 20:37:16.249498 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:16.249436 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" event={"ID":"2b9454b2-a95d-49b8-bd43-66f163c3cff8","Type":"ContainerStarted","Data":"08bbb9a697cbb28504c785e717234803c104afdb78b4afa940eab05c33a0969b"} Jul 06 20:37:16.587273 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:16.587235 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:16.708289 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:16.708241 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582026c2-9714-442b-8550-8a2da38ef9c3-service-ca-bundle\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:16.708479 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:16.708315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-metrics-certs\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:16.708479 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:16.708397 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/582026c2-9714-442b-8550-8a2da38ef9c3-service-ca-bundle podName:582026c2-9714-442b-8550-8a2da38ef9c3 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:18.708375281 +0000 UTC m=+119.527520867 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/582026c2-9714-442b-8550-8a2da38ef9c3-service-ca-bundle") pod "router-default-7644b4cf9c-fh2wd" (UID: "582026c2-9714-442b-8550-8a2da38ef9c3") : configmap references non-existent config key: service-ca.crt Jul 06 20:37:16.708479 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:16.708448 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 20:37:16.708645 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:16.708494 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-metrics-certs podName:582026c2-9714-442b-8550-8a2da38ef9c3 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:18.708482543 +0000 UTC m=+119.527628129 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-metrics-certs") pod "router-default-7644b4cf9c-fh2wd" (UID: "582026c2-9714-442b-8550-8a2da38ef9c3") : secret "router-metrics-certs-default" not found Jul 06 20:37:17.597523 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:17.597471 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:17.659975 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:17.659933 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:18.724376 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:18.724269 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582026c2-9714-442b-8550-8a2da38ef9c3-service-ca-bundle\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:18.724376 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:18.724348 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-metrics-certs\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:18.724916 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:18.724460 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 20:37:18.724916 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:18.724471 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/582026c2-9714-442b-8550-8a2da38ef9c3-service-ca-bundle podName:582026c2-9714-442b-8550-8a2da38ef9c3 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:22.724451758 +0000 UTC m=+123.543597348 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/582026c2-9714-442b-8550-8a2da38ef9c3-service-ca-bundle") pod "router-default-7644b4cf9c-fh2wd" (UID: "582026c2-9714-442b-8550-8a2da38ef9c3") : configmap references non-existent config key: service-ca.crt Jul 06 20:37:18.724916 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:18.724525 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-metrics-certs podName:582026c2-9714-442b-8550-8a2da38ef9c3 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:22.724510297 +0000 UTC m=+123.543655887 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-metrics-certs") pod "router-default-7644b4cf9c-fh2wd" (UID: "582026c2-9714-442b-8550-8a2da38ef9c3") : secret "router-metrics-certs-default" not found Jul 06 20:37:19.260182 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.260138 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zwvls" event={"ID":"32e64091-395a-4a73-b236-50ec25a430ce","Type":"ContainerStarted","Data":"a4f4bf152ad483346ea6301c9fdec1a1da215c78d97a6fc154d277231d9512ed"} Jul 06 20:37:19.262491 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.262470 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-m8w66_7a829421-0363-40d1-941c-78b3f80a4f95/console-operator/0.log" Jul 06 20:37:19.262598 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.262504 2577 generic.go:356] "Generic (PLEG): container finished" podID="7a829421-0363-40d1-941c-78b3f80a4f95" containerID="42bbd74234fbadd2aad4e8016b60c231d591a4ad28f0bf5a8420df890dd85f24" exitCode=255 Jul 06 20:37:19.262652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.262595 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-m8w66" event={"ID":"7a829421-0363-40d1-941c-78b3f80a4f95","Type":"ContainerDied","Data":"42bbd74234fbadd2aad4e8016b60c231d591a4ad28f0bf5a8420df890dd85f24"} Jul 06 20:37:19.262772 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.262740 2577 scope.go:117] "RemoveContainer" containerID="42bbd74234fbadd2aad4e8016b60c231d591a4ad28f0bf5a8420df890dd85f24" Jul 06 20:37:19.264028 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.263998 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" event={"ID":"2b9454b2-a95d-49b8-bd43-66f163c3cff8","Type":"ContainerStarted","Data":"71bf6b43fb6d1c1133c7eb6ec6316dc2e2e412527716d9ab560c143669e8ee93"} Jul 06 20:37:19.309010 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.308981 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:19.320113 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.319190 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" podStartSLOduration=2.258960229 podStartE2EDuration="5.319169223s" totalImagesPullingTime="3.060208994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:37:19.318691006 +0000 UTC m=+120.137836617" watchObservedRunningTime="2026-07-06 20:37:19.319169223 +0000 UTC m=+120.138314831" Jul 06 20:37:19.320113 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.319548 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zwvls" podStartSLOduration=2.370555269 podStartE2EDuration="5.319534343s" totalImagesPullingTime="2.948979074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:37:19.28699517 +0000 UTC m=+120.106140779" watchObservedRunningTime="2026-07-06 20:37:19.319534343 +0000 UTC m=+120.138679952" Jul 06 20:37:19.331181 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.331146 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mjkbq"] Jul 06 20:37:19.334284 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.334242 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:19.337631 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.337450 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qlpp5\"" Jul 06 20:37:19.337823 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.337671 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 20:37:19.337823 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.337703 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 20:37:19.348090 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.348068 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mjkbq"] Jul 06 20:37:19.382752 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.382722 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:19.429026 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.428994 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa874fc4-b66f-482c-8b20-f34f1b796be3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:19.429159 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.429111 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa874fc4-b66f-482c-8b20-f34f1b796be3-crio-socket\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:19.429159 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.429154 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqd46\" (UniqueName: \"kubernetes.io/projected/aa874fc4-b66f-482c-8b20-f34f1b796be3-kube-api-access-pqd46\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:19.429254 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.429199 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa874fc4-b66f-482c-8b20-f34f1b796be3-data-volume\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:19.429254 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.429221 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa874fc4-b66f-482c-8b20-f34f1b796be3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:19.530007 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.529917 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa874fc4-b66f-482c-8b20-f34f1b796be3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:19.530007 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.529955 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa874fc4-b66f-482c-8b20-f34f1b796be3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:19.530199 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.530023 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa874fc4-b66f-482c-8b20-f34f1b796be3-crio-socket\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:19.530199 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:19.530058 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:37:19.530199 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:19.530106 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:37:19.530199 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:19.530133 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa874fc4-b66f-482c-8b20-f34f1b796be3-insights-runtime-extractor-tls podName:aa874fc4-b66f-482c-8b20-f34f1b796be3 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:20.030113822 +0000 UTC m=+120.849259426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa874fc4-b66f-482c-8b20-f34f1b796be3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mjkbq" (UID: "aa874fc4-b66f-482c-8b20-f34f1b796be3") : secret "insights-runtime-extractor-tls" not found Jul 06 20:37:19.530199 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.530128 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa874fc4-b66f-482c-8b20-f34f1b796be3-crio-socket\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:19.530199 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.530067 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqd46\" (UniqueName: \"kubernetes.io/projected/aa874fc4-b66f-482c-8b20-f34f1b796be3-kube-api-access-pqd46\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:19.530199 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:19.530161 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa874fc4-b66f-482c-8b20-f34f1b796be3-kube-rbac-proxy-cm podName:aa874fc4-b66f-482c-8b20-f34f1b796be3 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:20.030146178 +0000 UTC m=+120.849291768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa874fc4-b66f-482c-8b20-f34f1b796be3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mjkbq" (UID: "aa874fc4-b66f-482c-8b20-f34f1b796be3") : configmap "kube-rbac-proxy" not found Jul 06 20:37:19.530411 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.530242 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa874fc4-b66f-482c-8b20-f34f1b796be3-data-volume\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:19.530576 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.530561 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa874fc4-b66f-482c-8b20-f34f1b796be3-data-volume\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:19.540795 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:19.540755 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqd46\" (UniqueName: \"kubernetes.io/projected/aa874fc4-b66f-482c-8b20-f34f1b796be3-kube-api-access-pqd46\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:20.003638 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:20.003599 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:20.033432 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:20.033402 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa874fc4-b66f-482c-8b20-f34f1b796be3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:20.033601 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:20.033441 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa874fc4-b66f-482c-8b20-f34f1b796be3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:20.033601 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:20.033515 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:37:20.033601 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:20.033563 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:37:20.033724 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:20.033573 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa874fc4-b66f-482c-8b20-f34f1b796be3-kube-rbac-proxy-cm podName:aa874fc4-b66f-482c-8b20-f34f1b796be3 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:21.033559274 +0000 UTC m=+121.852704861 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa874fc4-b66f-482c-8b20-f34f1b796be3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mjkbq" (UID: "aa874fc4-b66f-482c-8b20-f34f1b796be3") : configmap "kube-rbac-proxy" not found Jul 06 20:37:20.033724 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:20.033640 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa874fc4-b66f-482c-8b20-f34f1b796be3-insights-runtime-extractor-tls podName:aa874fc4-b66f-482c-8b20-f34f1b796be3 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:21.033620038 +0000 UTC m=+121.852765633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa874fc4-b66f-482c-8b20-f34f1b796be3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mjkbq" (UID: "aa874fc4-b66f-482c-8b20-f34f1b796be3") : secret "insights-runtime-extractor-tls" not found Jul 06 20:37:20.131416 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:20.131374 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:20.213654 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:20.213621 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:20.269690 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:20.269611 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-m8w66_7a829421-0363-40d1-941c-78b3f80a4f95/console-operator/1.log" Jul 06 20:37:20.270054 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:20.270038 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-m8w66_7a829421-0363-40d1-941c-78b3f80a4f95/console-operator/0.log" Jul 06 20:37:20.270103 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:20.270074 2577 generic.go:356] "Generic (PLEG): container finished" podID="7a829421-0363-40d1-941c-78b3f80a4f95" containerID="140584a6f1296f81150600a9dc0a2f5d0b6e81b3de715c9bcd97392a93c15e5d" exitCode=255 Jul 06 20:37:20.270175 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:20.270159 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-m8w66" event={"ID":"7a829421-0363-40d1-941c-78b3f80a4f95","Type":"ContainerDied","Data":"140584a6f1296f81150600a9dc0a2f5d0b6e81b3de715c9bcd97392a93c15e5d"} Jul 06 20:37:20.270222 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:20.270211 2577 scope.go:117] "RemoveContainer" containerID="42bbd74234fbadd2aad4e8016b60c231d591a4ad28f0bf5a8420df890dd85f24" Jul 06 20:37:20.270472 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:20.270449 2577 scope.go:117] "RemoveContainer" containerID="140584a6f1296f81150600a9dc0a2f5d0b6e81b3de715c9bcd97392a93c15e5d" Jul 06 20:37:20.270659 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:20.270641 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-m8w66_openshift-console-operator(7a829421-0363-40d1-941c-78b3f80a4f95)\"" pod="openshift-console-operator/console-operator-68b757fb67-m8w66" podUID="7a829421-0363-40d1-941c-78b3f80a4f95" Jul 06 20:37:20.296536 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:20.296508 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:21.042218 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.042180 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa874fc4-b66f-482c-8b20-f34f1b796be3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:21.042218 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.042221 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa874fc4-b66f-482c-8b20-f34f1b796be3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:21.042684 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:21.042334 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:37:21.042684 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:21.042356 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:37:21.042684 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:21.042387 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa874fc4-b66f-482c-8b20-f34f1b796be3-kube-rbac-proxy-cm podName:aa874fc4-b66f-482c-8b20-f34f1b796be3 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:23.042374163 +0000 UTC m=+123.861519749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa874fc4-b66f-482c-8b20-f34f1b796be3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mjkbq" (UID: "aa874fc4-b66f-482c-8b20-f34f1b796be3") : configmap "kube-rbac-proxy" not found Jul 06 20:37:21.042684 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:21.042427 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa874fc4-b66f-482c-8b20-f34f1b796be3-insights-runtime-extractor-tls podName:aa874fc4-b66f-482c-8b20-f34f1b796be3 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:23.042406383 +0000 UTC m=+123.861551983 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa874fc4-b66f-482c-8b20-f34f1b796be3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mjkbq" (UID: "aa874fc4-b66f-482c-8b20-f34f1b796be3") : secret "insights-runtime-extractor-tls" not found Jul 06 20:37:21.274590 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.274564 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-m8w66_7a829421-0363-40d1-941c-78b3f80a4f95/console-operator/1.log" Jul 06 20:37:21.274947 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.274930 2577 scope.go:117] "RemoveContainer" containerID="140584a6f1296f81150600a9dc0a2f5d0b6e81b3de715c9bcd97392a93c15e5d" Jul 06 20:37:21.275110 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:21.275091 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-m8w66_openshift-console-operator(7a829421-0363-40d1-941c-78b3f80a4f95)\"" pod="openshift-console-operator/console-operator-68b757fb67-m8w66" podUID="7a829421-0363-40d1-941c-78b3f80a4f95" Jul 06 20:37:21.302102 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.302078 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f8xd2_29c1a80a-f71a-441d-95e2-d93c4af98b05/dns-node-resolver/0.log" Jul 06 20:37:21.589498 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.589403 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-hdmd9"] Jul 06 20:37:21.591993 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.591978 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-hdmd9" Jul 06 20:37:21.594451 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.594434 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 20:37:21.594712 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.594575 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 20:37:21.598782 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.594995 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-g9mc9\"" Jul 06 20:37:21.598782 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.595136 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 20:37:21.598782 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.595209 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 20:37:21.600499 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.600474 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-hdmd9"] Jul 06 20:37:21.630023 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.629989 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:21.647844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.647825 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c978f6ec-0621-489a-8852-952dad68ead4-signing-cabundle\") pod \"service-ca-758f599c5-hdmd9\" (UID: \"c978f6ec-0621-489a-8852-952dad68ead4\") " pod="openshift-service-ca/service-ca-758f599c5-hdmd9" Jul 06 20:37:21.647958 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.647940 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c978f6ec-0621-489a-8852-952dad68ead4-signing-key\") pod \"service-ca-758f599c5-hdmd9\" (UID: \"c978f6ec-0621-489a-8852-952dad68ead4\") " pod="openshift-service-ca/service-ca-758f599c5-hdmd9" Jul 06 20:37:21.648003 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.647970 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kpng\" (UniqueName: \"kubernetes.io/projected/c978f6ec-0621-489a-8852-952dad68ead4-kube-api-access-2kpng\") pod \"service-ca-758f599c5-hdmd9\" (UID: \"c978f6ec-0621-489a-8852-952dad68ead4\") " pod="openshift-service-ca/service-ca-758f599c5-hdmd9" Jul 06 20:37:21.688689 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.688664 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:21.749234 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.749203 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c978f6ec-0621-489a-8852-952dad68ead4-signing-key\") pod \"service-ca-758f599c5-hdmd9\" (UID: \"c978f6ec-0621-489a-8852-952dad68ead4\") " pod="openshift-service-ca/service-ca-758f599c5-hdmd9" Jul 06 20:37:21.749234 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.749236 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kpng\" (UniqueName: \"kubernetes.io/projected/c978f6ec-0621-489a-8852-952dad68ead4-kube-api-access-2kpng\") pod \"service-ca-758f599c5-hdmd9\" (UID: \"c978f6ec-0621-489a-8852-952dad68ead4\") " pod="openshift-service-ca/service-ca-758f599c5-hdmd9" Jul 06 20:37:21.749411 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.749280 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c978f6ec-0621-489a-8852-952dad68ead4-signing-cabundle\") pod \"service-ca-758f599c5-hdmd9\" (UID: \"c978f6ec-0621-489a-8852-952dad68ead4\") " pod="openshift-service-ca/service-ca-758f599c5-hdmd9" Jul 06 20:37:21.750382 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.750359 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c978f6ec-0621-489a-8852-952dad68ead4-signing-cabundle\") pod \"service-ca-758f599c5-hdmd9\" (UID: \"c978f6ec-0621-489a-8852-952dad68ead4\") " pod="openshift-service-ca/service-ca-758f599c5-hdmd9" Jul 06 20:37:21.752206 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.752180 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c978f6ec-0621-489a-8852-952dad68ead4-signing-key\") pod \"service-ca-758f599c5-hdmd9\" (UID: \"c978f6ec-0621-489a-8852-952dad68ead4\") " pod="openshift-service-ca/service-ca-758f599c5-hdmd9" Jul 06 20:37:21.756857 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.756831 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kpng\" (UniqueName: \"kubernetes.io/projected/c978f6ec-0621-489a-8852-952dad68ead4-kube-api-access-2kpng\") pod \"service-ca-758f599c5-hdmd9\" (UID: \"c978f6ec-0621-489a-8852-952dad68ead4\") " pod="openshift-service-ca/service-ca-758f599c5-hdmd9" Jul 06 20:37:21.902330 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:21.902239 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-hdmd9" Jul 06 20:37:22.028806 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:22.028776 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-hdmd9"] Jul 06 20:37:22.032214 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:37:22.032188 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc978f6ec_0621_489a_8852_952dad68ead4.slice/crio-6f533135049413a85a30290ef0c50dc5edebdef6ef0e7140e8078e5a18aebe38 WatchSource:0}: Error finding container 6f533135049413a85a30290ef0c50dc5edebdef6ef0e7140e8078e5a18aebe38: Status 404 returned error can't find the container with id 6f533135049413a85a30290ef0c50dc5edebdef6ef0e7140e8078e5a18aebe38 Jul 06 20:37:22.279139 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:22.279043 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-hdmd9" event={"ID":"c978f6ec-0621-489a-8852-952dad68ead4","Type":"ContainerStarted","Data":"6f533135049413a85a30290ef0c50dc5edebdef6ef0e7140e8078e5a18aebe38"} Jul 06 20:37:22.302514 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:22.302489 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gvgt6_a71ef46f-aee4-4690-9668-324e344d1818/node-ca/0.log" Jul 06 20:37:22.638286 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:22.638238 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:22.758345 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:22.758309 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-metrics-certs\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:22.758542 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:22.758392 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582026c2-9714-442b-8550-8a2da38ef9c3-service-ca-bundle\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:22.758542 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:22.758492 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 20:37:22.758542 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:22.758524 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/582026c2-9714-442b-8550-8a2da38ef9c3-service-ca-bundle podName:582026c2-9714-442b-8550-8a2da38ef9c3 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:30.758508886 +0000 UTC m=+131.577654488 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/582026c2-9714-442b-8550-8a2da38ef9c3-service-ca-bundle") pod "router-default-7644b4cf9c-fh2wd" (UID: "582026c2-9714-442b-8550-8a2da38ef9c3") : configmap references non-existent config key: service-ca.crt Jul 06 20:37:22.758679 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:22.758557 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-metrics-certs podName:582026c2-9714-442b-8550-8a2da38ef9c3 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:30.758539326 +0000 UTC m=+131.577684925 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-metrics-certs") pod "router-default-7644b4cf9c-fh2wd" (UID: "582026c2-9714-442b-8550-8a2da38ef9c3") : secret "router-metrics-certs-default" not found Jul 06 20:37:23.061143 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:23.061107 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa874fc4-b66f-482c-8b20-f34f1b796be3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:23.061303 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:23.061222 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa874fc4-b66f-482c-8b20-f34f1b796be3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:23.061303 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:23.061236 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:37:23.061404 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:23.061305 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa874fc4-b66f-482c-8b20-f34f1b796be3-kube-rbac-proxy-cm podName:aa874fc4-b66f-482c-8b20-f34f1b796be3 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:27.061286368 +0000 UTC m=+127.880431958 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa874fc4-b66f-482c-8b20-f34f1b796be3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mjkbq" (UID: "aa874fc4-b66f-482c-8b20-f34f1b796be3") : configmap "kube-rbac-proxy" not found Jul 06 20:37:23.061404 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:23.061314 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:37:23.061404 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:23.061361 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa874fc4-b66f-482c-8b20-f34f1b796be3-insights-runtime-extractor-tls podName:aa874fc4-b66f-482c-8b20-f34f1b796be3 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:27.061344072 +0000 UTC m=+127.880489659 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa874fc4-b66f-482c-8b20-f34f1b796be3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mjkbq" (UID: "aa874fc4-b66f-482c-8b20-f34f1b796be3") : secret "insights-runtime-extractor-tls" not found Jul 06 20:37:23.103329 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:23.103294 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6vmbc_5f6abc31-2ae7-4ece-a13c-119c410ad425/serve-healthcheck-canary/0.log" Jul 06 20:37:25.289355 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:25.289318 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-hdmd9" event={"ID":"c978f6ec-0621-489a-8852-952dad68ead4","Type":"ContainerStarted","Data":"e23d9ddf29cfab99f06404c98235ae11382d103d724df2db3ccf983d8fe7a9f4"} Jul 06 20:37:25.304390 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:25.304335 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-hdmd9" podStartSLOduration=2.099731843 podStartE2EDuration="4.30432058s" totalImagesPullingTime="2.204588737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:37:25.303714466 +0000 UTC m=+126.122860074" watchObservedRunningTime="2026-07-06 20:37:25.30432058 +0000 UTC m=+126.123466188" Jul 06 20:37:25.344835 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:25.344802 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-m8w66" Jul 06 20:37:25.344970 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:25.344856 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-m8w66" Jul 06 20:37:25.345211 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:25.345197 2577 scope.go:117] "RemoveContainer" containerID="140584a6f1296f81150600a9dc0a2f5d0b6e81b3de715c9bcd97392a93c15e5d" Jul 06 20:37:25.345375 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:25.345352 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-m8w66_openshift-console-operator(7a829421-0363-40d1-941c-78b3f80a4f95)\"" pod="openshift-console-operator/console-operator-68b757fb67-m8w66" podUID="7a829421-0363-40d1-941c-78b3f80a4f95" Jul 06 20:37:25.572799 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:25.572747 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:25.861680 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:25.861588 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:25.961446 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:25.961369 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:26.061488 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:26.061384 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:26.164816 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:26.164711 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:26.262353 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:26.262310 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:26.368324 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:26.368285 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:26.869325 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:26.869294 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:27.097746 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:27.097702 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa874fc4-b66f-482c-8b20-f34f1b796be3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:27.097746 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:27.097746 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa874fc4-b66f-482c-8b20-f34f1b796be3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:27.097967 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:27.097874 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:37:27.097967 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:27.097887 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:37:27.097967 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:27.097944 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa874fc4-b66f-482c-8b20-f34f1b796be3-kube-rbac-proxy-cm podName:aa874fc4-b66f-482c-8b20-f34f1b796be3 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:35.097928319 +0000 UTC m=+135.917073909 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa874fc4-b66f-482c-8b20-f34f1b796be3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mjkbq" (UID: "aa874fc4-b66f-482c-8b20-f34f1b796be3") : configmap "kube-rbac-proxy" not found Jul 06 20:37:27.097967 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:27.097957 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa874fc4-b66f-482c-8b20-f34f1b796be3-insights-runtime-extractor-tls podName:aa874fc4-b66f-482c-8b20-f34f1b796be3 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:35.097951095 +0000 UTC m=+135.917096680 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa874fc4-b66f-482c-8b20-f34f1b796be3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mjkbq" (UID: "aa874fc4-b66f-482c-8b20-f34f1b796be3") : secret "insights-runtime-extractor-tls" not found Jul 06 20:37:27.460351 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:27.460300 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:28.065680 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:28.065644 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:28.271168 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:28.271132 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:28.726512 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:28.726478 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:28.864861 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:28.864825 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:29.418453 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:29.418418 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs\") pod \"network-metrics-daemon-sw6qp\" (UID: \"e3eec97f-a1ba-4160-ab43-ce2fda50659b\") " pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:37:29.418710 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:29.418601 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 20:37:29.418710 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:29.418681 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs podName:e3eec97f-a1ba-4160-ab43-ce2fda50659b nodeName:}" failed. No retries permitted until 2026-07-06 20:39:31.418660743 +0000 UTC m=+252.237806334 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs") pod "network-metrics-daemon-sw6qp" (UID: "e3eec97f-a1ba-4160-ab43-ce2fda50659b") : secret "metrics-daemon-secret" not found Jul 06 20:37:29.461993 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:29.461952 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:29.518961 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:29.518923 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:29.666283 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:29.666247 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:30.064042 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:30.064010 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:30.120999 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:30.120954 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:30.662923 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:30.662888 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:30.831035 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:30.831002 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-metrics-certs\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:30.831218 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:30.831081 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582026c2-9714-442b-8550-8a2da38ef9c3-service-ca-bundle\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:30.831289 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:30.831218 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/582026c2-9714-442b-8550-8a2da38ef9c3-service-ca-bundle podName:582026c2-9714-442b-8550-8a2da38ef9c3 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:46.831202227 +0000 UTC m=+147.650347815 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/582026c2-9714-442b-8550-8a2da38ef9c3-service-ca-bundle") pod "router-default-7644b4cf9c-fh2wd" (UID: "582026c2-9714-442b-8550-8a2da38ef9c3") : configmap references non-existent config key: service-ca.crt Jul 06 20:37:30.833690 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:30.833655 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/582026c2-9714-442b-8550-8a2da38ef9c3-metrics-certs\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:31.316402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:31.316361 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:31.463604 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:31.463561 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:31.857611 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:31.857570 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:32.005392 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:32.005359 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:32.105827 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:32.105792 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:32.549057 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:32.549024 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:32.665925 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:32.665892 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:32.767636 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:32.767603 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:32.869285 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:32.869251 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:33.063397 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:33.063350 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:33.458008 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:33.457976 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:33.660244 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:33.660216 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:34.263178 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:34.263144 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:34.510489 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:34.510458 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:34.663101 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:34.663047 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:35.058145 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:35.058104 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:35.164460 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:35.164422 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa874fc4-b66f-482c-8b20-f34f1b796be3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:35.164602 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:35.164464 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa874fc4-b66f-482c-8b20-f34f1b796be3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:35.164602 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:35.164578 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:37:35.164679 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:35.164647 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa874fc4-b66f-482c-8b20-f34f1b796be3-insights-runtime-extractor-tls podName:aa874fc4-b66f-482c-8b20-f34f1b796be3 nodeName:}" failed. No retries permitted until 2026-07-06 20:37:51.16462941 +0000 UTC m=+151.983774999 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa874fc4-b66f-482c-8b20-f34f1b796be3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mjkbq" (UID: "aa874fc4-b66f-482c-8b20-f34f1b796be3") : secret "insights-runtime-extractor-tls" not found Jul 06 20:37:35.165162 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:35.165144 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa874fc4-b66f-482c-8b20-f34f1b796be3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:35.268084 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:35.268048 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:35.866188 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:35.866152 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:36.067686 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:36.067658 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:36.274201 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:36.274112 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:39.699106 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:39.699073 2577 scope.go:117] "RemoveContainer" containerID="140584a6f1296f81150600a9dc0a2f5d0b6e81b3de715c9bcd97392a93c15e5d" Jul 06 20:37:40.334329 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:40.334300 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-m8w66_7a829421-0363-40d1-941c-78b3f80a4f95/console-operator/2.log" Jul 06 20:37:40.334712 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:40.334695 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-m8w66_7a829421-0363-40d1-941c-78b3f80a4f95/console-operator/1.log" Jul 06 20:37:40.334789 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:40.334730 2577 generic.go:356] "Generic (PLEG): container finished" podID="7a829421-0363-40d1-941c-78b3f80a4f95" containerID="a04326642232bfbc2b6d79c48b314998262dbcf6a506a3bd5cd2f49f0a2fe553" exitCode=255 Jul 06 20:37:40.334827 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:40.334791 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-m8w66" event={"ID":"7a829421-0363-40d1-941c-78b3f80a4f95","Type":"ContainerDied","Data":"a04326642232bfbc2b6d79c48b314998262dbcf6a506a3bd5cd2f49f0a2fe553"} Jul 06 20:37:40.334881 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:40.334846 2577 scope.go:117] "RemoveContainer" containerID="140584a6f1296f81150600a9dc0a2f5d0b6e81b3de715c9bcd97392a93c15e5d" Jul 06 20:37:40.335180 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:40.335163 2577 scope.go:117] "RemoveContainer" containerID="a04326642232bfbc2b6d79c48b314998262dbcf6a506a3bd5cd2f49f0a2fe553" Jul 06 20:37:40.335365 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:40.335337 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-m8w66_openshift-console-operator(7a829421-0363-40d1-941c-78b3f80a4f95)\"" pod="openshift-console-operator/console-operator-68b757fb67-m8w66" podUID="7a829421-0363-40d1-941c-78b3f80a4f95" Jul 06 20:37:41.338933 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:41.338904 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-m8w66_7a829421-0363-40d1-941c-78b3f80a4f95/console-operator/2.log" Jul 06 20:37:44.608957 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.608918 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8ff4bf4f9-xvtfv"] Jul 06 20:37:44.612077 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.612060 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.614570 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.614548 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 20:37:44.614693 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.614630 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 20:37:44.614786 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.614692 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 20:37:44.615670 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.615651 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bzrpw\"" Jul 06 20:37:44.619579 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.619561 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 20:37:44.622056 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.622037 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8ff4bf4f9-xvtfv"] Jul 06 20:37:44.622578 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.622549 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:44.715554 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.715522 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:44.740629 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.740587 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bac992c3-4bdc-439b-967b-e2a2679e09a9-trusted-ca\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.740629 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.740631 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bac992c3-4bdc-439b-967b-e2a2679e09a9-installation-pull-secrets\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.740868 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.740671 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bac992c3-4bdc-439b-967b-e2a2679e09a9-bound-sa-token\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.740868 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.740709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knf95\" (UniqueName: \"kubernetes.io/projected/bac992c3-4bdc-439b-967b-e2a2679e09a9-kube-api-access-knf95\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.740868 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.740807 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bac992c3-4bdc-439b-967b-e2a2679e09a9-image-registry-private-configuration\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.740868 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.740864 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bac992c3-4bdc-439b-967b-e2a2679e09a9-registry-certificates\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.740995 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.740885 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bac992c3-4bdc-439b-967b-e2a2679e09a9-registry-tls\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.740995 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.740910 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bac992c3-4bdc-439b-967b-e2a2679e09a9-ca-trust-extracted\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.813920 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.813889 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:44.841923 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.841894 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bac992c3-4bdc-439b-967b-e2a2679e09a9-bound-sa-token\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.841923 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.841925 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knf95\" (UniqueName: \"kubernetes.io/projected/bac992c3-4bdc-439b-967b-e2a2679e09a9-kube-api-access-knf95\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.842165 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.841960 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bac992c3-4bdc-439b-967b-e2a2679e09a9-image-registry-private-configuration\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.842165 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.842050 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bac992c3-4bdc-439b-967b-e2a2679e09a9-registry-certificates\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.842165 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.842092 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bac992c3-4bdc-439b-967b-e2a2679e09a9-registry-tls\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.842165 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.842127 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bac992c3-4bdc-439b-967b-e2a2679e09a9-ca-trust-extracted\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.842165 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.842161 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bac992c3-4bdc-439b-967b-e2a2679e09a9-trusted-ca\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.842409 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.842305 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bac992c3-4bdc-439b-967b-e2a2679e09a9-installation-pull-secrets\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.842610 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.842583 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bac992c3-4bdc-439b-967b-e2a2679e09a9-ca-trust-extracted\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.843082 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.842987 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bac992c3-4bdc-439b-967b-e2a2679e09a9-trusted-ca\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.843082 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.843005 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bac992c3-4bdc-439b-967b-e2a2679e09a9-registry-certificates\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.844634 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.844604 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bac992c3-4bdc-439b-967b-e2a2679e09a9-image-registry-private-configuration\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.844732 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.844713 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bac992c3-4bdc-439b-967b-e2a2679e09a9-registry-tls\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.844989 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.844974 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bac992c3-4bdc-439b-967b-e2a2679e09a9-installation-pull-secrets\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.849525 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.849503 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bac992c3-4bdc-439b-967b-e2a2679e09a9-bound-sa-token\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.849965 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.849938 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knf95\" (UniqueName: \"kubernetes.io/projected/bac992c3-4bdc-439b-967b-e2a2679e09a9-kube-api-access-knf95\") pod \"image-registry-8ff4bf4f9-xvtfv\" (UID: \"bac992c3-4bdc-439b-967b-e2a2679e09a9\") " pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:44.920884 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:44.920799 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:45.000280 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:45.000251 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:45.043673 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:45.043644 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8ff4bf4f9-xvtfv"] Jul 06 20:37:45.047232 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:37:45.047208 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbac992c3_4bdc_439b_967b_e2a2679e09a9.slice/crio-4007bc80ede3d16246d3803da35d706740a507a4c7ec2f59a9a765a3d470bf00 WatchSource:0}: Error finding container 4007bc80ede3d16246d3803da35d706740a507a4c7ec2f59a9a765a3d470bf00: Status 404 returned error can't find the container with id 4007bc80ede3d16246d3803da35d706740a507a4c7ec2f59a9a765a3d470bf00 Jul 06 20:37:45.101127 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:45.101099 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:45.344028 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:45.343989 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-m8w66" Jul 06 20:37:45.344182 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:45.344055 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-m8w66" Jul 06 20:37:45.344371 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:45.344355 2577 scope.go:117] "RemoveContainer" containerID="a04326642232bfbc2b6d79c48b314998262dbcf6a506a3bd5cd2f49f0a2fe553" Jul 06 20:37:45.344532 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:45.344512 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-m8w66_openshift-console-operator(7a829421-0363-40d1-941c-78b3f80a4f95)\"" pod="openshift-console-operator/console-operator-68b757fb67-m8w66" podUID="7a829421-0363-40d1-941c-78b3f80a4f95" Jul 06 20:37:45.352255 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:45.352223 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" event={"ID":"bac992c3-4bdc-439b-967b-e2a2679e09a9","Type":"ContainerStarted","Data":"20f30978a2977ee41428c4710ae23519b15d7d55078551d359181ac7e2677740"} Jul 06 20:37:45.352471 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:45.352270 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:37:45.352471 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:45.352287 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" event={"ID":"bac992c3-4bdc-439b-967b-e2a2679e09a9","Type":"ContainerStarted","Data":"4007bc80ede3d16246d3803da35d706740a507a4c7ec2f59a9a765a3d470bf00"} Jul 06 20:37:45.382149 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:45.382084 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" podStartSLOduration=1.382064256 podStartE2EDuration="1.382064256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:37:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:37:45.380369792 +0000 UTC m=+146.199515401" watchObservedRunningTime="2026-07-06 20:37:45.382064256 +0000 UTC m=+146.201209896" Jul 06 20:37:46.706748 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:46.706709 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:46.773060 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:46.773025 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:46.857073 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:46.857042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582026c2-9714-442b-8550-8a2da38ef9c3-service-ca-bundle\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:46.857584 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:46.857568 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582026c2-9714-442b-8550-8a2da38ef9c3-service-ca-bundle\") pod \"router-default-7644b4cf9c-fh2wd\" (UID: \"582026c2-9714-442b-8550-8a2da38ef9c3\") " pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:47.150482 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:47.150457 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-q8v6k\"" Jul 06 20:37:47.158560 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:47.158533 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:47.282174 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:47.282143 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7644b4cf9c-fh2wd"] Jul 06 20:37:47.287525 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:37:47.287492 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod582026c2_9714_442b_8550_8a2da38ef9c3.slice/crio-ad0168c9a87f1c2e80f61592566ac2637750d678f7b382606461d9d4bccd114f WatchSource:0}: Error finding container ad0168c9a87f1c2e80f61592566ac2637750d678f7b382606461d9d4bccd114f: Status 404 returned error can't find the container with id ad0168c9a87f1c2e80f61592566ac2637750d678f7b382606461d9d4bccd114f Jul 06 20:37:47.359392 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:47.359361 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" event={"ID":"582026c2-9714-442b-8550-8a2da38ef9c3","Type":"ContainerStarted","Data":"04d9b01f68d9db8af0f8828e620b00cce534e828cc4a5553c0c66d2dc34b8fa3"} Jul 06 20:37:47.359528 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:47.359413 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" event={"ID":"582026c2-9714-442b-8550-8a2da38ef9c3","Type":"ContainerStarted","Data":"ad0168c9a87f1c2e80f61592566ac2637750d678f7b382606461d9d4bccd114f"} Jul 06 20:37:47.380609 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:47.380555 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" podStartSLOduration=32.380534544 podStartE2EDuration="32.380534544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:37:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:37:47.37910924 +0000 UTC m=+148.198254842" watchObservedRunningTime="2026-07-06 20:37:47.380534544 +0000 UTC m=+148.199680130" Jul 06 20:37:47.773091 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:47.773059 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:47.835204 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:47.835167 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:48.159403 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:48.159359 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:48.162011 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:48.161988 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:48.363583 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:48.363554 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:48.364827 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:48.364801 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7644b4cf9c-fh2wd" Jul 06 20:37:49.371461 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:49.371427 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:49.469372 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:49.469334 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:49.537260 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:49.537231 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:49.761133 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:49.761036 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:51.188860 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:51.188818 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa874fc4-b66f-482c-8b20-f34f1b796be3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:51.191249 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:51.191231 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa874fc4-b66f-482c-8b20-f34f1b796be3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjkbq\" (UID: \"aa874fc4-b66f-482c-8b20-f34f1b796be3\") " pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:51.450059 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:51.449987 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qlpp5\"" Jul 06 20:37:51.458037 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:51.458013 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mjkbq" Jul 06 20:37:51.588490 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:51.588459 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mjkbq"] Jul 06 20:37:51.591848 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:37:51.591818 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa874fc4_b66f_482c_8b20_f34f1b796be3.slice/crio-3150047d40a658fbfc4cfe8a7f7062221a6bf53749dd4fe60ec3fbfc65ac92e8 WatchSource:0}: Error finding container 3150047d40a658fbfc4cfe8a7f7062221a6bf53749dd4fe60ec3fbfc65ac92e8: Status 404 returned error can't find the container with id 3150047d40a658fbfc4cfe8a7f7062221a6bf53749dd4fe60ec3fbfc65ac92e8 Jul 06 20:37:52.379578 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:52.379542 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjkbq" event={"ID":"aa874fc4-b66f-482c-8b20-f34f1b796be3","Type":"ContainerStarted","Data":"3150047d40a658fbfc4cfe8a7f7062221a6bf53749dd4fe60ec3fbfc65ac92e8"} Jul 06 20:37:52.563016 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:52.562878 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:52.633406 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:52.633326 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:52.768926 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:52.768885 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:55.395738 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:55.395700 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjkbq" event={"ID":"aa874fc4-b66f-482c-8b20-f34f1b796be3","Type":"ContainerStarted","Data":"7a2cb2c491ec0995d7560932fe0a7bc6d10e8ce184e7dc3081c3baa188191aa6"} Jul 06 20:37:55.697431 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:55.697404 2577 scope.go:117] "RemoveContainer" containerID="a04326642232bfbc2b6d79c48b314998262dbcf6a506a3bd5cd2f49f0a2fe553" Jul 06 20:37:55.697592 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:55.697558 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-m8w66_openshift-console-operator(7a829421-0363-40d1-941c-78b3f80a4f95)\"" pod="openshift-console-operator/console-operator-68b757fb67-m8w66" podUID="7a829421-0363-40d1-941c-78b3f80a4f95" Jul 06 20:37:56.401418 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:56.401376 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjkbq" event={"ID":"aa874fc4-b66f-482c-8b20-f34f1b796be3","Type":"ContainerStarted","Data":"9c7951c647af1133ad73ba99ff422d1fa8932e1c43075f60e0372618246d841c"} Jul 06 20:37:56.833883 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:56.833846 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:58.039998 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:58.039959 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4dr8s" podUID="978b822b-4b60-4700-b98e-4ba141cdb13f" Jul 06 20:37:58.407368 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:58.407345 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4dr8s" Jul 06 20:37:58.719034 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:37:58.718944 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-sw6qp" podUID="e3eec97f-a1ba-4160-ab43-ce2fda50659b" Jul 06 20:37:59.412393 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:59.412356 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjkbq" event={"ID":"aa874fc4-b66f-482c-8b20-f34f1b796be3","Type":"ContainerStarted","Data":"0dceafa93fef8791f8c124142c8166cd238ed8c30cac44347d3b287e96bb22fd"} Jul 06 20:37:59.430445 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:59.430394 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mjkbq" podStartSLOduration=33.776727204 podStartE2EDuration="40.430378766s" totalImagesPullingTime="6.653651562s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:37:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:37:59.42971814 +0000 UTC m=+160.248863760" watchObservedRunningTime="2026-07-06 20:37:59.430378766 +0000 UTC m=+160.249524388" Jul 06 20:37:59.692524 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:59.692453 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:59.914712 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:59.914682 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:59.947351 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:59.947276 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d"] Jul 06 20:37:59.950695 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:59.950659 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" Jul 06 20:37:59.954506 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:59.954485 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dc955\"" Jul 06 20:37:59.954664 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:59.954639 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 20:37:59.954723 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:59.954662 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 20:37:59.955061 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:59.954839 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 20:37:59.955061 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:59.954929 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 20:37:59.955061 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:59.954976 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 20:37:59.955967 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:59.955945 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 20:37:59.971580 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:59.971322 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d"] Jul 06 20:37:59.978162 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:59.978115 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k97nr"] Jul 06 20:37:59.980855 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:59.980834 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:37:59.983507 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:59.983485 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 20:37:59.983612 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:59.983485 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-k5595\"" Jul 06 20:37:59.983612 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:59.983524 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 20:37:59.983811 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:37:59.983675 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 20:38:00.004503 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.004472 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:00.067701 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.067664 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0100222c-1684-490f-ad7d-dcc4d32d5b68-node-exporter-textfile\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.067904 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.067797 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/372828ba-d419-4991-b2e8-9e6c9af1c721-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-zxt5d\" (UID: \"372828ba-d419-4991-b2e8-9e6c9af1c721\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" Jul 06 20:38:00.067904 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.067839 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/372828ba-d419-4991-b2e8-9e6c9af1c721-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-zxt5d\" (UID: \"372828ba-d419-4991-b2e8-9e6c9af1c721\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" Jul 06 20:38:00.067904 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.067859 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0100222c-1684-490f-ad7d-dcc4d32d5b68-root\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.068075 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.067910 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0100222c-1684-490f-ad7d-dcc4d32d5b68-metrics-client-ca\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.068075 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.067949 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0100222c-1684-490f-ad7d-dcc4d32d5b68-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.068075 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.067982 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0100222c-1684-490f-ad7d-dcc4d32d5b68-sys\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.068075 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.068014 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0100222c-1684-490f-ad7d-dcc4d32d5b68-node-exporter-accelerators-collector-config\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.068075 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.068053 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/372828ba-d419-4991-b2e8-9e6c9af1c721-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-zxt5d\" (UID: \"372828ba-d419-4991-b2e8-9e6c9af1c721\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" Jul 06 20:38:00.068268 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.068081 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/372828ba-d419-4991-b2e8-9e6c9af1c721-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-zxt5d\" (UID: \"372828ba-d419-4991-b2e8-9e6c9af1c721\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" Jul 06 20:38:00.068268 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.068143 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0100222c-1684-490f-ad7d-dcc4d32d5b68-node-exporter-wtmp\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.068268 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.068200 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-847nc\" (UniqueName: \"kubernetes.io/projected/372828ba-d419-4991-b2e8-9e6c9af1c721-kube-api-access-847nc\") pod \"kube-state-metrics-7c9dbb8b7d-zxt5d\" (UID: \"372828ba-d419-4991-b2e8-9e6c9af1c721\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" Jul 06 20:38:00.068268 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.068225 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0100222c-1684-490f-ad7d-dcc4d32d5b68-node-exporter-tls\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.068407 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.068268 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h6gl\" (UniqueName: \"kubernetes.io/projected/0100222c-1684-490f-ad7d-dcc4d32d5b68-kube-api-access-4h6gl\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.068407 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.068294 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/372828ba-d419-4991-b2e8-9e6c9af1c721-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-zxt5d\" (UID: \"372828ba-d419-4991-b2e8-9e6c9af1c721\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" Jul 06 20:38:00.101315 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.101270 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:00.169484 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.169447 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-847nc\" (UniqueName: \"kubernetes.io/projected/372828ba-d419-4991-b2e8-9e6c9af1c721-kube-api-access-847nc\") pod \"kube-state-metrics-7c9dbb8b7d-zxt5d\" (UID: \"372828ba-d419-4991-b2e8-9e6c9af1c721\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" Jul 06 20:38:00.169484 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.169487 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0100222c-1684-490f-ad7d-dcc4d32d5b68-node-exporter-tls\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.169742 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.169515 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h6gl\" (UniqueName: \"kubernetes.io/projected/0100222c-1684-490f-ad7d-dcc4d32d5b68-kube-api-access-4h6gl\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.169742 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.169538 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/372828ba-d419-4991-b2e8-9e6c9af1c721-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-zxt5d\" (UID: \"372828ba-d419-4991-b2e8-9e6c9af1c721\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" Jul 06 20:38:00.169742 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.169590 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0100222c-1684-490f-ad7d-dcc4d32d5b68-node-exporter-textfile\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.169742 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.169637 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/372828ba-d419-4991-b2e8-9e6c9af1c721-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-zxt5d\" (UID: \"372828ba-d419-4991-b2e8-9e6c9af1c721\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" Jul 06 20:38:00.169742 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.169676 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/372828ba-d419-4991-b2e8-9e6c9af1c721-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-zxt5d\" (UID: \"372828ba-d419-4991-b2e8-9e6c9af1c721\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" Jul 06 20:38:00.169742 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.169701 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0100222c-1684-490f-ad7d-dcc4d32d5b68-root\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.169742 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:38:00.169639 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 20:38:00.169742 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.169722 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0100222c-1684-490f-ad7d-dcc4d32d5b68-metrics-client-ca\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.169742 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.169744 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0100222c-1684-490f-ad7d-dcc4d32d5b68-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.170202 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:38:00.169799 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0100222c-1684-490f-ad7d-dcc4d32d5b68-node-exporter-tls podName:0100222c-1684-490f-ad7d-dcc4d32d5b68 nodeName:}" failed. No retries permitted until 2026-07-06 20:38:00.669755034 +0000 UTC m=+161.488900628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0100222c-1684-490f-ad7d-dcc4d32d5b68-node-exporter-tls") pod "node-exporter-k97nr" (UID: "0100222c-1684-490f-ad7d-dcc4d32d5b68") : secret "node-exporter-tls" not found Jul 06 20:38:00.170202 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.169836 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0100222c-1684-490f-ad7d-dcc4d32d5b68-sys\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.170202 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.169883 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0100222c-1684-490f-ad7d-dcc4d32d5b68-node-exporter-accelerators-collector-config\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.170202 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.169938 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/372828ba-d419-4991-b2e8-9e6c9af1c721-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-zxt5d\" (UID: \"372828ba-d419-4991-b2e8-9e6c9af1c721\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" Jul 06 20:38:00.170202 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.169967 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/372828ba-d419-4991-b2e8-9e6c9af1c721-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-zxt5d\" (UID: \"372828ba-d419-4991-b2e8-9e6c9af1c721\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" Jul 06 20:38:00.170202 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.169985 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0100222c-1684-490f-ad7d-dcc4d32d5b68-root\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.170202 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.169997 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0100222c-1684-490f-ad7d-dcc4d32d5b68-node-exporter-textfile\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.170202 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.170024 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0100222c-1684-490f-ad7d-dcc4d32d5b68-node-exporter-wtmp\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.170202 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.170057 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0100222c-1684-490f-ad7d-dcc4d32d5b68-sys\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.170202 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.170056 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/372828ba-d419-4991-b2e8-9e6c9af1c721-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-zxt5d\" (UID: \"372828ba-d419-4991-b2e8-9e6c9af1c721\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" Jul 06 20:38:00.170707 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.170372 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0100222c-1684-490f-ad7d-dcc4d32d5b68-node-exporter-wtmp\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.170707 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.170642 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0100222c-1684-490f-ad7d-dcc4d32d5b68-metrics-client-ca\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.171045 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.170963 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0100222c-1684-490f-ad7d-dcc4d32d5b68-node-exporter-accelerators-collector-config\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.171045 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.171086 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/372828ba-d419-4991-b2e8-9e6c9af1c721-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-zxt5d\" (UID: \"372828ba-d419-4991-b2e8-9e6c9af1c721\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" Jul 06 20:38:00.171607 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.171581 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/372828ba-d419-4991-b2e8-9e6c9af1c721-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-zxt5d\" (UID: \"372828ba-d419-4991-b2e8-9e6c9af1c721\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" Jul 06 20:38:00.172839 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.172817 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/372828ba-d419-4991-b2e8-9e6c9af1c721-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-zxt5d\" (UID: \"372828ba-d419-4991-b2e8-9e6c9af1c721\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" Jul 06 20:38:00.172981 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.172961 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0100222c-1684-490f-ad7d-dcc4d32d5b68-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.173421 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.173390 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/372828ba-d419-4991-b2e8-9e6c9af1c721-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-zxt5d\" (UID: \"372828ba-d419-4991-b2e8-9e6c9af1c721\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" Jul 06 20:38:00.177667 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.177648 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h6gl\" (UniqueName: \"kubernetes.io/projected/0100222c-1684-490f-ad7d-dcc4d32d5b68-kube-api-access-4h6gl\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.178363 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.178341 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-847nc\" (UniqueName: \"kubernetes.io/projected/372828ba-d419-4991-b2e8-9e6c9af1c721-kube-api-access-847nc\") pod \"kube-state-metrics-7c9dbb8b7d-zxt5d\" (UID: \"372828ba-d419-4991-b2e8-9e6c9af1c721\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" Jul 06 20:38:00.203180 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.203097 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:00.271438 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.271399 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" Jul 06 20:38:00.303263 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.303213 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:00.401235 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.401202 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d"] Jul 06 20:38:00.405440 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:38:00.405406 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod372828ba_d419_4991_b2e8_9e6c9af1c721.slice/crio-6562da7cdbe3648324c87e90f4e60f2609135756dba084b6837ca3ec1098603a WatchSource:0}: Error finding container 6562da7cdbe3648324c87e90f4e60f2609135756dba084b6837ca3ec1098603a: Status 404 returned error can't find the container with id 6562da7cdbe3648324c87e90f4e60f2609135756dba084b6837ca3ec1098603a Jul 06 20:38:00.416454 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.416426 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" event={"ID":"372828ba-d419-4991-b2e8-9e6c9af1c721","Type":"ContainerStarted","Data":"6562da7cdbe3648324c87e90f4e60f2609135756dba084b6837ca3ec1098603a"} Jul 06 20:38:00.674349 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.674313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0100222c-1684-490f-ad7d-dcc4d32d5b68-node-exporter-tls\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.676753 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.676727 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0100222c-1684-490f-ad7d-dcc4d32d5b68-node-exporter-tls\") pod \"node-exporter-k97nr\" (UID: \"0100222c-1684-490f-ad7d-dcc4d32d5b68\") " pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.890913 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.890885 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k97nr" Jul 06 20:38:00.902797 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:38:00.902749 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0100222c_1684_490f_ad7d_dcc4d32d5b68.slice/crio-eb8045a1414a61970a651cfcfd9d99776eb00c588a36b818f1bb30377aba7c9f WatchSource:0}: Error finding container eb8045a1414a61970a651cfcfd9d99776eb00c588a36b818f1bb30377aba7c9f: Status 404 returned error can't find the container with id eb8045a1414a61970a651cfcfd9d99776eb00c588a36b818f1bb30377aba7c9f Jul 06 20:38:00.914755 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:00.914721 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:01.012255 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.012094 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:01.019856 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.019828 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:38:01.022979 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.022955 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.025416 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.025392 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 20:38:01.025534 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.025476 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 20:38:01.026459 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.025739 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 20:38:01.026459 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.025747 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 20:38:01.026459 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.025934 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 20:38:01.026459 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.026040 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-w6wfd\"" Jul 06 20:38:01.026459 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.026128 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 20:38:01.026459 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.026172 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 20:38:01.026459 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.026288 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 20:38:01.026874 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.026666 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 20:38:01.037616 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.037590 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:38:01.077667 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.077629 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4775ff1-696a-4f8c-8d1c-af67bb548c43-config-out\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.077852 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.077673 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.077852 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.077696 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4775ff1-696a-4f8c-8d1c-af67bb548c43-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.077852 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.077794 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-config-volume\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.077852 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.077832 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.078068 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.077865 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.078068 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.077927 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tds28\" (UniqueName: \"kubernetes.io/projected/c4775ff1-696a-4f8c-8d1c-af67bb548c43-kube-api-access-tds28\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.078068 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.077961 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4775ff1-696a-4f8c-8d1c-af67bb548c43-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.078068 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.077993 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.078068 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.078023 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-web-config\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.078068 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.078040 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4775ff1-696a-4f8c-8d1c-af67bb548c43-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.078068 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.078063 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.078405 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.078090 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c4775ff1-696a-4f8c-8d1c-af67bb548c43-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.135935 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.135896 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:01.179111 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.179073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4775ff1-696a-4f8c-8d1c-af67bb548c43-config-out\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.179267 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.179117 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.179267 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.179146 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4775ff1-696a-4f8c-8d1c-af67bb548c43-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.179267 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.179201 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-config-volume\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.179267 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.179228 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.179267 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.179266 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.179537 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.179300 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tds28\" (UniqueName: \"kubernetes.io/projected/c4775ff1-696a-4f8c-8d1c-af67bb548c43-kube-api-access-tds28\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.179537 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.179343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4775ff1-696a-4f8c-8d1c-af67bb548c43-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.179537 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.179369 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.179537 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.179410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-web-config\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.179537 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.179438 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4775ff1-696a-4f8c-8d1c-af67bb548c43-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.179537 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.179463 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.179537 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.179497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c4775ff1-696a-4f8c-8d1c-af67bb548c43-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.182557 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.182525 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4775ff1-696a-4f8c-8d1c-af67bb548c43-config-out\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.182686 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.182629 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4775ff1-696a-4f8c-8d1c-af67bb548c43-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.182754 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.182727 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c4775ff1-696a-4f8c-8d1c-af67bb548c43-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.183350 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.183329 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.183682 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.183646 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-web-config\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.184157 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.184135 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.184424 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.184366 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-config-volume\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.184784 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.184751 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4775ff1-696a-4f8c-8d1c-af67bb548c43-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.184970 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.184924 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.185501 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.185474 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4775ff1-696a-4f8c-8d1c-af67bb548c43-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.185668 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.185641 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.187156 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.187126 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.190745 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.190723 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tds28\" (UniqueName: \"kubernetes.io/projected/c4775ff1-696a-4f8c-8d1c-af67bb548c43-kube-api-access-tds28\") pod \"alertmanager-main-0\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.241528 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.241491 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:01.334982 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.334940 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:38:01.421601 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.421560 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k97nr" event={"ID":"0100222c-1684-490f-ad7d-dcc4d32d5b68","Type":"ContainerStarted","Data":"eb8045a1414a61970a651cfcfd9d99776eb00c588a36b818f1bb30377aba7c9f"} Jul 06 20:38:01.929249 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.929222 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-756b85c6b-55jjr"] Jul 06 20:38:01.934374 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.934346 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:01.937243 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.936899 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 20:38:01.937243 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.937001 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3j4u07up3g9mk\"" Jul 06 20:38:01.937243 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.937127 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 20:38:01.937488 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.937467 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jts2z\"" Jul 06 20:38:01.937745 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.937718 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 20:38:01.937855 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.937811 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 20:38:01.937933 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.937728 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 20:38:01.942093 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.941979 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-756b85c6b-55jjr"] Jul 06 20:38:01.988609 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.988275 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:01.988609 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.988357 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:01.988609 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.988388 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:01.988609 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.988426 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-secret-thanos-querier-tls\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:01.988609 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.988451 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzhsq\" (UniqueName: \"kubernetes.io/projected/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-kube-api-access-wzhsq\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:01.988609 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.988517 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-secret-grpc-tls\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:01.988609 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.988547 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:01.989208 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:01.988651 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-metrics-client-ca\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:02.033642 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.033608 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:38:02.039379 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:38:02.039321 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4775ff1_696a_4f8c_8d1c_af67bb548c43.slice/crio-abf59999b1fa67124e4b27f71517150a725301d9d4b8153889e3b692cc322a5a WatchSource:0}: Error finding container abf59999b1fa67124e4b27f71517150a725301d9d4b8153889e3b692cc322a5a: Status 404 returned error can't find the container with id abf59999b1fa67124e4b27f71517150a725301d9d4b8153889e3b692cc322a5a Jul 06 20:38:02.089144 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.089112 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:02.089430 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.089409 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:02.089626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.089609 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:02.089729 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.089710 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-secret-thanos-querier-tls\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:02.089807 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.089745 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzhsq\" (UniqueName: \"kubernetes.io/projected/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-kube-api-access-wzhsq\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:02.089868 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.089804 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-secret-grpc-tls\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:02.089868 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.089838 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:02.089956 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.089912 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-metrics-client-ca\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:02.090775 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.090730 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-metrics-client-ca\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:02.093018 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.092989 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:02.093098 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.093035 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:02.093242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.093196 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-secret-grpc-tls\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:02.093683 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.093646 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:02.093874 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.093851 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-secret-thanos-querier-tls\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:02.094191 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.094168 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:02.098739 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.098717 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzhsq\" (UniqueName: \"kubernetes.io/projected/1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f-kube-api-access-wzhsq\") pod \"thanos-querier-756b85c6b-55jjr\" (UID: \"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f\") " pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:02.247497 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.247461 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:02.377237 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.377203 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-756b85c6b-55jjr"] Jul 06 20:38:02.426186 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.426152 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" event={"ID":"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f","Type":"ContainerStarted","Data":"90344b0caa8503881d20908a410e56b3a436c5d31309bb9fcbbced108b56c1e1"} Jul 06 20:38:02.427722 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.427696 2577 generic.go:356] "Generic (PLEG): container finished" podID="0100222c-1684-490f-ad7d-dcc4d32d5b68" containerID="91f2c7482bcf939590f8305462b9c9f66505289c3e3ad3739329f95363f5a8b9" exitCode=0 Jul 06 20:38:02.427858 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.427783 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k97nr" event={"ID":"0100222c-1684-490f-ad7d-dcc4d32d5b68","Type":"ContainerDied","Data":"91f2c7482bcf939590f8305462b9c9f66505289c3e3ad3739329f95363f5a8b9"} Jul 06 20:38:02.429966 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.429945 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" event={"ID":"372828ba-d419-4991-b2e8-9e6c9af1c721","Type":"ContainerStarted","Data":"19b4b37317986c591ccce70b5cdaf34c274f536e8076170d4a81cfcc9419f50c"} Jul 06 20:38:02.430080 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.430005 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" event={"ID":"372828ba-d419-4991-b2e8-9e6c9af1c721","Type":"ContainerStarted","Data":"e275edfe218b7dd1935d52ea8bc83259a92843aabce23912557f9cdade68f8fb"} Jul 06 20:38:02.430080 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.430032 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" event={"ID":"372828ba-d419-4991-b2e8-9e6c9af1c721","Type":"ContainerStarted","Data":"cb33cb0dfc29419f8637bc797d00c608292a0c7fcd7185db7423cff80f6a6720"} Jul 06 20:38:02.431083 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.431060 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4775ff1-696a-4f8c-8d1c-af67bb548c43","Type":"ContainerStarted","Data":"abf59999b1fa67124e4b27f71517150a725301d9d4b8153889e3b692cc322a5a"} Jul 06 20:38:02.461901 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.461858 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zxt5d" podStartSLOduration=1.989118878 podStartE2EDuration="3.46184605s" totalImagesPullingTime="1.472727172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:37:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:38:02.460980342 +0000 UTC m=+163.280125950" watchObservedRunningTime="2026-07-06 20:38:02.46184605 +0000 UTC m=+163.280991657" Jul 06 20:38:02.864604 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.864567 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:02.896654 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.896618 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls\") pod \"dns-default-4dr8s\" (UID: \"978b822b-4b60-4700-b98e-4ba141cdb13f\") " pod="openshift-dns/dns-default-4dr8s" Jul 06 20:38:02.899452 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.899430 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/978b822b-4b60-4700-b98e-4ba141cdb13f-metrics-tls\") pod \"dns-default-4dr8s\" (UID: \"978b822b-4b60-4700-b98e-4ba141cdb13f\") " pod="openshift-dns/dns-default-4dr8s" Jul 06 20:38:02.911049 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.911023 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h5jj9\"" Jul 06 20:38:02.918789 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.918747 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4dr8s" Jul 06 20:38:02.964860 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:02.964814 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:03.062506 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:03.062476 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4dr8s"] Jul 06 20:38:03.064614 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:03.064584 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:03.165755 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:03.165622 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:03.231810 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:38:03.231749 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod978b822b_4b60_4700_b98e_4ba141cdb13f.slice/crio-36933ec76460007c196ebcd0e3c726aceda1a9ecc7648f525177ed92e06f9ec2 WatchSource:0}: Error finding container 36933ec76460007c196ebcd0e3c726aceda1a9ecc7648f525177ed92e06f9ec2: Status 404 returned error can't find the container with id 36933ec76460007c196ebcd0e3c726aceda1a9ecc7648f525177ed92e06f9ec2 Jul 06 20:38:03.438264 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:03.438169 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k97nr" event={"ID":"0100222c-1684-490f-ad7d-dcc4d32d5b68","Type":"ContainerStarted","Data":"547ff105462f3e82f1eea76676c79c8d3d6e40807725f9e5bbbf03f18ed24c5e"} Jul 06 20:38:03.438264 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:03.438226 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k97nr" event={"ID":"0100222c-1684-490f-ad7d-dcc4d32d5b68","Type":"ContainerStarted","Data":"ff92b63c0dad6dd713db58915257c5785bb342abc7f015ca18d50b7cb1ba258f"} Jul 06 20:38:03.440081 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:03.440056 2577 generic.go:356] "Generic (PLEG): container finished" podID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerID="d081b07df51f8783dd4dd96d60a371e5661d4919fdc8dcd2161cd6dcb15b267e" exitCode=0 Jul 06 20:38:03.440211 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:03.440145 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4775ff1-696a-4f8c-8d1c-af67bb548c43","Type":"ContainerDied","Data":"d081b07df51f8783dd4dd96d60a371e5661d4919fdc8dcd2161cd6dcb15b267e"} Jul 06 20:38:03.442029 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:03.442003 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4dr8s" event={"ID":"978b822b-4b60-4700-b98e-4ba141cdb13f","Type":"ContainerStarted","Data":"36933ec76460007c196ebcd0e3c726aceda1a9ecc7648f525177ed92e06f9ec2"} Jul 06 20:38:03.457056 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:03.457011 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k97nr" podStartSLOduration=3.377013276 podStartE2EDuration="4.456994074s" totalImagesPullingTime="977.439214ms" totalInitContainerRuntime="102.541584ms" isStatefulPod=true podCreationTimestamp="2026-07-06 20:37:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:38:03.456446793 +0000 UTC m=+164.275592401" watchObservedRunningTime="2026-07-06 20:38:03.456994074 +0000 UTC m=+164.276139681" Jul 06 20:38:04.165509 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.165314 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-b994475cc-vqrpx"] Jul 06 20:38:04.168055 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.168027 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.178004 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.176874 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 20:38:04.178004 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.177424 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 20:38:04.183345 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.183319 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-b994475cc-vqrpx"] Jul 06 20:38:04.183511 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.183496 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1ej5dtcej2skm\"" Jul 06 20:38:04.183778 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.183740 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 20:38:04.189308 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.184077 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-hvvx4\"" Jul 06 20:38:04.189404 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.184841 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 20:38:04.210379 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.210347 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9ec690eb-a7db-4614-9f73-9b4b92b03efa-audit-log\") pod \"metrics-server-b994475cc-vqrpx\" (UID: \"9ec690eb-a7db-4614-9f73-9b4b92b03efa\") " pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.210503 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.210392 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9ec690eb-a7db-4614-9f73-9b4b92b03efa-metrics-server-audit-profiles\") pod \"metrics-server-b994475cc-vqrpx\" (UID: \"9ec690eb-a7db-4614-9f73-9b4b92b03efa\") " pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.210503 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.210437 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwtq8\" (UniqueName: \"kubernetes.io/projected/9ec690eb-a7db-4614-9f73-9b4b92b03efa-kube-api-access-fwtq8\") pod \"metrics-server-b994475cc-vqrpx\" (UID: \"9ec690eb-a7db-4614-9f73-9b4b92b03efa\") " pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.210503 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.210470 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ec690eb-a7db-4614-9f73-9b4b92b03efa-client-ca-bundle\") pod \"metrics-server-b994475cc-vqrpx\" (UID: \"9ec690eb-a7db-4614-9f73-9b4b92b03efa\") " pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.210662 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.210525 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9ec690eb-a7db-4614-9f73-9b4b92b03efa-secret-metrics-server-client-certs\") pod \"metrics-server-b994475cc-vqrpx\" (UID: \"9ec690eb-a7db-4614-9f73-9b4b92b03efa\") " pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.210662 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.210612 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ec690eb-a7db-4614-9f73-9b4b92b03efa-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b994475cc-vqrpx\" (UID: \"9ec690eb-a7db-4614-9f73-9b4b92b03efa\") " pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.210662 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.210652 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9ec690eb-a7db-4614-9f73-9b4b92b03efa-secret-metrics-server-tls\") pod \"metrics-server-b994475cc-vqrpx\" (UID: \"9ec690eb-a7db-4614-9f73-9b4b92b03efa\") " pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.311296 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.311257 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9ec690eb-a7db-4614-9f73-9b4b92b03efa-metrics-server-audit-profiles\") pod \"metrics-server-b994475cc-vqrpx\" (UID: \"9ec690eb-a7db-4614-9f73-9b4b92b03efa\") " pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.311486 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.311319 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwtq8\" (UniqueName: \"kubernetes.io/projected/9ec690eb-a7db-4614-9f73-9b4b92b03efa-kube-api-access-fwtq8\") pod \"metrics-server-b994475cc-vqrpx\" (UID: \"9ec690eb-a7db-4614-9f73-9b4b92b03efa\") " pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.311486 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.311346 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ec690eb-a7db-4614-9f73-9b4b92b03efa-client-ca-bundle\") pod \"metrics-server-b994475cc-vqrpx\" (UID: \"9ec690eb-a7db-4614-9f73-9b4b92b03efa\") " pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.311486 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.311390 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9ec690eb-a7db-4614-9f73-9b4b92b03efa-secret-metrics-server-client-certs\") pod \"metrics-server-b994475cc-vqrpx\" (UID: \"9ec690eb-a7db-4614-9f73-9b4b92b03efa\") " pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.311486 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.311422 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ec690eb-a7db-4614-9f73-9b4b92b03efa-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b994475cc-vqrpx\" (UID: \"9ec690eb-a7db-4614-9f73-9b4b92b03efa\") " pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.311486 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.311457 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9ec690eb-a7db-4614-9f73-9b4b92b03efa-secret-metrics-server-tls\") pod \"metrics-server-b994475cc-vqrpx\" (UID: \"9ec690eb-a7db-4614-9f73-9b4b92b03efa\") " pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.311914 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.311566 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9ec690eb-a7db-4614-9f73-9b4b92b03efa-audit-log\") pod \"metrics-server-b994475cc-vqrpx\" (UID: \"9ec690eb-a7db-4614-9f73-9b4b92b03efa\") " pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.313001 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.311999 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9ec690eb-a7db-4614-9f73-9b4b92b03efa-audit-log\") pod \"metrics-server-b994475cc-vqrpx\" (UID: \"9ec690eb-a7db-4614-9f73-9b4b92b03efa\") " pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.313001 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.312782 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ec690eb-a7db-4614-9f73-9b4b92b03efa-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b994475cc-vqrpx\" (UID: \"9ec690eb-a7db-4614-9f73-9b4b92b03efa\") " pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.313001 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.312959 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9ec690eb-a7db-4614-9f73-9b4b92b03efa-metrics-server-audit-profiles\") pod \"metrics-server-b994475cc-vqrpx\" (UID: \"9ec690eb-a7db-4614-9f73-9b4b92b03efa\") " pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.315536 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.315512 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9ec690eb-a7db-4614-9f73-9b4b92b03efa-secret-metrics-server-client-certs\") pod \"metrics-server-b994475cc-vqrpx\" (UID: \"9ec690eb-a7db-4614-9f73-9b4b92b03efa\") " pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.317183 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.317157 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9ec690eb-a7db-4614-9f73-9b4b92b03efa-secret-metrics-server-tls\") pod \"metrics-server-b994475cc-vqrpx\" (UID: \"9ec690eb-a7db-4614-9f73-9b4b92b03efa\") " pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.317638 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.317593 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ec690eb-a7db-4614-9f73-9b4b92b03efa-client-ca-bundle\") pod \"metrics-server-b994475cc-vqrpx\" (UID: \"9ec690eb-a7db-4614-9f73-9b4b92b03efa\") " pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.321710 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.321670 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwtq8\" (UniqueName: \"kubernetes.io/projected/9ec690eb-a7db-4614-9f73-9b4b92b03efa-kube-api-access-fwtq8\") pod \"metrics-server-b994475cc-vqrpx\" (UID: \"9ec690eb-a7db-4614-9f73-9b4b92b03efa\") " pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.496811 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.496712 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:04.730079 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.730040 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:04.927453 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.927414 2577 patch_prober.go:28] interesting pod/image-registry-8ff4bf4f9-xvtfv container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 20:38:04.927624 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:04.927478 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" podUID="bac992c3-4bdc-439b-967b-e2a2679e09a9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 20:38:05.522936 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:05.522905 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:05.911953 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:05.911928 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-b994475cc-vqrpx"] Jul 06 20:38:06.108536 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:06.108512 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:06.359754 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:06.359728 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8ff4bf4f9-xvtfv" Jul 06 20:38:06.456320 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:06.456287 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4dr8s" event={"ID":"978b822b-4b60-4700-b98e-4ba141cdb13f","Type":"ContainerStarted","Data":"6049fd3bafeb5f8d8c306ec0d439f4d228f44f1df7a5699e5bd0b0a30e797299"} Jul 06 20:38:06.456504 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:06.456343 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4dr8s" event={"ID":"978b822b-4b60-4700-b98e-4ba141cdb13f","Type":"ContainerStarted","Data":"cf0473c33603c6bc375e02c75ffcdf8206d6b8fdeb6ec598dde464c1ba152776"} Jul 06 20:38:06.456504 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:06.456415 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4dr8s" Jul 06 20:38:06.457491 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:06.457467 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" event={"ID":"9ec690eb-a7db-4614-9f73-9b4b92b03efa","Type":"ContainerStarted","Data":"f9eb9176f4d711e2f9785a171b6e6d645dcdd02a827356ed11af7a5016bfd4ab"} Jul 06 20:38:06.460731 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:06.460706 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4775ff1-696a-4f8c-8d1c-af67bb548c43","Type":"ContainerStarted","Data":"3e7fab2b974ed057c7f0f62d83ec6f0f89beb929263f2224ff38e2ce2db51e4f"} Jul 06 20:38:06.460854 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:06.460778 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4775ff1-696a-4f8c-8d1c-af67bb548c43","Type":"ContainerStarted","Data":"860322a70d9b4599904109154daa283d594a3ca09d453287fd9dd9d061c18e85"} Jul 06 20:38:06.460854 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:06.460818 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4775ff1-696a-4f8c-8d1c-af67bb548c43","Type":"ContainerStarted","Data":"3747dd2cc2bdca9e412fd92ca90a587f75cddd1054b4216221271761c31be6e2"} Jul 06 20:38:06.460854 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:06.460852 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4775ff1-696a-4f8c-8d1c-af67bb548c43","Type":"ContainerStarted","Data":"e791c87e0ca39617b18143686243287f2b94e05cd1517b286b9d94a97dcba474"} Jul 06 20:38:06.460984 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:06.460881 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4775ff1-696a-4f8c-8d1c-af67bb548c43","Type":"ContainerStarted","Data":"3b765f74fe564fab60941d3f45ebfff3b29d6b964daadea89b07641ac0eeed98"} Jul 06 20:38:06.462502 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:06.462484 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" event={"ID":"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f","Type":"ContainerStarted","Data":"6816cd58b9726a083f99d403e1b873896ef4ea4610e103a46f2b874fa7cdaad1"} Jul 06 20:38:06.462590 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:06.462533 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" event={"ID":"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f","Type":"ContainerStarted","Data":"98cc1f2ffd2b57fe868b9fc876a64f31c56a1815f80f220e383d27f9ea94abd7"} Jul 06 20:38:06.462590 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:06.462561 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" event={"ID":"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f","Type":"ContainerStarted","Data":"12ac66a3504cc20af9fe362fa1accbf91c58c0c6b833f6b7a3d6940c50f70289"} Jul 06 20:38:06.482411 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:06.482370 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4dr8s" podStartSLOduration=128.971559221 podStartE2EDuration="2m11.482357401s" totalImagesPullingTime="2.51079818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:38:06.480675976 +0000 UTC m=+167.299821584" watchObservedRunningTime="2026-07-06 20:38:06.482357401 +0000 UTC m=+167.301503064" Jul 06 20:38:06.504613 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:06.504590 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:06.606002 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:06.605951 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:06.706523 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:06.706390 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:07.470913 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:07.470876 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4775ff1-696a-4f8c-8d1c-af67bb548c43","Type":"ContainerStarted","Data":"e94fb74729649f8761a226f1bec44d1c744babbfcf55541c5610fbc853610560"} Jul 06 20:38:07.474443 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:07.474396 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" event={"ID":"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f","Type":"ContainerStarted","Data":"0f03dbf55cbe7fe08afc0979ed2f7e8f2de500e4d3e6b645a9ce8d769a6f7636"} Jul 06 20:38:07.474588 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:07.474474 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" event={"ID":"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f","Type":"ContainerStarted","Data":"6064a62e10965fed4fb6192f9202a62a044ef40c8a2328e101136d489a5e9228"} Jul 06 20:38:07.474588 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:07.474518 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" event={"ID":"1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f","Type":"ContainerStarted","Data":"09ac3282d900b9cc5b1c2ef9f3df5e4a5cec837ee0e030abf98b1426e7cf571d"} Jul 06 20:38:07.501665 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:07.501607 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.205564282 podStartE2EDuration="7.501586289s" totalImagesPullingTime="4.278596308s" totalInitContainerRuntime="17.425699ms" isStatefulPod=false podCreationTimestamp="2026-07-06 20:38:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:38:07.498603022 +0000 UTC m=+168.317748631" watchObservedRunningTime="2026-07-06 20:38:07.501586289 +0000 UTC m=+168.320731898" Jul 06 20:38:07.526498 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:07.526435 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" podStartSLOduration=2.305866888 podStartE2EDuration="6.526412676s" totalImagesPullingTime="4.220545788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:38:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:38:07.523584493 +0000 UTC m=+168.342730102" watchObservedRunningTime="2026-07-06 20:38:07.526412676 +0000 UTC m=+168.345558285" Jul 06 20:38:08.479772 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:08.479731 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" event={"ID":"9ec690eb-a7db-4614-9f73-9b4b92b03efa","Type":"ContainerStarted","Data":"c38e0301463af51fbbcb7cc06eaa4e48cb7527e03f24df25adf9202657c64c13"} Jul 06 20:38:08.480496 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:08.480479 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:08.499580 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:08.499531 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" podStartSLOduration=2.842999555 podStartE2EDuration="4.499517772s" totalImagesPullingTime="1.656518217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:38:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:38:08.498743185 +0000 UTC m=+169.317888794" watchObservedRunningTime="2026-07-06 20:38:08.499517772 +0000 UTC m=+169.318663379" Jul 06 20:38:08.697922 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:08.697894 2577 scope.go:117] "RemoveContainer" containerID="a04326642232bfbc2b6d79c48b314998262dbcf6a506a3bd5cd2f49f0a2fe553" Jul 06 20:38:09.399091 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:09.399056 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-dmhqf"] Jul 06 20:38:09.401561 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:09.401533 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-dmhqf" Jul 06 20:38:09.404133 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:09.404094 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 20:38:09.404276 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:09.404176 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 20:38:09.404345 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:09.404298 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vgqbm\"" Jul 06 20:38:09.412488 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:09.412465 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-dmhqf"] Jul 06 20:38:09.415342 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:09.415321 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:09.463146 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:09.463109 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkncq\" (UniqueName: \"kubernetes.io/projected/cb326133-e833-4513-bb7c-3a8ab7dad1ed-kube-api-access-dkncq\") pod \"downloads-685bfb5f64-dmhqf\" (UID: \"cb326133-e833-4513-bb7c-3a8ab7dad1ed\") " pod="openshift-console/downloads-685bfb5f64-dmhqf" Jul 06 20:38:09.476886 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:09.476848 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:09.485323 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:09.485305 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-m8w66_7a829421-0363-40d1-941c-78b3f80a4f95/console-operator/2.log" Jul 06 20:38:09.485655 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:09.485419 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-m8w66" event={"ID":"7a829421-0363-40d1-941c-78b3f80a4f95","Type":"ContainerStarted","Data":"f7c44f16229a9fefa5832a2700822c43857e0f02dafde62f5d63b082a9308340"} Jul 06 20:38:09.485993 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:09.485977 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-m8w66" Jul 06 20:38:09.490542 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:09.490524 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-m8w66" Jul 06 20:38:09.503173 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:09.503136 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-m8w66" podStartSLOduration=51.57416402 podStartE2EDuration="54.503123587s" totalImagesPullingTime="2.928959567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:38:09.502682323 +0000 UTC m=+170.321827933" watchObservedRunningTime="2026-07-06 20:38:09.503123587 +0000 UTC m=+170.322269194" Jul 06 20:38:09.546545 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:09.546493 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:09.563884 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:09.563857 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkncq\" (UniqueName: \"kubernetes.io/projected/cb326133-e833-4513-bb7c-3a8ab7dad1ed-kube-api-access-dkncq\") pod \"downloads-685bfb5f64-dmhqf\" (UID: \"cb326133-e833-4513-bb7c-3a8ab7dad1ed\") " pod="openshift-console/downloads-685bfb5f64-dmhqf" Jul 06 20:38:09.571950 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:09.571925 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkncq\" (UniqueName: \"kubernetes.io/projected/cb326133-e833-4513-bb7c-3a8ab7dad1ed-kube-api-access-dkncq\") pod \"downloads-685bfb5f64-dmhqf\" (UID: \"cb326133-e833-4513-bb7c-3a8ab7dad1ed\") " pod="openshift-console/downloads-685bfb5f64-dmhqf" Jul 06 20:38:09.662753 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:09.662629 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:09.710974 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:09.710947 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-dmhqf" Jul 06 20:38:09.845006 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:09.844965 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-dmhqf"] Jul 06 20:38:09.848607 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:09.848574 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:09.849190 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:38:09.849166 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb326133_e833_4513_bb7c_3a8ab7dad1ed.slice/crio-f61927db9b8b4781c1d4afeb775ef7bc8fed1b1e8c093126ee5c12bad885065b WatchSource:0}: Error finding container f61927db9b8b4781c1d4afeb775ef7bc8fed1b1e8c093126ee5c12bad885065b: Status 404 returned error can't find the container with id f61927db9b8b4781c1d4afeb775ef7bc8fed1b1e8c093126ee5c12bad885065b Jul 06 20:38:09.914282 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:09.914195 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:10.042614 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:10.042579 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:10.106208 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:10.106179 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:10.489665 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:10.489620 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-dmhqf" event={"ID":"cb326133-e833-4513-bb7c-3a8ab7dad1ed","Type":"ContainerStarted","Data":"f61927db9b8b4781c1d4afeb775ef7bc8fed1b1e8c093126ee5c12bad885065b"} Jul 06 20:38:10.697011 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:10.696975 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:38:11.078227 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:11.078184 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:11.178916 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:11.178847 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:11.279438 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:11.279389 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:11.481203 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:11.481105 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:11.743212 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:11.743125 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:14.492989 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:14.492961 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-756b85c6b-55jjr" Jul 06 20:38:16.263561 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:16.263506 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:16.317952 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:16.317912 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:16.477298 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:16.477227 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4dr8s" Jul 06 20:38:17.777679 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:17.777641 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:17.849812 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:17.849754 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:18.131357 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.131313 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:18.238431 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.238366 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:18.278091 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.278053 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c7df5587-cxp9s"] Jul 06 20:38:18.282800 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.282749 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:18.285728 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.285706 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 20:38:18.286988 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.286956 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 20:38:18.286988 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.286958 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 20:38:18.287149 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.287042 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 20:38:18.287293 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.287277 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 20:38:18.287379 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.287301 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4d7tn\"" Jul 06 20:38:18.291181 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.291158 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c7df5587-cxp9s"] Jul 06 20:38:18.350419 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.350389 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c70c905-3817-4986-b2ff-2a579e0eb51b-console-oauth-config\") pod \"console-7c7df5587-cxp9s\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:18.350603 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.350443 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c70c905-3817-4986-b2ff-2a579e0eb51b-console-serving-cert\") pod \"console-7c7df5587-cxp9s\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:18.350603 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.350485 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c70c905-3817-4986-b2ff-2a579e0eb51b-service-ca\") pod \"console-7c7df5587-cxp9s\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:18.350603 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.350559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c70c905-3817-4986-b2ff-2a579e0eb51b-oauth-serving-cert\") pod \"console-7c7df5587-cxp9s\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:18.350603 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.350585 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k49zm\" (UniqueName: \"kubernetes.io/projected/0c70c905-3817-4986-b2ff-2a579e0eb51b-kube-api-access-k49zm\") pod \"console-7c7df5587-cxp9s\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:18.350808 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.350616 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c70c905-3817-4986-b2ff-2a579e0eb51b-console-config\") pod \"console-7c7df5587-cxp9s\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:18.451631 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.451551 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c70c905-3817-4986-b2ff-2a579e0eb51b-oauth-serving-cert\") pod \"console-7c7df5587-cxp9s\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:18.451631 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.451602 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k49zm\" (UniqueName: \"kubernetes.io/projected/0c70c905-3817-4986-b2ff-2a579e0eb51b-kube-api-access-k49zm\") pod \"console-7c7df5587-cxp9s\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:18.451871 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.451634 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c70c905-3817-4986-b2ff-2a579e0eb51b-console-config\") pod \"console-7c7df5587-cxp9s\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:18.451871 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.451678 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c70c905-3817-4986-b2ff-2a579e0eb51b-console-oauth-config\") pod \"console-7c7df5587-cxp9s\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:18.451871 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.451726 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c70c905-3817-4986-b2ff-2a579e0eb51b-console-serving-cert\") pod \"console-7c7df5587-cxp9s\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:18.451871 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.451774 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c70c905-3817-4986-b2ff-2a579e0eb51b-service-ca\") pod \"console-7c7df5587-cxp9s\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:18.452414 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.452365 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c70c905-3817-4986-b2ff-2a579e0eb51b-oauth-serving-cert\") pod \"console-7c7df5587-cxp9s\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:18.452661 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.452637 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c70c905-3817-4986-b2ff-2a579e0eb51b-console-config\") pod \"console-7c7df5587-cxp9s\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:18.452749 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.452661 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c70c905-3817-4986-b2ff-2a579e0eb51b-service-ca\") pod \"console-7c7df5587-cxp9s\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:18.454700 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.454659 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c70c905-3817-4986-b2ff-2a579e0eb51b-console-oauth-config\") pod \"console-7c7df5587-cxp9s\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:18.454838 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.454782 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c70c905-3817-4986-b2ff-2a579e0eb51b-console-serving-cert\") pod \"console-7c7df5587-cxp9s\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:18.461622 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.461567 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k49zm\" (UniqueName: \"kubernetes.io/projected/0c70c905-3817-4986-b2ff-2a579e0eb51b-kube-api-access-k49zm\") pod \"console-7c7df5587-cxp9s\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:18.479949 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.479898 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:18.545346 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.545312 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:18.595466 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.595377 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:18.746844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:18.746739 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c7df5587-cxp9s"] Jul 06 20:38:18.750980 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:38:18.750939 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c70c905_3817_4986_b2ff_2a579e0eb51b.slice/crio-e83104fb7425e24d303e88691ab52d0b92bbcd0077a8797719277425d7ebf034 WatchSource:0}: Error finding container e83104fb7425e24d303e88691ab52d0b92bbcd0077a8797719277425d7ebf034: Status 404 returned error can't find the container with id e83104fb7425e24d303e88691ab52d0b92bbcd0077a8797719277425d7ebf034 Jul 06 20:38:19.533332 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:19.533295 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7df5587-cxp9s" event={"ID":"0c70c905-3817-4986-b2ff-2a579e0eb51b","Type":"ContainerStarted","Data":"e83104fb7425e24d303e88691ab52d0b92bbcd0077a8797719277425d7ebf034"} Jul 06 20:38:24.497117 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:24.497074 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:24.497587 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:24.497147 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:25.232299 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:25.232266 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:25.332346 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:25.332308 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:25.433084 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:25.433049 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:25.607096 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:25.607054 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:25.705841 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:25.705805 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:26.470870 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.470837 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69cdbfcbbd-88xdw"] Jul 06 20:38:26.487835 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.487804 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69cdbfcbbd-88xdw"] Jul 06 20:38:26.488009 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.487873 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.497361 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.497332 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 20:38:26.639638 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.639597 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/687ec9b0-e063-4cf8-ad29-a13a6803a499-console-serving-cert\") pod \"console-69cdbfcbbd-88xdw\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.639638 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.639639 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-service-ca\") pod \"console-69cdbfcbbd-88xdw\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.640149 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.639711 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-trusted-ca-bundle\") pod \"console-69cdbfcbbd-88xdw\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.640149 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.639744 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-console-config\") pod \"console-69cdbfcbbd-88xdw\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.640149 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.639787 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njg9t\" (UniqueName: \"kubernetes.io/projected/687ec9b0-e063-4cf8-ad29-a13a6803a499-kube-api-access-njg9t\") pod \"console-69cdbfcbbd-88xdw\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.640149 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.639859 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/687ec9b0-e063-4cf8-ad29-a13a6803a499-console-oauth-config\") pod \"console-69cdbfcbbd-88xdw\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.640149 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.639878 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-oauth-serving-cert\") pod \"console-69cdbfcbbd-88xdw\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.740642 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.740536 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/687ec9b0-e063-4cf8-ad29-a13a6803a499-console-serving-cert\") pod \"console-69cdbfcbbd-88xdw\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.740642 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.740570 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-service-ca\") pod \"console-69cdbfcbbd-88xdw\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.740642 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.740632 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-trusted-ca-bundle\") pod \"console-69cdbfcbbd-88xdw\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.740952 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.740661 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-console-config\") pod \"console-69cdbfcbbd-88xdw\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.740952 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.740685 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njg9t\" (UniqueName: \"kubernetes.io/projected/687ec9b0-e063-4cf8-ad29-a13a6803a499-kube-api-access-njg9t\") pod \"console-69cdbfcbbd-88xdw\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.740952 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.740744 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/687ec9b0-e063-4cf8-ad29-a13a6803a499-console-oauth-config\") pod \"console-69cdbfcbbd-88xdw\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.740952 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.740794 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-oauth-serving-cert\") pod \"console-69cdbfcbbd-88xdw\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.741623 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.741568 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-oauth-serving-cert\") pod \"console-69cdbfcbbd-88xdw\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.741623 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.741578 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-service-ca\") pod \"console-69cdbfcbbd-88xdw\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.741985 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.741650 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-trusted-ca-bundle\") pod \"console-69cdbfcbbd-88xdw\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.741985 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.741863 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-console-config\") pod \"console-69cdbfcbbd-88xdw\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.743732 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.743709 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/687ec9b0-e063-4cf8-ad29-a13a6803a499-console-serving-cert\") pod \"console-69cdbfcbbd-88xdw\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.744330 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.744305 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/687ec9b0-e063-4cf8-ad29-a13a6803a499-console-oauth-config\") pod \"console-69cdbfcbbd-88xdw\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.749418 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.749394 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njg9t\" (UniqueName: \"kubernetes.io/projected/687ec9b0-e063-4cf8-ad29-a13a6803a499-kube-api-access-njg9t\") pod \"console-69cdbfcbbd-88xdw\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.799378 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.799309 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:26.890595 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:26.890554 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:28.250374 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:28.250346 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69cdbfcbbd-88xdw"] Jul 06 20:38:28.252724 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:38:28.252693 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod687ec9b0_e063_4cf8_ad29_a13a6803a499.slice/crio-f6d61b7496cfa7f73c85ca17ef077cdc92ed66dfc10c964867e9ddb268b94bff WatchSource:0}: Error finding container f6d61b7496cfa7f73c85ca17ef077cdc92ed66dfc10c964867e9ddb268b94bff: Status 404 returned error can't find the container with id f6d61b7496cfa7f73c85ca17ef077cdc92ed66dfc10c964867e9ddb268b94bff Jul 06 20:38:28.581949 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:28.581900 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-dmhqf" event={"ID":"cb326133-e833-4513-bb7c-3a8ab7dad1ed","Type":"ContainerStarted","Data":"da8cddd2da63231eca6de3c95a6ecd75fbf679ef59bf9949f4677cab49ef25b1"} Jul 06 20:38:28.582150 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:28.581970 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-dmhqf" Jul 06 20:38:28.583951 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:28.583911 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7df5587-cxp9s" event={"ID":"0c70c905-3817-4986-b2ff-2a579e0eb51b","Type":"ContainerStarted","Data":"93b98c3cdd6df156976119e5e14a6ea5f73425fce0de91f71f3aa5c82135f9e1"} Jul 06 20:38:28.585801 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:28.585753 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69cdbfcbbd-88xdw" event={"ID":"687ec9b0-e063-4cf8-ad29-a13a6803a499","Type":"ContainerStarted","Data":"c0d5c31500de10cef60d5ceac0ad040f0a93128e44a6f0ec823bc93ecbce14da"} Jul 06 20:38:28.585919 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:28.585814 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69cdbfcbbd-88xdw" event={"ID":"687ec9b0-e063-4cf8-ad29-a13a6803a499","Type":"ContainerStarted","Data":"f6d61b7496cfa7f73c85ca17ef077cdc92ed66dfc10c964867e9ddb268b94bff"} Jul 06 20:38:28.596050 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:28.596022 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:28.596166 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:28.596074 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:28.596166 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:28.596118 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-dmhqf" Jul 06 20:38:28.601118 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:28.601067 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-dmhqf" podStartSLOduration=1.300899453 podStartE2EDuration="19.601046889s" totalImagesPullingTime="18.300147436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:38:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:38:28.599394691 +0000 UTC m=+189.418540300" watchObservedRunningTime="2026-07-06 20:38:28.601046889 +0000 UTC m=+189.420192499" Jul 06 20:38:28.601804 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:28.601754 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:28.655858 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:28.654293 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c7df5587-cxp9s" podStartSLOduration=1.290863976 podStartE2EDuration="10.654250845s" totalImagesPullingTime="9.363386869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:38:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:38:28.651833576 +0000 UTC m=+189.470979185" watchObservedRunningTime="2026-07-06 20:38:28.654250845 +0000 UTC m=+189.473396454" Jul 06 20:38:28.655858 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:28.655534 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69cdbfcbbd-88xdw" podStartSLOduration=2.655518805 podStartE2EDuration="2.655518805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:38:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:38:28.635280819 +0000 UTC m=+189.454426431" watchObservedRunningTime="2026-07-06 20:38:28.655518805 +0000 UTC m=+189.474664415" Jul 06 20:38:29.592996 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:29.592956 2577 generic.go:356] "Generic (PLEG): container finished" podID="2b9454b2-a95d-49b8-bd43-66f163c3cff8" containerID="71bf6b43fb6d1c1133c7eb6ec6316dc2e2e412527716d9ab560c143669e8ee93" exitCode=0 Jul 06 20:38:29.593467 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:29.593038 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" event={"ID":"2b9454b2-a95d-49b8-bd43-66f163c3cff8","Type":"ContainerDied","Data":"71bf6b43fb6d1c1133c7eb6ec6316dc2e2e412527716d9ab560c143669e8ee93"} Jul 06 20:38:29.593686 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:29.593659 2577 scope.go:117] "RemoveContainer" containerID="71bf6b43fb6d1c1133c7eb6ec6316dc2e2e412527716d9ab560c143669e8ee93" Jul 06 20:38:29.598885 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:29.598862 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:38:30.601227 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:30.601183 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-hxgk7" event={"ID":"2b9454b2-a95d-49b8-bd43-66f163c3cff8","Type":"ContainerStarted","Data":"b4d4a4fcad49936b4a15ddfd1e356cea96272c25a2225dc779a753145b497ddb"} Jul 06 20:38:32.679365 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:32.679324 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:32.780402 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:32.780354 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:32.840450 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:32.840414 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:33.675996 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:33.675955 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:34.623646 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:34.623615 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:36.800110 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:36.800070 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:36.800560 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:36.800150 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:36.806236 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:36.806210 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:37.315627 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:37.315587 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:37.415844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:37.415803 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:37.637817 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:37.637712 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:38:37.682085 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:37.682052 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c7df5587-cxp9s"] Jul 06 20:38:38.502623 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:38.502591 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:38.603096 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:38.603064 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:44.502325 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:44.502296 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:44.506212 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:44.506185 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-b994475cc-vqrpx" Jul 06 20:38:45.669250 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:45.669215 2577 generic.go:356] "Generic (PLEG): container finished" podID="32e64091-395a-4a73-b236-50ec25a430ce" containerID="a4f4bf152ad483346ea6301c9fdec1a1da215c78d97a6fc154d277231d9512ed" exitCode=0 Jul 06 20:38:45.669631 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:45.669267 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zwvls" event={"ID":"32e64091-395a-4a73-b236-50ec25a430ce","Type":"ContainerDied","Data":"a4f4bf152ad483346ea6301c9fdec1a1da215c78d97a6fc154d277231d9512ed"} Jul 06 20:38:45.669631 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:45.669582 2577 scope.go:117] "RemoveContainer" containerID="a4f4bf152ad483346ea6301c9fdec1a1da215c78d97a6fc154d277231d9512ed" Jul 06 20:38:46.675094 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:46.675062 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-zwvls" event={"ID":"32e64091-395a-4a73-b236-50ec25a430ce","Type":"ContainerStarted","Data":"2b70c14b974c8bdf8cdd8fcd8c14eadbbcaff70294bb0b8ba9c453ae8606d78c"} Jul 06 20:38:47.764059 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:47.764023 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:47.821125 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:38:47.821090 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:39:02.711358 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:02.711316 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7c7df5587-cxp9s" podUID="0c70c905-3817-4986-b2ff-2a579e0eb51b" containerName="console" containerID="cri-o://93b98c3cdd6df156976119e5e14a6ea5f73425fce0de91f71f3aa5c82135f9e1" gracePeriod=15 Jul 06 20:39:02.785615 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:02.785583 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:39:02.848971 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:02.848934 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:39:02.982750 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:02.982677 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:39:03.086905 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.086872 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c70c905-3817-4986-b2ff-2a579e0eb51b-service-ca\") pod \"0c70c905-3817-4986-b2ff-2a579e0eb51b\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " Jul 06 20:39:03.087080 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.086931 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c70c905-3817-4986-b2ff-2a579e0eb51b-console-serving-cert\") pod \"0c70c905-3817-4986-b2ff-2a579e0eb51b\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " Jul 06 20:39:03.087080 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.086970 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c70c905-3817-4986-b2ff-2a579e0eb51b-oauth-serving-cert\") pod \"0c70c905-3817-4986-b2ff-2a579e0eb51b\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " Jul 06 20:39:03.087201 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.087174 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k49zm\" (UniqueName: \"kubernetes.io/projected/0c70c905-3817-4986-b2ff-2a579e0eb51b-kube-api-access-k49zm\") pod \"0c70c905-3817-4986-b2ff-2a579e0eb51b\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " Jul 06 20:39:03.087261 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.087225 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c70c905-3817-4986-b2ff-2a579e0eb51b-console-oauth-config\") pod \"0c70c905-3817-4986-b2ff-2a579e0eb51b\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " Jul 06 20:39:03.087261 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.087245 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c70c905-3817-4986-b2ff-2a579e0eb51b-console-config\") pod \"0c70c905-3817-4986-b2ff-2a579e0eb51b\" (UID: \"0c70c905-3817-4986-b2ff-2a579e0eb51b\") " Jul 06 20:39:03.087383 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.087361 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c70c905-3817-4986-b2ff-2a579e0eb51b-service-ca" (OuterVolumeSpecName: "service-ca") pod "0c70c905-3817-4986-b2ff-2a579e0eb51b" (UID: "0c70c905-3817-4986-b2ff-2a579e0eb51b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:39:03.087383 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.087369 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c70c905-3817-4986-b2ff-2a579e0eb51b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0c70c905-3817-4986-b2ff-2a579e0eb51b" (UID: "0c70c905-3817-4986-b2ff-2a579e0eb51b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:39:03.087658 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.087633 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c70c905-3817-4986-b2ff-2a579e0eb51b-service-ca\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:39:03.087658 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.087660 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c70c905-3817-4986-b2ff-2a579e0eb51b-oauth-serving-cert\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:39:03.088042 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.087654 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c70c905-3817-4986-b2ff-2a579e0eb51b-console-config" (OuterVolumeSpecName: "console-config") pod "0c70c905-3817-4986-b2ff-2a579e0eb51b" (UID: "0c70c905-3817-4986-b2ff-2a579e0eb51b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:39:03.089565 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.089541 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c70c905-3817-4986-b2ff-2a579e0eb51b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0c70c905-3817-4986-b2ff-2a579e0eb51b" (UID: "0c70c905-3817-4986-b2ff-2a579e0eb51b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:39:03.089652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.089569 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c70c905-3817-4986-b2ff-2a579e0eb51b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0c70c905-3817-4986-b2ff-2a579e0eb51b" (UID: "0c70c905-3817-4986-b2ff-2a579e0eb51b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:39:03.089652 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.089627 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c70c905-3817-4986-b2ff-2a579e0eb51b-kube-api-access-k49zm" (OuterVolumeSpecName: "kube-api-access-k49zm") pod "0c70c905-3817-4986-b2ff-2a579e0eb51b" (UID: "0c70c905-3817-4986-b2ff-2a579e0eb51b"). InnerVolumeSpecName "kube-api-access-k49zm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:39:03.188430 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.188394 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c70c905-3817-4986-b2ff-2a579e0eb51b-console-serving-cert\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:39:03.188430 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.188423 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k49zm\" (UniqueName: \"kubernetes.io/projected/0c70c905-3817-4986-b2ff-2a579e0eb51b-kube-api-access-k49zm\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:39:03.188430 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.188433 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c70c905-3817-4986-b2ff-2a579e0eb51b-console-oauth-config\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:39:03.188654 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.188444 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c70c905-3817-4986-b2ff-2a579e0eb51b-console-config\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:39:03.742482 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.742440 2577 generic.go:356] "Generic (PLEG): container finished" podID="0c70c905-3817-4986-b2ff-2a579e0eb51b" containerID="93b98c3cdd6df156976119e5e14a6ea5f73425fce0de91f71f3aa5c82135f9e1" exitCode=0 Jul 06 20:39:03.742937 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.742494 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7df5587-cxp9s" Jul 06 20:39:03.742937 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.742536 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7df5587-cxp9s" event={"ID":"0c70c905-3817-4986-b2ff-2a579e0eb51b","Type":"ContainerDied","Data":"93b98c3cdd6df156976119e5e14a6ea5f73425fce0de91f71f3aa5c82135f9e1"} Jul 06 20:39:03.742937 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.742583 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7df5587-cxp9s" event={"ID":"0c70c905-3817-4986-b2ff-2a579e0eb51b","Type":"ContainerDied","Data":"e83104fb7425e24d303e88691ab52d0b92bbcd0077a8797719277425d7ebf034"} Jul 06 20:39:03.742937 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.742604 2577 scope.go:117] "RemoveContainer" containerID="93b98c3cdd6df156976119e5e14a6ea5f73425fce0de91f71f3aa5c82135f9e1" Jul 06 20:39:03.751122 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.751093 2577 scope.go:117] "RemoveContainer" containerID="93b98c3cdd6df156976119e5e14a6ea5f73425fce0de91f71f3aa5c82135f9e1" Jul 06 20:39:03.751360 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:39:03.751339 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93b98c3cdd6df156976119e5e14a6ea5f73425fce0de91f71f3aa5c82135f9e1\": container with ID starting with 93b98c3cdd6df156976119e5e14a6ea5f73425fce0de91f71f3aa5c82135f9e1 not found: ID does not exist" containerID="93b98c3cdd6df156976119e5e14a6ea5f73425fce0de91f71f3aa5c82135f9e1" Jul 06 20:39:03.751416 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.751379 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93b98c3cdd6df156976119e5e14a6ea5f73425fce0de91f71f3aa5c82135f9e1"} err="failed to get container status \"93b98c3cdd6df156976119e5e14a6ea5f73425fce0de91f71f3aa5c82135f9e1\": rpc error: code = NotFound desc = could not find container \"93b98c3cdd6df156976119e5e14a6ea5f73425fce0de91f71f3aa5c82135f9e1\": container with ID starting with 93b98c3cdd6df156976119e5e14a6ea5f73425fce0de91f71f3aa5c82135f9e1 not found: ID does not exist" Jul 06 20:39:03.758216 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.758196 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c7df5587-cxp9s"] Jul 06 20:39:03.762305 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:03.762287 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c7df5587-cxp9s"] Jul 06 20:39:05.702365 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:05.702330 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c70c905-3817-4986-b2ff-2a579e0eb51b" path="/var/lib/kubelet/pods/0c70c905-3817-4986-b2ff-2a579e0eb51b/volumes" Jul 06 20:39:19.167362 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:19.167312 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:39:19.246434 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:19.246402 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:39:19.328530 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:19.328484 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:39:19.709635 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:19.709607 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:39:20.208237 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:20.208202 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:39:20.208616 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:20.208485 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="alertmanager" containerID="cri-o://3b765f74fe564fab60941d3f45ebfff3b29d6b964daadea89b07641ac0eeed98" gracePeriod=120 Jul 06 20:39:20.208616 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:20.208554 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="kube-rbac-proxy-metric" containerID="cri-o://3e7fab2b974ed057c7f0f62d83ec6f0f89beb929263f2224ff38e2ce2db51e4f" gracePeriod=120 Jul 06 20:39:20.208616 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:20.208574 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="kube-rbac-proxy-web" containerID="cri-o://3747dd2cc2bdca9e412fd92ca90a587f75cddd1054b4216221271761c31be6e2" gracePeriod=120 Jul 06 20:39:20.208616 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:20.208604 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="prom-label-proxy" containerID="cri-o://e94fb74729649f8761a226f1bec44d1c744babbfcf55541c5610fbc853610560" gracePeriod=120 Jul 06 20:39:20.208852 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:20.208623 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="kube-rbac-proxy" containerID="cri-o://860322a70d9b4599904109154daa283d594a3ca09d453287fd9dd9d061c18e85" gracePeriod=120 Jul 06 20:39:20.208852 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:20.208579 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="config-reloader" containerID="cri-o://e791c87e0ca39617b18143686243287f2b94e05cd1517b286b9d94a97dcba474" gracePeriod=120 Jul 06 20:39:20.814728 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:20.814699 2577 generic.go:356] "Generic (PLEG): container finished" podID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerID="e94fb74729649f8761a226f1bec44d1c744babbfcf55541c5610fbc853610560" exitCode=0 Jul 06 20:39:20.814728 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:20.814724 2577 generic.go:356] "Generic (PLEG): container finished" podID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerID="860322a70d9b4599904109154daa283d594a3ca09d453287fd9dd9d061c18e85" exitCode=0 Jul 06 20:39:20.814728 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:20.814731 2577 generic.go:356] "Generic (PLEG): container finished" podID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerID="e791c87e0ca39617b18143686243287f2b94e05cd1517b286b9d94a97dcba474" exitCode=0 Jul 06 20:39:20.814728 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:20.814737 2577 generic.go:356] "Generic (PLEG): container finished" podID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerID="3b765f74fe564fab60941d3f45ebfff3b29d6b964daadea89b07641ac0eeed98" exitCode=0 Jul 06 20:39:20.815066 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:20.814798 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4775ff1-696a-4f8c-8d1c-af67bb548c43","Type":"ContainerDied","Data":"e94fb74729649f8761a226f1bec44d1c744babbfcf55541c5610fbc853610560"} Jul 06 20:39:20.815066 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:20.814878 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4775ff1-696a-4f8c-8d1c-af67bb548c43","Type":"ContainerDied","Data":"860322a70d9b4599904109154daa283d594a3ca09d453287fd9dd9d061c18e85"} Jul 06 20:39:20.815066 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:20.814917 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4775ff1-696a-4f8c-8d1c-af67bb548c43","Type":"ContainerDied","Data":"e791c87e0ca39617b18143686243287f2b94e05cd1517b286b9d94a97dcba474"} Jul 06 20:39:20.815066 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:20.814953 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4775ff1-696a-4f8c-8d1c-af67bb548c43","Type":"ContainerDied","Data":"3b765f74fe564fab60941d3f45ebfff3b29d6b964daadea89b07641ac0eeed98"} Jul 06 20:39:21.463390 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.463362 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:21.559423 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.559395 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-config-volume\") pod \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " Jul 06 20:39:21.559601 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.559437 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4775ff1-696a-4f8c-8d1c-af67bb548c43-tls-assets\") pod \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " Jul 06 20:39:21.559601 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.559476 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4775ff1-696a-4f8c-8d1c-af67bb548c43-metrics-client-ca\") pod \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " Jul 06 20:39:21.559601 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.559503 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c4775ff1-696a-4f8c-8d1c-af67bb548c43-alertmanager-main-db\") pod \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " Jul 06 20:39:21.559601 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.559542 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " Jul 06 20:39:21.559601 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.559572 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-kube-rbac-proxy-web\") pod \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " Jul 06 20:39:21.559912 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.559618 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4775ff1-696a-4f8c-8d1c-af67bb548c43-alertmanager-trusted-ca-bundle\") pod \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " Jul 06 20:39:21.559912 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.559648 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4775ff1-696a-4f8c-8d1c-af67bb548c43-config-out\") pod \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " Jul 06 20:39:21.559912 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.559680 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tds28\" (UniqueName: \"kubernetes.io/projected/c4775ff1-696a-4f8c-8d1c-af67bb548c43-kube-api-access-tds28\") pod \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " Jul 06 20:39:21.559912 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.559720 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-main-tls\") pod \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " Jul 06 20:39:21.559912 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.559792 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-web-config\") pod \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " Jul 06 20:39:21.559912 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.559832 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-kube-rbac-proxy\") pod \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " Jul 06 20:39:21.559912 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.559859 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-cluster-tls-config\") pod \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\" (UID: \"c4775ff1-696a-4f8c-8d1c-af67bb548c43\") " Jul 06 20:39:21.560214 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.559902 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4775ff1-696a-4f8c-8d1c-af67bb548c43-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c4775ff1-696a-4f8c-8d1c-af67bb548c43" (UID: "c4775ff1-696a-4f8c-8d1c-af67bb548c43"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:39:21.560214 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.559937 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4775ff1-696a-4f8c-8d1c-af67bb548c43-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c4775ff1-696a-4f8c-8d1c-af67bb548c43" (UID: "c4775ff1-696a-4f8c-8d1c-af67bb548c43"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:39:21.560214 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.560174 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4775ff1-696a-4f8c-8d1c-af67bb548c43-metrics-client-ca\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:39:21.560214 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.560192 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c4775ff1-696a-4f8c-8d1c-af67bb548c43-alertmanager-main-db\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:39:21.560424 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.560352 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4775ff1-696a-4f8c-8d1c-af67bb548c43-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c4775ff1-696a-4f8c-8d1c-af67bb548c43" (UID: "c4775ff1-696a-4f8c-8d1c-af67bb548c43"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:39:21.563145 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.563054 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4775ff1-696a-4f8c-8d1c-af67bb548c43-kube-api-access-tds28" (OuterVolumeSpecName: "kube-api-access-tds28") pod "c4775ff1-696a-4f8c-8d1c-af67bb548c43" (UID: "c4775ff1-696a-4f8c-8d1c-af67bb548c43"). InnerVolumeSpecName "kube-api-access-tds28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:39:21.563145 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.563108 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-config-volume" (OuterVolumeSpecName: "config-volume") pod "c4775ff1-696a-4f8c-8d1c-af67bb548c43" (UID: "c4775ff1-696a-4f8c-8d1c-af67bb548c43"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:39:21.563378 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.563162 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c4775ff1-696a-4f8c-8d1c-af67bb548c43" (UID: "c4775ff1-696a-4f8c-8d1c-af67bb548c43"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:39:21.563378 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.563303 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4775ff1-696a-4f8c-8d1c-af67bb548c43-config-out" (OuterVolumeSpecName: "config-out") pod "c4775ff1-696a-4f8c-8d1c-af67bb548c43" (UID: "c4775ff1-696a-4f8c-8d1c-af67bb548c43"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:39:21.563665 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.563619 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c4775ff1-696a-4f8c-8d1c-af67bb548c43" (UID: "c4775ff1-696a-4f8c-8d1c-af67bb548c43"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:39:21.563776 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.563662 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4775ff1-696a-4f8c-8d1c-af67bb548c43-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c4775ff1-696a-4f8c-8d1c-af67bb548c43" (UID: "c4775ff1-696a-4f8c-8d1c-af67bb548c43"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:39:21.564201 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.564170 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c4775ff1-696a-4f8c-8d1c-af67bb548c43" (UID: "c4775ff1-696a-4f8c-8d1c-af67bb548c43"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:39:21.564479 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.564456 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c4775ff1-696a-4f8c-8d1c-af67bb548c43" (UID: "c4775ff1-696a-4f8c-8d1c-af67bb548c43"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:39:21.567085 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.567063 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c4775ff1-696a-4f8c-8d1c-af67bb548c43" (UID: "c4775ff1-696a-4f8c-8d1c-af67bb548c43"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:39:21.575276 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.575250 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-web-config" (OuterVolumeSpecName: "web-config") pod "c4775ff1-696a-4f8c-8d1c-af67bb548c43" (UID: "c4775ff1-696a-4f8c-8d1c-af67bb548c43"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:39:21.660967 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.660912 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:39:21.660967 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.660958 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:39:21.660967 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.660969 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4775ff1-696a-4f8c-8d1c-af67bb548c43-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:39:21.660967 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.660979 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4775ff1-696a-4f8c-8d1c-af67bb548c43-config-out\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:39:21.661260 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.660989 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tds28\" (UniqueName: \"kubernetes.io/projected/c4775ff1-696a-4f8c-8d1c-af67bb548c43-kube-api-access-tds28\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:39:21.661260 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.660998 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-main-tls\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:39:21.661260 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.661006 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-web-config\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:39:21.661260 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.661014 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:39:21.661260 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.661022 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-cluster-tls-config\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:39:21.661260 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.661030 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c4775ff1-696a-4f8c-8d1c-af67bb548c43-config-volume\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:39:21.661260 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.661037 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4775ff1-696a-4f8c-8d1c-af67bb548c43-tls-assets\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:39:21.822598 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.822513 2577 generic.go:356] "Generic (PLEG): container finished" podID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerID="3e7fab2b974ed057c7f0f62d83ec6f0f89beb929263f2224ff38e2ce2db51e4f" exitCode=0 Jul 06 20:39:21.822598 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.822543 2577 generic.go:356] "Generic (PLEG): container finished" podID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerID="3747dd2cc2bdca9e412fd92ca90a587f75cddd1054b4216221271761c31be6e2" exitCode=0 Jul 06 20:39:21.822598 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.822579 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4775ff1-696a-4f8c-8d1c-af67bb548c43","Type":"ContainerDied","Data":"3e7fab2b974ed057c7f0f62d83ec6f0f89beb929263f2224ff38e2ce2db51e4f"} Jul 06 20:39:21.822845 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.822607 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:21.822845 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.822653 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4775ff1-696a-4f8c-8d1c-af67bb548c43","Type":"ContainerDied","Data":"3747dd2cc2bdca9e412fd92ca90a587f75cddd1054b4216221271761c31be6e2"} Jul 06 20:39:21.822845 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.822696 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4775ff1-696a-4f8c-8d1c-af67bb548c43","Type":"ContainerDied","Data":"abf59999b1fa67124e4b27f71517150a725301d9d4b8153889e3b692cc322a5a"} Jul 06 20:39:21.822845 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.822720 2577 scope.go:117] "RemoveContainer" containerID="e94fb74729649f8761a226f1bec44d1c744babbfcf55541c5610fbc853610560" Jul 06 20:39:21.830548 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.830521 2577 scope.go:117] "RemoveContainer" containerID="3e7fab2b974ed057c7f0f62d83ec6f0f89beb929263f2224ff38e2ce2db51e4f" Jul 06 20:39:21.839572 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.839552 2577 scope.go:117] "RemoveContainer" containerID="860322a70d9b4599904109154daa283d594a3ca09d453287fd9dd9d061c18e85" Jul 06 20:39:21.846959 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.846935 2577 scope.go:117] "RemoveContainer" containerID="3747dd2cc2bdca9e412fd92ca90a587f75cddd1054b4216221271761c31be6e2" Jul 06 20:39:21.847268 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.847249 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:39:21.850732 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.850708 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:39:21.854193 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.854176 2577 scope.go:117] "RemoveContainer" containerID="e791c87e0ca39617b18143686243287f2b94e05cd1517b286b9d94a97dcba474" Jul 06 20:39:21.861024 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.861009 2577 scope.go:117] "RemoveContainer" containerID="3b765f74fe564fab60941d3f45ebfff3b29d6b964daadea89b07641ac0eeed98" Jul 06 20:39:21.868058 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.868037 2577 scope.go:117] "RemoveContainer" containerID="d081b07df51f8783dd4dd96d60a371e5661d4919fdc8dcd2161cd6dcb15b267e" Jul 06 20:39:21.875047 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.875021 2577 scope.go:117] "RemoveContainer" containerID="e94fb74729649f8761a226f1bec44d1c744babbfcf55541c5610fbc853610560" Jul 06 20:39:21.875298 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:39:21.875279 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e94fb74729649f8761a226f1bec44d1c744babbfcf55541c5610fbc853610560\": container with ID starting with e94fb74729649f8761a226f1bec44d1c744babbfcf55541c5610fbc853610560 not found: ID does not exist" containerID="e94fb74729649f8761a226f1bec44d1c744babbfcf55541c5610fbc853610560" Jul 06 20:39:21.875373 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.875310 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e94fb74729649f8761a226f1bec44d1c744babbfcf55541c5610fbc853610560"} err="failed to get container status \"e94fb74729649f8761a226f1bec44d1c744babbfcf55541c5610fbc853610560\": rpc error: code = NotFound desc = could not find container \"e94fb74729649f8761a226f1bec44d1c744babbfcf55541c5610fbc853610560\": container with ID starting with e94fb74729649f8761a226f1bec44d1c744babbfcf55541c5610fbc853610560 not found: ID does not exist" Jul 06 20:39:21.875373 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.875338 2577 scope.go:117] "RemoveContainer" containerID="3e7fab2b974ed057c7f0f62d83ec6f0f89beb929263f2224ff38e2ce2db51e4f" Jul 06 20:39:21.875644 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:39:21.875616 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e7fab2b974ed057c7f0f62d83ec6f0f89beb929263f2224ff38e2ce2db51e4f\": container with ID starting with 3e7fab2b974ed057c7f0f62d83ec6f0f89beb929263f2224ff38e2ce2db51e4f not found: ID does not exist" containerID="3e7fab2b974ed057c7f0f62d83ec6f0f89beb929263f2224ff38e2ce2db51e4f" Jul 06 20:39:21.875741 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.875643 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e7fab2b974ed057c7f0f62d83ec6f0f89beb929263f2224ff38e2ce2db51e4f"} err="failed to get container status \"3e7fab2b974ed057c7f0f62d83ec6f0f89beb929263f2224ff38e2ce2db51e4f\": rpc error: code = NotFound desc = could not find container \"3e7fab2b974ed057c7f0f62d83ec6f0f89beb929263f2224ff38e2ce2db51e4f\": container with ID starting with 3e7fab2b974ed057c7f0f62d83ec6f0f89beb929263f2224ff38e2ce2db51e4f not found: ID does not exist" Jul 06 20:39:21.875741 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.875662 2577 scope.go:117] "RemoveContainer" containerID="860322a70d9b4599904109154daa283d594a3ca09d453287fd9dd9d061c18e85" Jul 06 20:39:21.876017 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:39:21.875994 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"860322a70d9b4599904109154daa283d594a3ca09d453287fd9dd9d061c18e85\": container with ID starting with 860322a70d9b4599904109154daa283d594a3ca09d453287fd9dd9d061c18e85 not found: ID does not exist" containerID="860322a70d9b4599904109154daa283d594a3ca09d453287fd9dd9d061c18e85" Jul 06 20:39:21.876097 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.876026 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"860322a70d9b4599904109154daa283d594a3ca09d453287fd9dd9d061c18e85"} err="failed to get container status \"860322a70d9b4599904109154daa283d594a3ca09d453287fd9dd9d061c18e85\": rpc error: code = NotFound desc = could not find container \"860322a70d9b4599904109154daa283d594a3ca09d453287fd9dd9d061c18e85\": container with ID starting with 860322a70d9b4599904109154daa283d594a3ca09d453287fd9dd9d061c18e85 not found: ID does not exist" Jul 06 20:39:21.876097 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.876048 2577 scope.go:117] "RemoveContainer" containerID="3747dd2cc2bdca9e412fd92ca90a587f75cddd1054b4216221271761c31be6e2" Jul 06 20:39:21.876491 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:39:21.876461 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3747dd2cc2bdca9e412fd92ca90a587f75cddd1054b4216221271761c31be6e2\": container with ID starting with 3747dd2cc2bdca9e412fd92ca90a587f75cddd1054b4216221271761c31be6e2 not found: ID does not exist" containerID="3747dd2cc2bdca9e412fd92ca90a587f75cddd1054b4216221271761c31be6e2" Jul 06 20:39:21.876574 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.876489 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3747dd2cc2bdca9e412fd92ca90a587f75cddd1054b4216221271761c31be6e2"} err="failed to get container status \"3747dd2cc2bdca9e412fd92ca90a587f75cddd1054b4216221271761c31be6e2\": rpc error: code = NotFound desc = could not find container \"3747dd2cc2bdca9e412fd92ca90a587f75cddd1054b4216221271761c31be6e2\": container with ID starting with 3747dd2cc2bdca9e412fd92ca90a587f75cddd1054b4216221271761c31be6e2 not found: ID does not exist" Jul 06 20:39:21.876574 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.876508 2577 scope.go:117] "RemoveContainer" containerID="e791c87e0ca39617b18143686243287f2b94e05cd1517b286b9d94a97dcba474" Jul 06 20:39:21.876816 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:39:21.876794 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e791c87e0ca39617b18143686243287f2b94e05cd1517b286b9d94a97dcba474\": container with ID starting with e791c87e0ca39617b18143686243287f2b94e05cd1517b286b9d94a97dcba474 not found: ID does not exist" containerID="e791c87e0ca39617b18143686243287f2b94e05cd1517b286b9d94a97dcba474" Jul 06 20:39:21.876894 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.876820 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e791c87e0ca39617b18143686243287f2b94e05cd1517b286b9d94a97dcba474"} err="failed to get container status \"e791c87e0ca39617b18143686243287f2b94e05cd1517b286b9d94a97dcba474\": rpc error: code = NotFound desc = could not find container \"e791c87e0ca39617b18143686243287f2b94e05cd1517b286b9d94a97dcba474\": container with ID starting with e791c87e0ca39617b18143686243287f2b94e05cd1517b286b9d94a97dcba474 not found: ID does not exist" Jul 06 20:39:21.876894 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.876835 2577 scope.go:117] "RemoveContainer" containerID="3b765f74fe564fab60941d3f45ebfff3b29d6b964daadea89b07641ac0eeed98" Jul 06 20:39:21.877086 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:39:21.877071 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b765f74fe564fab60941d3f45ebfff3b29d6b964daadea89b07641ac0eeed98\": container with ID starting with 3b765f74fe564fab60941d3f45ebfff3b29d6b964daadea89b07641ac0eeed98 not found: ID does not exist" containerID="3b765f74fe564fab60941d3f45ebfff3b29d6b964daadea89b07641ac0eeed98" Jul 06 20:39:21.877132 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.877089 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b765f74fe564fab60941d3f45ebfff3b29d6b964daadea89b07641ac0eeed98"} err="failed to get container status \"3b765f74fe564fab60941d3f45ebfff3b29d6b964daadea89b07641ac0eeed98\": rpc error: code = NotFound desc = could not find container \"3b765f74fe564fab60941d3f45ebfff3b29d6b964daadea89b07641ac0eeed98\": container with ID starting with 3b765f74fe564fab60941d3f45ebfff3b29d6b964daadea89b07641ac0eeed98 not found: ID does not exist" Jul 06 20:39:21.877132 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.877102 2577 scope.go:117] "RemoveContainer" containerID="d081b07df51f8783dd4dd96d60a371e5661d4919fdc8dcd2161cd6dcb15b267e" Jul 06 20:39:21.877334 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:39:21.877318 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d081b07df51f8783dd4dd96d60a371e5661d4919fdc8dcd2161cd6dcb15b267e\": container with ID starting with d081b07df51f8783dd4dd96d60a371e5661d4919fdc8dcd2161cd6dcb15b267e not found: ID does not exist" containerID="d081b07df51f8783dd4dd96d60a371e5661d4919fdc8dcd2161cd6dcb15b267e" Jul 06 20:39:21.877375 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.877337 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d081b07df51f8783dd4dd96d60a371e5661d4919fdc8dcd2161cd6dcb15b267e"} err="failed to get container status \"d081b07df51f8783dd4dd96d60a371e5661d4919fdc8dcd2161cd6dcb15b267e\": rpc error: code = NotFound desc = could not find container \"d081b07df51f8783dd4dd96d60a371e5661d4919fdc8dcd2161cd6dcb15b267e\": container with ID starting with d081b07df51f8783dd4dd96d60a371e5661d4919fdc8dcd2161cd6dcb15b267e not found: ID does not exist" Jul 06 20:39:21.877375 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.877349 2577 scope.go:117] "RemoveContainer" containerID="e94fb74729649f8761a226f1bec44d1c744babbfcf55541c5610fbc853610560" Jul 06 20:39:21.877586 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.877570 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e94fb74729649f8761a226f1bec44d1c744babbfcf55541c5610fbc853610560"} err="failed to get container status \"e94fb74729649f8761a226f1bec44d1c744babbfcf55541c5610fbc853610560\": rpc error: code = NotFound desc = could not find container \"e94fb74729649f8761a226f1bec44d1c744babbfcf55541c5610fbc853610560\": container with ID starting with e94fb74729649f8761a226f1bec44d1c744babbfcf55541c5610fbc853610560 not found: ID does not exist" Jul 06 20:39:21.877626 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.877586 2577 scope.go:117] "RemoveContainer" containerID="3e7fab2b974ed057c7f0f62d83ec6f0f89beb929263f2224ff38e2ce2db51e4f" Jul 06 20:39:21.877824 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.877805 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e7fab2b974ed057c7f0f62d83ec6f0f89beb929263f2224ff38e2ce2db51e4f"} err="failed to get container status \"3e7fab2b974ed057c7f0f62d83ec6f0f89beb929263f2224ff38e2ce2db51e4f\": rpc error: code = NotFound desc = could not find container \"3e7fab2b974ed057c7f0f62d83ec6f0f89beb929263f2224ff38e2ce2db51e4f\": container with ID starting with 3e7fab2b974ed057c7f0f62d83ec6f0f89beb929263f2224ff38e2ce2db51e4f not found: ID does not exist" Jul 06 20:39:21.877869 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.877825 2577 scope.go:117] "RemoveContainer" containerID="860322a70d9b4599904109154daa283d594a3ca09d453287fd9dd9d061c18e85" Jul 06 20:39:21.878046 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878029 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"860322a70d9b4599904109154daa283d594a3ca09d453287fd9dd9d061c18e85"} err="failed to get container status \"860322a70d9b4599904109154daa283d594a3ca09d453287fd9dd9d061c18e85\": rpc error: code = NotFound desc = could not find container \"860322a70d9b4599904109154daa283d594a3ca09d453287fd9dd9d061c18e85\": container with ID starting with 860322a70d9b4599904109154daa283d594a3ca09d453287fd9dd9d061c18e85 not found: ID does not exist" Jul 06 20:39:21.878095 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878047 2577 scope.go:117] "RemoveContainer" containerID="3747dd2cc2bdca9e412fd92ca90a587f75cddd1054b4216221271761c31be6e2" Jul 06 20:39:21.878139 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878095 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:39:21.878290 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878268 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3747dd2cc2bdca9e412fd92ca90a587f75cddd1054b4216221271761c31be6e2"} err="failed to get container status \"3747dd2cc2bdca9e412fd92ca90a587f75cddd1054b4216221271761c31be6e2\": rpc error: code = NotFound desc = could not find container \"3747dd2cc2bdca9e412fd92ca90a587f75cddd1054b4216221271761c31be6e2\": container with ID starting with 3747dd2cc2bdca9e412fd92ca90a587f75cddd1054b4216221271761c31be6e2 not found: ID does not exist" Jul 06 20:39:21.878290 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878290 2577 scope.go:117] "RemoveContainer" containerID="e791c87e0ca39617b18143686243287f2b94e05cd1517b286b9d94a97dcba474" Jul 06 20:39:21.878450 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878441 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c70c905-3817-4986-b2ff-2a579e0eb51b" containerName="console" Jul 06 20:39:21.878490 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878454 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c70c905-3817-4986-b2ff-2a579e0eb51b" containerName="console" Jul 06 20:39:21.878490 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878463 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="kube-rbac-proxy-web" Jul 06 20:39:21.878490 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878488 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="kube-rbac-proxy-web" Jul 06 20:39:21.878588 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878500 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="alertmanager" Jul 06 20:39:21.878588 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878508 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="alertmanager" Jul 06 20:39:21.878588 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878527 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="config-reloader" Jul 06 20:39:21.878588 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878526 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e791c87e0ca39617b18143686243287f2b94e05cd1517b286b9d94a97dcba474"} err="failed to get container status \"e791c87e0ca39617b18143686243287f2b94e05cd1517b286b9d94a97dcba474\": rpc error: code = NotFound desc = could not find container \"e791c87e0ca39617b18143686243287f2b94e05cd1517b286b9d94a97dcba474\": container with ID starting with e791c87e0ca39617b18143686243287f2b94e05cd1517b286b9d94a97dcba474 not found: ID does not exist" Jul 06 20:39:21.878588 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878549 2577 scope.go:117] "RemoveContainer" containerID="3b765f74fe564fab60941d3f45ebfff3b29d6b964daadea89b07641ac0eeed98" Jul 06 20:39:21.878588 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878534 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="config-reloader" Jul 06 20:39:21.878844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878604 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="init-config-reloader" Jul 06 20:39:21.878844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878615 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="init-config-reloader" Jul 06 20:39:21.878844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878628 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="prom-label-proxy" Jul 06 20:39:21.878844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878637 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="prom-label-proxy" Jul 06 20:39:21.878844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878652 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="kube-rbac-proxy" Jul 06 20:39:21.878844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878662 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="kube-rbac-proxy" Jul 06 20:39:21.878844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878672 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="kube-rbac-proxy-metric" Jul 06 20:39:21.878844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878678 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="kube-rbac-proxy-metric" Jul 06 20:39:21.878844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878781 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="alertmanager" Jul 06 20:39:21.878844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878791 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="kube-rbac-proxy-metric" Jul 06 20:39:21.878844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878798 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="config-reloader" Jul 06 20:39:21.878844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878804 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="kube-rbac-proxy-web" Jul 06 20:39:21.878844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878812 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="kube-rbac-proxy" Jul 06 20:39:21.878844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878822 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c70c905-3817-4986-b2ff-2a579e0eb51b" containerName="console" Jul 06 20:39:21.878844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878832 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" containerName="prom-label-proxy" Jul 06 20:39:21.878844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878832 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b765f74fe564fab60941d3f45ebfff3b29d6b964daadea89b07641ac0eeed98"} err="failed to get container status \"3b765f74fe564fab60941d3f45ebfff3b29d6b964daadea89b07641ac0eeed98\": rpc error: code = NotFound desc = could not find container \"3b765f74fe564fab60941d3f45ebfff3b29d6b964daadea89b07641ac0eeed98\": container with ID starting with 3b765f74fe564fab60941d3f45ebfff3b29d6b964daadea89b07641ac0eeed98 not found: ID does not exist" Jul 06 20:39:21.878844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.878849 2577 scope.go:117] "RemoveContainer" containerID="d081b07df51f8783dd4dd96d60a371e5661d4919fdc8dcd2161cd6dcb15b267e" Jul 06 20:39:21.879380 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.879095 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d081b07df51f8783dd4dd96d60a371e5661d4919fdc8dcd2161cd6dcb15b267e"} err="failed to get container status \"d081b07df51f8783dd4dd96d60a371e5661d4919fdc8dcd2161cd6dcb15b267e\": rpc error: code = NotFound desc = could not find container \"d081b07df51f8783dd4dd96d60a371e5661d4919fdc8dcd2161cd6dcb15b267e\": container with ID starting with d081b07df51f8783dd4dd96d60a371e5661d4919fdc8dcd2161cd6dcb15b267e not found: ID does not exist" Jul 06 20:39:21.882746 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.882731 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:21.885644 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.885622 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 20:39:21.885737 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.885651 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 20:39:21.885737 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.885695 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 20:39:21.885945 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.885931 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 20:39:21.886014 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.885948 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-w6wfd\"" Jul 06 20:39:21.886014 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.885934 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 20:39:21.886173 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.886157 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 20:39:21.886173 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.886167 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 20:39:21.886279 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.886195 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 20:39:21.891513 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.891496 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 20:39:21.899524 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.899503 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:39:21.965090 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.965055 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a63c887-c164-4b8d-95c0-4e96093c0bfb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:21.965090 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.965089 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7a63c887-c164-4b8d-95c0-4e96093c0bfb-config-out\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:21.965317 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.965129 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7a63c887-c164-4b8d-95c0-4e96093c0bfb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:21.965317 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.965146 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7a63c887-c164-4b8d-95c0-4e96093c0bfb-config-volume\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:21.965317 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.965171 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7a63c887-c164-4b8d-95c0-4e96093c0bfb-web-config\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:21.965317 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.965196 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7a63c887-c164-4b8d-95c0-4e96093c0bfb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:21.965317 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.965269 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a63c887-c164-4b8d-95c0-4e96093c0bfb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:21.965317 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.965304 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a63c887-c164-4b8d-95c0-4e96093c0bfb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:21.965590 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.965372 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hh95\" (UniqueName: \"kubernetes.io/projected/7a63c887-c164-4b8d-95c0-4e96093c0bfb-kube-api-access-2hh95\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:21.965590 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.965402 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7a63c887-c164-4b8d-95c0-4e96093c0bfb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:21.965590 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.965428 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a63c887-c164-4b8d-95c0-4e96093c0bfb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:21.965590 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.965461 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7a63c887-c164-4b8d-95c0-4e96093c0bfb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:21.965590 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:21.965492 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7a63c887-c164-4b8d-95c0-4e96093c0bfb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.066275 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.066238 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7a63c887-c164-4b8d-95c0-4e96093c0bfb-web-config\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.066451 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.066292 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7a63c887-c164-4b8d-95c0-4e96093c0bfb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.066451 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.066322 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a63c887-c164-4b8d-95c0-4e96093c0bfb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.066451 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.066344 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a63c887-c164-4b8d-95c0-4e96093c0bfb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.066451 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.066371 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hh95\" (UniqueName: \"kubernetes.io/projected/7a63c887-c164-4b8d-95c0-4e96093c0bfb-kube-api-access-2hh95\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.066451 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.066397 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7a63c887-c164-4b8d-95c0-4e96093c0bfb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.066451 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.066420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a63c887-c164-4b8d-95c0-4e96093c0bfb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.066451 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.066447 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7a63c887-c164-4b8d-95c0-4e96093c0bfb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.066826 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.066480 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7a63c887-c164-4b8d-95c0-4e96093c0bfb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.066826 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.066526 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a63c887-c164-4b8d-95c0-4e96093c0bfb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.066826 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.066556 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7a63c887-c164-4b8d-95c0-4e96093c0bfb-config-out\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.066826 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.066619 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7a63c887-c164-4b8d-95c0-4e96093c0bfb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.066826 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.066651 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7a63c887-c164-4b8d-95c0-4e96093c0bfb-config-volume\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.067081 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.066895 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7a63c887-c164-4b8d-95c0-4e96093c0bfb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.067959 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.067579 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a63c887-c164-4b8d-95c0-4e96093c0bfb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.067959 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.067944 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a63c887-c164-4b8d-95c0-4e96093c0bfb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.069717 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.069687 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7a63c887-c164-4b8d-95c0-4e96093c0bfb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.069842 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.069704 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7a63c887-c164-4b8d-95c0-4e96093c0bfb-web-config\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.069842 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.069785 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7a63c887-c164-4b8d-95c0-4e96093c0bfb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.069842 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.069807 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a63c887-c164-4b8d-95c0-4e96093c0bfb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.069842 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.069839 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7a63c887-c164-4b8d-95c0-4e96093c0bfb-config-volume\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.070063 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.070003 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7a63c887-c164-4b8d-95c0-4e96093c0bfb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.070259 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.070240 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7a63c887-c164-4b8d-95c0-4e96093c0bfb-config-out\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.070653 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.070630 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a63c887-c164-4b8d-95c0-4e96093c0bfb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.071701 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.071683 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7a63c887-c164-4b8d-95c0-4e96093c0bfb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.075218 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.075165 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hh95\" (UniqueName: \"kubernetes.io/projected/7a63c887-c164-4b8d-95c0-4e96093c0bfb-kube-api-access-2hh95\") pod \"alertmanager-main-0\" (UID: \"7a63c887-c164-4b8d-95c0-4e96093c0bfb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.192392 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.192357 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:39:22.332348 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.332269 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:39:22.335039 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:39:22.335007 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a63c887_c164_4b8d_95c0_4e96093c0bfb.slice/crio-a8725fdd0790094e129977fb5d5e4283fdd8383edada71aad5e1e563e14b1396 WatchSource:0}: Error finding container a8725fdd0790094e129977fb5d5e4283fdd8383edada71aad5e1e563e14b1396: Status 404 returned error can't find the container with id a8725fdd0790094e129977fb5d5e4283fdd8383edada71aad5e1e563e14b1396 Jul 06 20:39:22.828976 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.828936 2577 generic.go:356] "Generic (PLEG): container finished" podID="7a63c887-c164-4b8d-95c0-4e96093c0bfb" containerID="64c95575e883907575ec21f3c9864929c134fdadf4ec69085b64b950ee758394" exitCode=0 Jul 06 20:39:22.829365 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.828996 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a63c887-c164-4b8d-95c0-4e96093c0bfb","Type":"ContainerDied","Data":"64c95575e883907575ec21f3c9864929c134fdadf4ec69085b64b950ee758394"} Jul 06 20:39:22.829365 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:22.829061 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a63c887-c164-4b8d-95c0-4e96093c0bfb","Type":"ContainerStarted","Data":"a8725fdd0790094e129977fb5d5e4283fdd8383edada71aad5e1e563e14b1396"} Jul 06 20:39:23.703261 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:23.703214 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4775ff1-696a-4f8c-8d1c-af67bb548c43" path="/var/lib/kubelet/pods/c4775ff1-696a-4f8c-8d1c-af67bb548c43/volumes" Jul 06 20:39:23.835892 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:23.835857 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a63c887-c164-4b8d-95c0-4e96093c0bfb","Type":"ContainerStarted","Data":"caf04c386bcc91a4da6ed635428bc2b2e70b0d685f791d3309003a66e5cbffe8"} Jul 06 20:39:23.836360 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:23.835929 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a63c887-c164-4b8d-95c0-4e96093c0bfb","Type":"ContainerStarted","Data":"06e23051dfecf17956d8801a5cd8a6420969c23d66ee6aabae46611f78d6f855"} Jul 06 20:39:23.836360 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:23.835970 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a63c887-c164-4b8d-95c0-4e96093c0bfb","Type":"ContainerStarted","Data":"7acf507c67adf3ccd02129e3dfa350dc0cf002e9454c1a5fbaac3a30f1dd10dd"} Jul 06 20:39:23.836360 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:23.836008 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a63c887-c164-4b8d-95c0-4e96093c0bfb","Type":"ContainerStarted","Data":"2f5e8e8921bbea2a0d0030b8b721f9cc51eaf2e93e5da670c4fae0f1cc7bc209"} Jul 06 20:39:23.836360 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:23.836052 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a63c887-c164-4b8d-95c0-4e96093c0bfb","Type":"ContainerStarted","Data":"327c48b4cd21a2d7a6ef3cc95e841fbd6a956df093b59e685f53c9b67087b208"} Jul 06 20:39:23.836360 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:23.836086 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a63c887-c164-4b8d-95c0-4e96093c0bfb","Type":"ContainerStarted","Data":"64ba312817da29a67f6d956268a9a1d760c147472f668a46ede2d60e3aad76d9"} Jul 06 20:39:23.863234 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:23.863178 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.846850053 podStartE2EDuration="2.863163196s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.313143ms" isStatefulPod=false podCreationTimestamp="2026-07-06 20:39:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:39:23.860648637 +0000 UTC m=+244.679794249" watchObservedRunningTime="2026-07-06 20:39:23.863163196 +0000 UTC m=+244.682308804" Jul 06 20:39:24.234728 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.234694 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-d67c85646-t6sf8"] Jul 06 20:39:24.237713 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.237690 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.240578 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.240542 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 20:39:24.240700 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.240660 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 20:39:24.240700 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.240686 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hc2tb\"" Jul 06 20:39:24.240855 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.240704 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 20:39:24.241073 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.241046 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 20:39:24.241163 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.241102 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 20:39:24.245407 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.245387 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 20:39:24.250724 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.250703 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d67c85646-t6sf8"] Jul 06 20:39:24.288887 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.288853 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-secret-telemeter-client\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.289023 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.288894 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-serving-certs-ca-bundle\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.289023 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.288918 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4584p\" (UniqueName: \"kubernetes.io/projected/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-kube-api-access-4584p\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.289023 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.288985 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-federate-client-tls\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.289137 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.289029 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-telemeter-client-tls\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.289137 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.289080 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.289137 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.289110 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-metrics-client-ca\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.289137 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.289127 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.389924 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.389884 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-federate-client-tls\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.390095 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.389937 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-telemeter-client-tls\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.390095 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.389977 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.390095 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.390002 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-metrics-client-ca\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.390095 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.390025 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.390373 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.390100 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-secret-telemeter-client\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.390373 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.390130 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-serving-certs-ca-bundle\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.390373 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.390159 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4584p\" (UniqueName: \"kubernetes.io/projected/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-kube-api-access-4584p\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.391085 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.391049 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-serving-certs-ca-bundle\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.391330 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.391306 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-metrics-client-ca\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.391573 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.391551 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.392697 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.392659 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-federate-client-tls\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.392830 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.392798 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.392830 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.392818 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-telemeter-client-tls\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.392924 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.392890 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-secret-telemeter-client\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.398671 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.398643 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4584p\" (UniqueName: \"kubernetes.io/projected/582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d-kube-api-access-4584p\") pod \"telemeter-client-d67c85646-t6sf8\" (UID: \"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d\") " pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.547978 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.547898 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" Jul 06 20:39:24.682141 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.682049 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d67c85646-t6sf8"] Jul 06 20:39:24.684641 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:39:24.684614 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod582ffe32_b6ea_4aa0_9b55_c0e9ab24df6d.slice/crio-ded21d10c552ee33f57e7218e4a2b33f84fa51bcb5bf949b3cb4f4b930c86f5a WatchSource:0}: Error finding container ded21d10c552ee33f57e7218e4a2b33f84fa51bcb5bf949b3cb4f4b930c86f5a: Status 404 returned error can't find the container with id ded21d10c552ee33f57e7218e4a2b33f84fa51bcb5bf949b3cb4f4b930c86f5a Jul 06 20:39:24.842146 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:24.842100 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" event={"ID":"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d","Type":"ContainerStarted","Data":"ded21d10c552ee33f57e7218e4a2b33f84fa51bcb5bf949b3cb4f4b930c86f5a"} Jul 06 20:39:27.859699 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:27.859664 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" event={"ID":"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d","Type":"ContainerStarted","Data":"2d1e8898470ec744da43557fa07b843a8d75aee8e352ddc471a51928101c384c"} Jul 06 20:39:27.860095 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:27.859716 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" event={"ID":"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d","Type":"ContainerStarted","Data":"ba1520aefd659efc64d8ece85361d5aa68b5b77b2fc827a545637f05e2af36d4"} Jul 06 20:39:27.860095 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:27.859735 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" event={"ID":"582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d","Type":"ContainerStarted","Data":"98e4ac9ad0ea3515e96fb6d5dc128a2176e6c895189262f8a5766fa13fa07c45"} Jul 06 20:39:27.884718 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:27.884668 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-d67c85646-t6sf8" podStartSLOduration=1.593831819 podStartE2EDuration="3.884648345s" totalImagesPullingTime="2.290816526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:39:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:39:27.882272654 +0000 UTC m=+248.701418262" watchObservedRunningTime="2026-07-06 20:39:27.884648345 +0000 UTC m=+248.703794003" Jul 06 20:39:28.610509 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.610356 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7ddb6fc47f-dkzwx"] Jul 06 20:39:28.613267 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.613236 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:28.624261 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.624234 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ddb6fc47f-dkzwx"] Jul 06 20:39:28.666257 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.666218 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:39:28.730581 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.730538 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92d0e803-5f68-435e-853e-e0b67ec8f7f0-console-serving-cert\") pod \"console-7ddb6fc47f-dkzwx\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:28.730794 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.730590 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-oauth-serving-cert\") pod \"console-7ddb6fc47f-dkzwx\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:28.730794 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.730628 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92d0e803-5f68-435e-853e-e0b67ec8f7f0-console-oauth-config\") pod \"console-7ddb6fc47f-dkzwx\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:28.730794 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.730661 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-service-ca\") pod \"console-7ddb6fc47f-dkzwx\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:28.730794 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.730694 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-trusted-ca-bundle\") pod \"console-7ddb6fc47f-dkzwx\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:28.730794 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.730730 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-console-config\") pod \"console-7ddb6fc47f-dkzwx\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:28.731012 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.730845 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vd6c\" (UniqueName: \"kubernetes.io/projected/92d0e803-5f68-435e-853e-e0b67ec8f7f0-kube-api-access-4vd6c\") pod \"console-7ddb6fc47f-dkzwx\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:28.733750 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.733725 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:39:28.831787 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.831730 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-console-config\") pod \"console-7ddb6fc47f-dkzwx\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:28.831976 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.831814 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vd6c\" (UniqueName: \"kubernetes.io/projected/92d0e803-5f68-435e-853e-e0b67ec8f7f0-kube-api-access-4vd6c\") pod \"console-7ddb6fc47f-dkzwx\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:28.831976 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.831858 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92d0e803-5f68-435e-853e-e0b67ec8f7f0-console-serving-cert\") pod \"console-7ddb6fc47f-dkzwx\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:28.831976 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.831889 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-oauth-serving-cert\") pod \"console-7ddb6fc47f-dkzwx\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:28.831976 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.831921 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92d0e803-5f68-435e-853e-e0b67ec8f7f0-console-oauth-config\") pod \"console-7ddb6fc47f-dkzwx\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:28.831976 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.831954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-service-ca\") pod \"console-7ddb6fc47f-dkzwx\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:28.832215 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.831985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-trusted-ca-bundle\") pod \"console-7ddb6fc47f-dkzwx\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:28.832604 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.832576 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-console-config\") pod \"console-7ddb6fc47f-dkzwx\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:28.832710 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.832629 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-oauth-serving-cert\") pod \"console-7ddb6fc47f-dkzwx\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:28.832781 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.832740 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-service-ca\") pod \"console-7ddb6fc47f-dkzwx\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:28.832885 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.832865 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-trusted-ca-bundle\") pod \"console-7ddb6fc47f-dkzwx\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:28.834403 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.834371 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92d0e803-5f68-435e-853e-e0b67ec8f7f0-console-oauth-config\") pod \"console-7ddb6fc47f-dkzwx\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:28.834561 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.834542 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92d0e803-5f68-435e-853e-e0b67ec8f7f0-console-serving-cert\") pod \"console-7ddb6fc47f-dkzwx\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:28.840296 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.840266 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vd6c\" (UniqueName: \"kubernetes.io/projected/92d0e803-5f68-435e-853e-e0b67ec8f7f0-kube-api-access-4vd6c\") pod \"console-7ddb6fc47f-dkzwx\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:28.923835 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:28.923718 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:29.077372 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:29.077348 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ddb6fc47f-dkzwx"] Jul 06 20:39:29.080230 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:39:29.080202 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d0e803_5f68_435e_853e_e0b67ec8f7f0.slice/crio-eb66e47bd0844a1cb247517f5f6732526cee5d80ec69a9ef8e9a3c849dd503ce WatchSource:0}: Error finding container eb66e47bd0844a1cb247517f5f6732526cee5d80ec69a9ef8e9a3c849dd503ce: Status 404 returned error can't find the container with id eb66e47bd0844a1cb247517f5f6732526cee5d80ec69a9ef8e9a3c849dd503ce Jul 06 20:39:29.871844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:29.871804 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ddb6fc47f-dkzwx" event={"ID":"92d0e803-5f68-435e-853e-e0b67ec8f7f0","Type":"ContainerStarted","Data":"e1f25a1814e42b5f9a83274bfdd3221ea753bcb9c6919d829e532a79eb07457e"} Jul 06 20:39:29.872058 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:29.871867 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ddb6fc47f-dkzwx" event={"ID":"92d0e803-5f68-435e-853e-e0b67ec8f7f0","Type":"ContainerStarted","Data":"eb66e47bd0844a1cb247517f5f6732526cee5d80ec69a9ef8e9a3c849dd503ce"} Jul 06 20:39:29.889186 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:29.889126 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7ddb6fc47f-dkzwx" podStartSLOduration=1.889108934 podStartE2EDuration="1.889108934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:39:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:39:29.888875401 +0000 UTC m=+250.708021010" watchObservedRunningTime="2026-07-06 20:39:29.889108934 +0000 UTC m=+250.708254542" Jul 06 20:39:31.459335 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:31.459295 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs\") pod \"network-metrics-daemon-sw6qp\" (UID: \"e3eec97f-a1ba-4160-ab43-ce2fda50659b\") " pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:39:31.461700 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:31.461674 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3eec97f-a1ba-4160-ab43-ce2fda50659b-metrics-certs\") pod \"network-metrics-daemon-sw6qp\" (UID: \"e3eec97f-a1ba-4160-ab43-ce2fda50659b\") " pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:39:31.700423 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:31.700395 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hq9zz\"" Jul 06 20:39:31.707725 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:31.707708 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sw6qp" Jul 06 20:39:31.833788 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:31.833736 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sw6qp"] Jul 06 20:39:31.836857 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:39:31.836831 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3eec97f_a1ba_4160_ab43_ce2fda50659b.slice/crio-c1cb00b1ea57cc1dabada05dcbf5119b237a1ab94d356b19b4a383459e3f30fd WatchSource:0}: Error finding container c1cb00b1ea57cc1dabada05dcbf5119b237a1ab94d356b19b4a383459e3f30fd: Status 404 returned error can't find the container with id c1cb00b1ea57cc1dabada05dcbf5119b237a1ab94d356b19b4a383459e3f30fd Jul 06 20:39:31.881170 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:31.881137 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sw6qp" event={"ID":"e3eec97f-a1ba-4160-ab43-ce2fda50659b","Type":"ContainerStarted","Data":"c1cb00b1ea57cc1dabada05dcbf5119b237a1ab94d356b19b4a383459e3f30fd"} Jul 06 20:39:33.894781 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:33.894722 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sw6qp" event={"ID":"e3eec97f-a1ba-4160-ab43-ce2fda50659b","Type":"ContainerStarted","Data":"07f69245721fd6a68a6a8b620e146b91126d702fa6a29d454eec88e975bd5a77"} Jul 06 20:39:33.895177 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:33.894805 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sw6qp" event={"ID":"e3eec97f-a1ba-4160-ab43-ce2fda50659b","Type":"ContainerStarted","Data":"6c565ef99f6189be089ffe4b9f8fee3c3fd010d54e9fb50ab19fdbd28229bfcd"} Jul 06 20:39:33.912086 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:33.912040 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sw6qp" podStartSLOduration=252.730644933 podStartE2EDuration="4m13.91202291s" totalImagesPullingTime="1.181377977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:39:33.911451744 +0000 UTC m=+254.730597352" watchObservedRunningTime="2026-07-06 20:39:33.91202291 +0000 UTC m=+254.731168517" Jul 06 20:39:34.010052 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:34.010021 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:39:34.087225 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:34.087195 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:39:38.924635 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:38.924604 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:38.925183 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:38.924907 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:38.929581 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:38.929549 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:39.923467 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:39.923384 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:39:39.981486 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:39.981454 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69cdbfcbbd-88xdw"] Jul 06 20:39:40.095537 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:40.095506 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:39:40.195562 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:40.195454 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:39:40.265104 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:39:40.265073 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:40:05.006208 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.006160 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-69cdbfcbbd-88xdw" podUID="687ec9b0-e063-4cf8-ad29-a13a6803a499" containerName="console" containerID="cri-o://c0d5c31500de10cef60d5ceac0ad040f0a93128e44a6f0ec823bc93ecbce14da" gracePeriod=15 Jul 06 20:40:05.255700 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.255663 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:40:05.367934 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.367891 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/687ec9b0-e063-4cf8-ad29-a13a6803a499-console-serving-cert\") pod \"687ec9b0-e063-4cf8-ad29-a13a6803a499\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " Jul 06 20:40:05.368137 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.367972 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njg9t\" (UniqueName: \"kubernetes.io/projected/687ec9b0-e063-4cf8-ad29-a13a6803a499-kube-api-access-njg9t\") pod \"687ec9b0-e063-4cf8-ad29-a13a6803a499\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " Jul 06 20:40:05.368137 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.367994 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-console-config\") pod \"687ec9b0-e063-4cf8-ad29-a13a6803a499\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " Jul 06 20:40:05.368137 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.368105 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-oauth-serving-cert\") pod \"687ec9b0-e063-4cf8-ad29-a13a6803a499\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " Jul 06 20:40:05.368307 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.368189 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-trusted-ca-bundle\") pod \"687ec9b0-e063-4cf8-ad29-a13a6803a499\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " Jul 06 20:40:05.368307 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.368218 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/687ec9b0-e063-4cf8-ad29-a13a6803a499-console-oauth-config\") pod \"687ec9b0-e063-4cf8-ad29-a13a6803a499\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " Jul 06 20:40:05.368307 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.368265 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-service-ca\") pod \"687ec9b0-e063-4cf8-ad29-a13a6803a499\" (UID: \"687ec9b0-e063-4cf8-ad29-a13a6803a499\") " Jul 06 20:40:05.368482 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.368456 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-console-config" (OuterVolumeSpecName: "console-config") pod "687ec9b0-e063-4cf8-ad29-a13a6803a499" (UID: "687ec9b0-e063-4cf8-ad29-a13a6803a499"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:40:05.368590 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.368564 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "687ec9b0-e063-4cf8-ad29-a13a6803a499" (UID: "687ec9b0-e063-4cf8-ad29-a13a6803a499"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:40:05.368643 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.368587 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "687ec9b0-e063-4cf8-ad29-a13a6803a499" (UID: "687ec9b0-e063-4cf8-ad29-a13a6803a499"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:40:05.368687 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.368577 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-console-config\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:40:05.368997 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.368969 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-service-ca" (OuterVolumeSpecName: "service-ca") pod "687ec9b0-e063-4cf8-ad29-a13a6803a499" (UID: "687ec9b0-e063-4cf8-ad29-a13a6803a499"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:40:05.370355 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.370328 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/687ec9b0-e063-4cf8-ad29-a13a6803a499-kube-api-access-njg9t" (OuterVolumeSpecName: "kube-api-access-njg9t") pod "687ec9b0-e063-4cf8-ad29-a13a6803a499" (UID: "687ec9b0-e063-4cf8-ad29-a13a6803a499"). InnerVolumeSpecName "kube-api-access-njg9t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:40:05.370637 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.370413 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/687ec9b0-e063-4cf8-ad29-a13a6803a499-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "687ec9b0-e063-4cf8-ad29-a13a6803a499" (UID: "687ec9b0-e063-4cf8-ad29-a13a6803a499"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:40:05.370701 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.370635 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/687ec9b0-e063-4cf8-ad29-a13a6803a499-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "687ec9b0-e063-4cf8-ad29-a13a6803a499" (UID: "687ec9b0-e063-4cf8-ad29-a13a6803a499"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:40:05.469877 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.469835 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njg9t\" (UniqueName: \"kubernetes.io/projected/687ec9b0-e063-4cf8-ad29-a13a6803a499-kube-api-access-njg9t\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:40:05.469877 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.469868 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-oauth-serving-cert\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:40:05.469877 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.469877 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-trusted-ca-bundle\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:40:05.469877 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.469886 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/687ec9b0-e063-4cf8-ad29-a13a6803a499-console-oauth-config\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:40:05.469877 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.469895 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/687ec9b0-e063-4cf8-ad29-a13a6803a499-service-ca\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:40:05.470169 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:05.469905 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/687ec9b0-e063-4cf8-ad29-a13a6803a499-console-serving-cert\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:40:06.023518 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:06.023414 2577 generic.go:356] "Generic (PLEG): container finished" podID="687ec9b0-e063-4cf8-ad29-a13a6803a499" containerID="c0d5c31500de10cef60d5ceac0ad040f0a93128e44a6f0ec823bc93ecbce14da" exitCode=0 Jul 06 20:40:06.023518 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:06.023471 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69cdbfcbbd-88xdw" Jul 06 20:40:06.023518 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:06.023495 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69cdbfcbbd-88xdw" event={"ID":"687ec9b0-e063-4cf8-ad29-a13a6803a499","Type":"ContainerDied","Data":"c0d5c31500de10cef60d5ceac0ad040f0a93128e44a6f0ec823bc93ecbce14da"} Jul 06 20:40:06.024044 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:06.023552 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69cdbfcbbd-88xdw" event={"ID":"687ec9b0-e063-4cf8-ad29-a13a6803a499","Type":"ContainerDied","Data":"f6d61b7496cfa7f73c85ca17ef077cdc92ed66dfc10c964867e9ddb268b94bff"} Jul 06 20:40:06.024044 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:06.023573 2577 scope.go:117] "RemoveContainer" containerID="c0d5c31500de10cef60d5ceac0ad040f0a93128e44a6f0ec823bc93ecbce14da" Jul 06 20:40:06.031843 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:06.031822 2577 scope.go:117] "RemoveContainer" containerID="c0d5c31500de10cef60d5ceac0ad040f0a93128e44a6f0ec823bc93ecbce14da" Jul 06 20:40:06.032128 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:40:06.032106 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0d5c31500de10cef60d5ceac0ad040f0a93128e44a6f0ec823bc93ecbce14da\": container with ID starting with c0d5c31500de10cef60d5ceac0ad040f0a93128e44a6f0ec823bc93ecbce14da not found: ID does not exist" containerID="c0d5c31500de10cef60d5ceac0ad040f0a93128e44a6f0ec823bc93ecbce14da" Jul 06 20:40:06.032173 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:06.032138 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0d5c31500de10cef60d5ceac0ad040f0a93128e44a6f0ec823bc93ecbce14da"} err="failed to get container status \"c0d5c31500de10cef60d5ceac0ad040f0a93128e44a6f0ec823bc93ecbce14da\": rpc error: code = NotFound desc = could not find container \"c0d5c31500de10cef60d5ceac0ad040f0a93128e44a6f0ec823bc93ecbce14da\": container with ID starting with c0d5c31500de10cef60d5ceac0ad040f0a93128e44a6f0ec823bc93ecbce14da not found: ID does not exist" Jul 06 20:40:06.038953 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:06.038930 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69cdbfcbbd-88xdw"] Jul 06 20:40:06.041928 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:06.041907 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69cdbfcbbd-88xdw"] Jul 06 20:40:07.702305 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:07.702275 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="687ec9b0-e063-4cf8-ad29-a13a6803a499" path="/var/lib/kubelet/pods/687ec9b0-e063-4cf8-ad29-a13a6803a499/volumes" Jul 06 20:40:19.576464 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:19.576434 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-m8w66_7a829421-0363-40d1-941c-78b3f80a4f95/console-operator/2.log" Jul 06 20:40:19.582972 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:19.582944 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-m8w66_7a829421-0363-40d1-941c-78b3f80a4f95/console-operator/2.log" Jul 06 20:40:19.586039 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:19.586013 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/ovn-acl-logging/0.log" Jul 06 20:40:19.589877 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:19.589852 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 20:40:19.593152 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:19.593128 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/ovn-acl-logging/0.log" Jul 06 20:40:21.313715 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:21.313683 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:40:34.387920 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:34.387889 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:40:34.459302 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:34.459258 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:40:46.382650 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:46.382617 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:40:46.456808 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:46.456750 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:40:51.215230 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:51.215194 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:40:51.316659 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:51.316621 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:40:57.556996 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.556959 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5446c67d9-vvpj9"] Jul 06 20:40:57.557470 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.557413 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="687ec9b0-e063-4cf8-ad29-a13a6803a499" containerName="console" Jul 06 20:40:57.557470 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.557433 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="687ec9b0-e063-4cf8-ad29-a13a6803a499" containerName="console" Jul 06 20:40:57.557604 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.557507 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="687ec9b0-e063-4cf8-ad29-a13a6803a499" containerName="console" Jul 06 20:40:57.560735 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.560715 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:57.571083 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.571061 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5446c67d9-vvpj9"] Jul 06 20:40:57.612168 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.612138 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-console-config\") pod \"console-5446c67d9-vvpj9\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:57.612342 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.612186 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b55xm\" (UniqueName: \"kubernetes.io/projected/c483db77-0f95-401d-8c30-0ff633ccd1a8-kube-api-access-b55xm\") pod \"console-5446c67d9-vvpj9\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:57.612342 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.612225 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-oauth-serving-cert\") pod \"console-5446c67d9-vvpj9\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:57.612342 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.612257 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c483db77-0f95-401d-8c30-0ff633ccd1a8-console-oauth-config\") pod \"console-5446c67d9-vvpj9\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:57.612342 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.612275 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-trusted-ca-bundle\") pod \"console-5446c67d9-vvpj9\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:57.612342 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.612301 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-service-ca\") pod \"console-5446c67d9-vvpj9\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:57.612342 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.612321 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c483db77-0f95-401d-8c30-0ff633ccd1a8-console-serving-cert\") pod \"console-5446c67d9-vvpj9\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:57.616695 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.616651 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:40:57.713452 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.713422 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-console-config\") pod \"console-5446c67d9-vvpj9\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:57.713630 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.713460 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b55xm\" (UniqueName: \"kubernetes.io/projected/c483db77-0f95-401d-8c30-0ff633ccd1a8-kube-api-access-b55xm\") pod \"console-5446c67d9-vvpj9\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:57.713630 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.713481 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-oauth-serving-cert\") pod \"console-5446c67d9-vvpj9\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:57.713630 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.713615 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c483db77-0f95-401d-8c30-0ff633ccd1a8-console-oauth-config\") pod \"console-5446c67d9-vvpj9\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:57.713844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.713644 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-trusted-ca-bundle\") pod \"console-5446c67d9-vvpj9\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:57.713844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.713673 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-service-ca\") pod \"console-5446c67d9-vvpj9\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:57.713844 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.713702 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c483db77-0f95-401d-8c30-0ff633ccd1a8-console-serving-cert\") pod \"console-5446c67d9-vvpj9\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:57.714245 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.714221 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-console-config\") pod \"console-5446c67d9-vvpj9\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:57.714381 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.714318 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-oauth-serving-cert\") pod \"console-5446c67d9-vvpj9\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:57.714617 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.714409 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-service-ca\") pod \"console-5446c67d9-vvpj9\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:57.714617 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.714457 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-trusted-ca-bundle\") pod \"console-5446c67d9-vvpj9\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:57.716345 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.716321 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c483db77-0f95-401d-8c30-0ff633ccd1a8-console-serving-cert\") pod \"console-5446c67d9-vvpj9\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:57.716433 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.716371 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c483db77-0f95-401d-8c30-0ff633ccd1a8-console-oauth-config\") pod \"console-5446c67d9-vvpj9\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:57.722327 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.722296 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b55xm\" (UniqueName: \"kubernetes.io/projected/c483db77-0f95-401d-8c30-0ff633ccd1a8-kube-api-access-b55xm\") pod \"console-5446c67d9-vvpj9\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:57.873032 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:57.872953 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:40:58.004542 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:58.004514 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5446c67d9-vvpj9"] Jul 06 20:40:58.007397 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:40:58.007356 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc483db77_0f95_401d_8c30_0ff633ccd1a8.slice/crio-9be1195e432fd824c7ba037557c6dfb88eea30e8e7e223c92ba6859282e42796 WatchSource:0}: Error finding container 9be1195e432fd824c7ba037557c6dfb88eea30e8e7e223c92ba6859282e42796: Status 404 returned error can't find the container with id 9be1195e432fd824c7ba037557c6dfb88eea30e8e7e223c92ba6859282e42796 Jul 06 20:40:58.229824 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:58.229705 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5446c67d9-vvpj9" event={"ID":"c483db77-0f95-401d-8c30-0ff633ccd1a8","Type":"ContainerStarted","Data":"f50862addc0133812466da5f09fc99c669ce43f083a7f6cc134d95095966ac1b"} Jul 06 20:40:58.229824 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:58.229751 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5446c67d9-vvpj9" event={"ID":"c483db77-0f95-401d-8c30-0ff633ccd1a8","Type":"ContainerStarted","Data":"9be1195e432fd824c7ba037557c6dfb88eea30e8e7e223c92ba6859282e42796"} Jul 06 20:40:58.248087 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:40:58.248042 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5446c67d9-vvpj9" podStartSLOduration=1.248028039 podStartE2EDuration="1.248028039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:40:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:40:58.247013435 +0000 UTC m=+339.066159043" watchObservedRunningTime="2026-07-06 20:40:58.248028039 +0000 UTC m=+339.067173646" Jul 06 20:41:02.417854 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:02.417821 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:41:07.873242 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:07.873199 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:41:07.873635 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:07.873263 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:41:07.878214 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:07.878193 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:41:08.274247 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:08.274168 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:41:08.319329 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:08.319298 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ddb6fc47f-dkzwx"] Jul 06 20:41:08.441471 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:08.441436 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:41:08.544049 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:08.543963 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:41:08.642435 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:08.642402 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:41:14.715718 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:14.715625 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:41:33.343821 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.343734 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7ddb6fc47f-dkzwx" podUID="92d0e803-5f68-435e-853e-e0b67ec8f7f0" containerName="console" containerID="cri-o://e1f25a1814e42b5f9a83274bfdd3221ea753bcb9c6919d829e532a79eb07457e" gracePeriod=15 Jul 06 20:41:33.580443 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.580421 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:41:33.629549 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.629457 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92d0e803-5f68-435e-853e-e0b67ec8f7f0-console-oauth-config\") pod \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " Jul 06 20:41:33.629549 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.629495 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-trusted-ca-bundle\") pod \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " Jul 06 20:41:33.629549 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.629517 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-oauth-serving-cert\") pod \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " Jul 06 20:41:33.629822 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.629561 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vd6c\" (UniqueName: \"kubernetes.io/projected/92d0e803-5f68-435e-853e-e0b67ec8f7f0-kube-api-access-4vd6c\") pod \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " Jul 06 20:41:33.629822 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.629594 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92d0e803-5f68-435e-853e-e0b67ec8f7f0-console-serving-cert\") pod \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " Jul 06 20:41:33.629822 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.629636 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-console-config\") pod \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " Jul 06 20:41:33.629822 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.629681 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-service-ca\") pod \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\" (UID: \"92d0e803-5f68-435e-853e-e0b67ec8f7f0\") " Jul 06 20:41:33.630034 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.629889 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "92d0e803-5f68-435e-853e-e0b67ec8f7f0" (UID: "92d0e803-5f68-435e-853e-e0b67ec8f7f0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:41:33.630034 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.629954 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-trusted-ca-bundle\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:41:33.630204 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.630176 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "92d0e803-5f68-435e-853e-e0b67ec8f7f0" (UID: "92d0e803-5f68-435e-853e-e0b67ec8f7f0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:41:33.630204 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.630188 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-console-config" (OuterVolumeSpecName: "console-config") pod "92d0e803-5f68-435e-853e-e0b67ec8f7f0" (UID: "92d0e803-5f68-435e-853e-e0b67ec8f7f0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:41:33.630335 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.630212 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-service-ca" (OuterVolumeSpecName: "service-ca") pod "92d0e803-5f68-435e-853e-e0b67ec8f7f0" (UID: "92d0e803-5f68-435e-853e-e0b67ec8f7f0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:41:33.631928 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.631898 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92d0e803-5f68-435e-853e-e0b67ec8f7f0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "92d0e803-5f68-435e-853e-e0b67ec8f7f0" (UID: "92d0e803-5f68-435e-853e-e0b67ec8f7f0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:41:33.631928 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.631919 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92d0e803-5f68-435e-853e-e0b67ec8f7f0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "92d0e803-5f68-435e-853e-e0b67ec8f7f0" (UID: "92d0e803-5f68-435e-853e-e0b67ec8f7f0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:41:33.632066 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.631991 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92d0e803-5f68-435e-853e-e0b67ec8f7f0-kube-api-access-4vd6c" (OuterVolumeSpecName: "kube-api-access-4vd6c") pod "92d0e803-5f68-435e-853e-e0b67ec8f7f0" (UID: "92d0e803-5f68-435e-853e-e0b67ec8f7f0"). InnerVolumeSpecName "kube-api-access-4vd6c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:41:33.731103 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.731075 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92d0e803-5f68-435e-853e-e0b67ec8f7f0-console-serving-cert\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:41:33.731103 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.731100 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-console-config\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:41:33.731103 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.731111 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-service-ca\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:41:33.731303 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.731121 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92d0e803-5f68-435e-853e-e0b67ec8f7f0-console-oauth-config\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:41:33.731303 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.731136 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92d0e803-5f68-435e-853e-e0b67ec8f7f0-oauth-serving-cert\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:41:33.731303 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:33.731145 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vd6c\" (UniqueName: \"kubernetes.io/projected/92d0e803-5f68-435e-853e-e0b67ec8f7f0-kube-api-access-4vd6c\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:41:34.373225 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:34.373189 2577 generic.go:356] "Generic (PLEG): container finished" podID="92d0e803-5f68-435e-853e-e0b67ec8f7f0" containerID="e1f25a1814e42b5f9a83274bfdd3221ea753bcb9c6919d829e532a79eb07457e" exitCode=0 Jul 06 20:41:34.373651 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:34.373260 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ddb6fc47f-dkzwx" Jul 06 20:41:34.373651 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:34.373269 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ddb6fc47f-dkzwx" event={"ID":"92d0e803-5f68-435e-853e-e0b67ec8f7f0","Type":"ContainerDied","Data":"e1f25a1814e42b5f9a83274bfdd3221ea753bcb9c6919d829e532a79eb07457e"} Jul 06 20:41:34.373651 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:34.373354 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ddb6fc47f-dkzwx" event={"ID":"92d0e803-5f68-435e-853e-e0b67ec8f7f0","Type":"ContainerDied","Data":"eb66e47bd0844a1cb247517f5f6732526cee5d80ec69a9ef8e9a3c849dd503ce"} Jul 06 20:41:34.373651 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:34.373380 2577 scope.go:117] "RemoveContainer" containerID="e1f25a1814e42b5f9a83274bfdd3221ea753bcb9c6919d829e532a79eb07457e" Jul 06 20:41:34.381593 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:34.381574 2577 scope.go:117] "RemoveContainer" containerID="e1f25a1814e42b5f9a83274bfdd3221ea753bcb9c6919d829e532a79eb07457e" Jul 06 20:41:34.381867 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:41:34.381838 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1f25a1814e42b5f9a83274bfdd3221ea753bcb9c6919d829e532a79eb07457e\": container with ID starting with e1f25a1814e42b5f9a83274bfdd3221ea753bcb9c6919d829e532a79eb07457e not found: ID does not exist" containerID="e1f25a1814e42b5f9a83274bfdd3221ea753bcb9c6919d829e532a79eb07457e" Jul 06 20:41:34.381944 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:34.381876 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1f25a1814e42b5f9a83274bfdd3221ea753bcb9c6919d829e532a79eb07457e"} err="failed to get container status \"e1f25a1814e42b5f9a83274bfdd3221ea753bcb9c6919d829e532a79eb07457e\": rpc error: code = NotFound desc = could not find container \"e1f25a1814e42b5f9a83274bfdd3221ea753bcb9c6919d829e532a79eb07457e\": container with ID starting with e1f25a1814e42b5f9a83274bfdd3221ea753bcb9c6919d829e532a79eb07457e not found: ID does not exist" Jul 06 20:41:34.389456 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:34.389433 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ddb6fc47f-dkzwx"] Jul 06 20:41:34.393028 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:34.393006 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7ddb6fc47f-dkzwx"] Jul 06 20:41:35.701983 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:41:35.701941 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92d0e803-5f68-435e-853e-e0b67ec8f7f0" path="/var/lib/kubelet/pods/92d0e803-5f68-435e-853e-e0b67ec8f7f0/volumes" Jul 06 20:42:35.878595 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:42:35.878557 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:42:37.010978 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:42:37.010936 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:43:03.997808 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:03.997755 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:43:04.093903 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:04.093871 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:43:10.207453 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.207406 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:43:10.467058 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.466971 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:43:10.473358 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.473327 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-jrfpd"] Jul 06 20:43:10.473854 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.473838 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92d0e803-5f68-435e-853e-e0b67ec8f7f0" containerName="console" Jul 06 20:43:10.473923 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.473856 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="92d0e803-5f68-435e-853e-e0b67ec8f7f0" containerName="console" Jul 06 20:43:10.473974 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.473963 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="92d0e803-5f68-435e-853e-e0b67ec8f7f0" containerName="console" Jul 06 20:43:10.476958 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.476937 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-jrfpd" Jul 06 20:43:10.479902 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.479883 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 06 20:43:10.480328 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.480309 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 06 20:43:10.480495 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.480356 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 06 20:43:10.480580 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.480361 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 06 20:43:10.480580 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.480365 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-875j6\"" Jul 06 20:43:10.480580 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.480371 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 06 20:43:10.487462 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.487440 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-jrfpd"] Jul 06 20:43:10.561001 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.560967 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-527ts\" (UniqueName: \"kubernetes.io/projected/4c9b4c6e-94b8-4836-be68-b1876e3959f3-kube-api-access-527ts\") pod \"keda-operator-68bff59c-jrfpd\" (UID: \"4c9b4c6e-94b8-4836-be68-b1876e3959f3\") " pod="openshift-keda/keda-operator-68bff59c-jrfpd" Jul 06 20:43:10.561001 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.561006 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4c9b4c6e-94b8-4836-be68-b1876e3959f3-certificates\") pod \"keda-operator-68bff59c-jrfpd\" (UID: \"4c9b4c6e-94b8-4836-be68-b1876e3959f3\") " pod="openshift-keda/keda-operator-68bff59c-jrfpd" Jul 06 20:43:10.561227 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.561026 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/4c9b4c6e-94b8-4836-be68-b1876e3959f3-cabundle0\") pod \"keda-operator-68bff59c-jrfpd\" (UID: \"4c9b4c6e-94b8-4836-be68-b1876e3959f3\") " pod="openshift-keda/keda-operator-68bff59c-jrfpd" Jul 06 20:43:10.662103 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.662071 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-527ts\" (UniqueName: \"kubernetes.io/projected/4c9b4c6e-94b8-4836-be68-b1876e3959f3-kube-api-access-527ts\") pod \"keda-operator-68bff59c-jrfpd\" (UID: \"4c9b4c6e-94b8-4836-be68-b1876e3959f3\") " pod="openshift-keda/keda-operator-68bff59c-jrfpd" Jul 06 20:43:10.662103 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.662117 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4c9b4c6e-94b8-4836-be68-b1876e3959f3-certificates\") pod \"keda-operator-68bff59c-jrfpd\" (UID: \"4c9b4c6e-94b8-4836-be68-b1876e3959f3\") " pod="openshift-keda/keda-operator-68bff59c-jrfpd" Jul 06 20:43:10.662342 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.662139 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/4c9b4c6e-94b8-4836-be68-b1876e3959f3-cabundle0\") pod \"keda-operator-68bff59c-jrfpd\" (UID: \"4c9b4c6e-94b8-4836-be68-b1876e3959f3\") " pod="openshift-keda/keda-operator-68bff59c-jrfpd" Jul 06 20:43:10.662342 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:43:10.662244 2577 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Jul 06 20:43:10.662342 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:43:10.662260 2577 secret.go:281] references non-existent secret key: ca.crt Jul 06 20:43:10.662342 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:43:10.662267 2577 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 06 20:43:10.662342 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:43:10.662278 2577 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-jrfpd: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 06 20:43:10.662342 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:43:10.662343 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c9b4c6e-94b8-4836-be68-b1876e3959f3-certificates podName:4c9b4c6e-94b8-4836-be68-b1876e3959f3 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:11.162324654 +0000 UTC m=+471.981470257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/4c9b4c6e-94b8-4836-be68-b1876e3959f3-certificates") pod "keda-operator-68bff59c-jrfpd" (UID: "4c9b4c6e-94b8-4836-be68-b1876e3959f3") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 06 20:43:10.662919 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.662894 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/4c9b4c6e-94b8-4836-be68-b1876e3959f3-cabundle0\") pod \"keda-operator-68bff59c-jrfpd\" (UID: \"4c9b4c6e-94b8-4836-be68-b1876e3959f3\") " pod="openshift-keda/keda-operator-68bff59c-jrfpd" Jul 06 20:43:10.665611 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.665571 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:43:10.674825 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:10.674796 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-527ts\" (UniqueName: \"kubernetes.io/projected/4c9b4c6e-94b8-4836-be68-b1876e3959f3-kube-api-access-527ts\") pod \"keda-operator-68bff59c-jrfpd\" (UID: \"4c9b4c6e-94b8-4836-be68-b1876e3959f3\") " pod="openshift-keda/keda-operator-68bff59c-jrfpd" Jul 06 20:43:11.035671 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.035633 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:43:11.147895 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.147861 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:43:11.167129 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.167096 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4c9b4c6e-94b8-4836-be68-b1876e3959f3-certificates\") pod \"keda-operator-68bff59c-jrfpd\" (UID: \"4c9b4c6e-94b8-4836-be68-b1876e3959f3\") " pod="openshift-keda/keda-operator-68bff59c-jrfpd" Jul 06 20:43:11.169625 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.169603 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4c9b4c6e-94b8-4836-be68-b1876e3959f3-certificates\") pod \"keda-operator-68bff59c-jrfpd\" (UID: \"4c9b4c6e-94b8-4836-be68-b1876e3959f3\") " pod="openshift-keda/keda-operator-68bff59c-jrfpd" Jul 06 20:43:11.248486 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.248449 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-w8f6k"] Jul 06 20:43:11.249204 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.249170 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:43:11.252014 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.251994 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-w8f6k" Jul 06 20:43:11.254642 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.254624 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 06 20:43:11.261349 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.261326 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-w8f6k"] Jul 06 20:43:11.326103 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.326062 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:43:11.369376 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.369337 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/858c85f4-260d-4c3c-9a68-a6065d6ebc70-certificates\") pod \"keda-admission-5fbd5c4644-w8f6k\" (UID: \"858c85f4-260d-4c3c-9a68-a6065d6ebc70\") " pod="openshift-keda/keda-admission-5fbd5c4644-w8f6k" Jul 06 20:43:11.369574 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.369392 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4xcv\" (UniqueName: \"kubernetes.io/projected/858c85f4-260d-4c3c-9a68-a6065d6ebc70-kube-api-access-j4xcv\") pod \"keda-admission-5fbd5c4644-w8f6k\" (UID: \"858c85f4-260d-4c3c-9a68-a6065d6ebc70\") " pod="openshift-keda/keda-admission-5fbd5c4644-w8f6k" Jul 06 20:43:11.388295 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.388273 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-jrfpd" Jul 06 20:43:11.426360 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.426318 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:43:11.470569 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.470534 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/858c85f4-260d-4c3c-9a68-a6065d6ebc70-certificates\") pod \"keda-admission-5fbd5c4644-w8f6k\" (UID: \"858c85f4-260d-4c3c-9a68-a6065d6ebc70\") " pod="openshift-keda/keda-admission-5fbd5c4644-w8f6k" Jul 06 20:43:11.470738 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.470606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4xcv\" (UniqueName: \"kubernetes.io/projected/858c85f4-260d-4c3c-9a68-a6065d6ebc70-kube-api-access-j4xcv\") pod \"keda-admission-5fbd5c4644-w8f6k\" (UID: \"858c85f4-260d-4c3c-9a68-a6065d6ebc70\") " pod="openshift-keda/keda-admission-5fbd5c4644-w8f6k" Jul 06 20:43:11.470738 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:43:11.470682 2577 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found Jul 06 20:43:11.470738 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:43:11.470706 2577 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-5fbd5c4644-w8f6k: secret "keda-admission-webhooks-certs" not found Jul 06 20:43:11.471157 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:43:11.470797 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/858c85f4-260d-4c3c-9a68-a6065d6ebc70-certificates podName:858c85f4-260d-4c3c-9a68-a6065d6ebc70 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:11.97075338 +0000 UTC m=+472.789898989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/858c85f4-260d-4c3c-9a68-a6065d6ebc70-certificates") pod "keda-admission-5fbd5c4644-w8f6k" (UID: "858c85f4-260d-4c3c-9a68-a6065d6ebc70") : secret "keda-admission-webhooks-certs" not found Jul 06 20:43:11.480874 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.480815 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4xcv\" (UniqueName: \"kubernetes.io/projected/858c85f4-260d-4c3c-9a68-a6065d6ebc70-kube-api-access-j4xcv\") pod \"keda-admission-5fbd5c4644-w8f6k\" (UID: \"858c85f4-260d-4c3c-9a68-a6065d6ebc70\") " pod="openshift-keda/keda-admission-5fbd5c4644-w8f6k" Jul 06 20:43:11.523806 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.523775 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-jrfpd"] Jul 06 20:43:11.525599 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.525562 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:43:11.537754 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:43:11.537730 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c9b4c6e_94b8_4836_be68_b1876e3959f3.slice/crio-938560a679f98ec0d9ac1be59183185e1a3ead6d9a97dfc8651862779cf94942 WatchSource:0}: Error finding container 938560a679f98ec0d9ac1be59183185e1a3ead6d9a97dfc8651862779cf94942: Status 404 returned error can't find the container with id 938560a679f98ec0d9ac1be59183185e1a3ead6d9a97dfc8651862779cf94942 Jul 06 20:43:11.539061 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.539046 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:43:11.713556 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.713464 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:43:11.765146 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.765110 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-jrfpd" event={"ID":"4c9b4c6e-94b8-4836-be68-b1876e3959f3","Type":"ContainerStarted","Data":"938560a679f98ec0d9ac1be59183185e1a3ead6d9a97dfc8651862779cf94942"} Jul 06 20:43:11.919635 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.919603 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:43:11.974951 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.974868 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/858c85f4-260d-4c3c-9a68-a6065d6ebc70-certificates\") pod \"keda-admission-5fbd5c4644-w8f6k\" (UID: \"858c85f4-260d-4c3c-9a68-a6065d6ebc70\") " pod="openshift-keda/keda-admission-5fbd5c4644-w8f6k" Jul 06 20:43:11.977400 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:11.977379 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/858c85f4-260d-4c3c-9a68-a6065d6ebc70-certificates\") pod \"keda-admission-5fbd5c4644-w8f6k\" (UID: \"858c85f4-260d-4c3c-9a68-a6065d6ebc70\") " pod="openshift-keda/keda-admission-5fbd5c4644-w8f6k" Jul 06 20:43:12.014966 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:12.014933 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:43:12.163516 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:12.163477 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-w8f6k" Jul 06 20:43:12.295328 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:12.295294 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-w8f6k"] Jul 06 20:43:12.299333 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:43:12.299288 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod858c85f4_260d_4c3c_9a68_a6065d6ebc70.slice/crio-bc8aab7148d7fb789e8cd08f718c0956313dd0394c0a162edd6e61ebdcca8145 WatchSource:0}: Error finding container bc8aab7148d7fb789e8cd08f718c0956313dd0394c0a162edd6e61ebdcca8145: Status 404 returned error can't find the container with id bc8aab7148d7fb789e8cd08f718c0956313dd0394c0a162edd6e61ebdcca8145 Jul 06 20:43:12.773093 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:12.773057 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-w8f6k" event={"ID":"858c85f4-260d-4c3c-9a68-a6065d6ebc70","Type":"ContainerStarted","Data":"bc8aab7148d7fb789e8cd08f718c0956313dd0394c0a162edd6e61ebdcca8145"} Jul 06 20:43:15.789809 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:15.789687 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-jrfpd" event={"ID":"4c9b4c6e-94b8-4836-be68-b1876e3959f3","Type":"ContainerStarted","Data":"094bd0cd5a9d8952aaf0d86c8804937b31c71e4ef03b01b0ddf3672ce3fe6521"} Jul 06 20:43:15.789809 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:15.789799 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-jrfpd" Jul 06 20:43:15.791220 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:15.791201 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-w8f6k" event={"ID":"858c85f4-260d-4c3c-9a68-a6065d6ebc70","Type":"ContainerStarted","Data":"50bbc389ed8b85668f454c8397d56599defddf55f4101bad851362824821ca00"} Jul 06 20:43:15.791328 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:15.791320 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-w8f6k" Jul 06 20:43:15.807203 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:15.807156 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-jrfpd" podStartSLOduration=1.9518860569999998 podStartE2EDuration="5.807142891s" totalImagesPullingTime="3.855256834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:43:15.805396893 +0000 UTC m=+476.624542501" watchObservedRunningTime="2026-07-06 20:43:15.807142891 +0000 UTC m=+476.626288499" Jul 06 20:43:15.821491 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:15.821447 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-w8f6k" podStartSLOduration=1.738806139 podStartE2EDuration="4.821434431s" totalImagesPullingTime="3.082628292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:43:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:43:15.820357547 +0000 UTC m=+476.639503154" watchObservedRunningTime="2026-07-06 20:43:15.821434431 +0000 UTC m=+476.640580038" Jul 06 20:43:36.798129 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:36.798098 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-jrfpd" Jul 06 20:43:36.798653 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:43:36.798229 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-w8f6k" Jul 06 20:44:13.050812 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:13.050710 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:44:13.150345 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:13.150305 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:44:14.465259 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:14.465224 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:44:14.529033 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:14.529001 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-kgvvj"] Jul 06 20:44:14.531394 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:14.531374 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-kgvvj" Jul 06 20:44:14.534577 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:14.534553 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 06 20:44:14.534698 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:14.534562 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-tfs5f\"" Jul 06 20:44:14.534860 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:14.534845 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 06 20:44:14.535946 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:14.535932 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 06 20:44:14.542150 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:14.542129 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-kgvvj"] Jul 06 20:44:14.561415 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:14.561379 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:44:14.630991 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:14.630936 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj2f7\" (UniqueName: \"kubernetes.io/projected/eab655aa-e2bf-4c83-b943-eb35856a5d59-kube-api-access-rj2f7\") pod \"llmisvc-controller-manager-67d95fdc48-kgvvj\" (UID: \"eab655aa-e2bf-4c83-b943-eb35856a5d59\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-kgvvj" Jul 06 20:44:14.631192 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:14.631080 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eab655aa-e2bf-4c83-b943-eb35856a5d59-cert\") pod \"llmisvc-controller-manager-67d95fdc48-kgvvj\" (UID: \"eab655aa-e2bf-4c83-b943-eb35856a5d59\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-kgvvj" Jul 06 20:44:14.637378 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:14.637347 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:44:14.732576 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:14.732485 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eab655aa-e2bf-4c83-b943-eb35856a5d59-cert\") pod \"llmisvc-controller-manager-67d95fdc48-kgvvj\" (UID: \"eab655aa-e2bf-4c83-b943-eb35856a5d59\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-kgvvj" Jul 06 20:44:14.732576 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:14.732570 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj2f7\" (UniqueName: \"kubernetes.io/projected/eab655aa-e2bf-4c83-b943-eb35856a5d59-kube-api-access-rj2f7\") pod \"llmisvc-controller-manager-67d95fdc48-kgvvj\" (UID: \"eab655aa-e2bf-4c83-b943-eb35856a5d59\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-kgvvj" Jul 06 20:44:14.735135 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:14.735114 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eab655aa-e2bf-4c83-b943-eb35856a5d59-cert\") pod \"llmisvc-controller-manager-67d95fdc48-kgvvj\" (UID: \"eab655aa-e2bf-4c83-b943-eb35856a5d59\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-kgvvj" Jul 06 20:44:14.736629 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:14.736606 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:44:14.740968 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:14.740939 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj2f7\" (UniqueName: \"kubernetes.io/projected/eab655aa-e2bf-4c83-b943-eb35856a5d59-kube-api-access-rj2f7\") pod \"llmisvc-controller-manager-67d95fdc48-kgvvj\" (UID: \"eab655aa-e2bf-4c83-b943-eb35856a5d59\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-kgvvj" Jul 06 20:44:14.834657 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:14.834616 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:44:14.844499 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:14.844464 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-kgvvj" Jul 06 20:44:14.980414 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:14.980384 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-kgvvj"] Jul 06 20:44:14.981974 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:14.981918 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:44:14.984351 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:44:14.984284 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podeab655aa_e2bf_4c83_b943_eb35856a5d59.slice/crio-57b917a056b8505ed0e4f888f05a85ba3d6a472ea7b5097b27622da358532d37 WatchSource:0}: Error finding container 57b917a056b8505ed0e4f888f05a85ba3d6a472ea7b5097b27622da358532d37: Status 404 returned error can't find the container with id 57b917a056b8505ed0e4f888f05a85ba3d6a472ea7b5097b27622da358532d37 Jul 06 20:44:15.041304 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:15.041271 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-kgvvj" event={"ID":"eab655aa-e2bf-4c83-b943-eb35856a5d59","Type":"ContainerStarted","Data":"57b917a056b8505ed0e4f888f05a85ba3d6a472ea7b5097b27622da358532d37"} Jul 06 20:44:15.080464 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:15.080416 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:44:17.051282 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:17.051243 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-kgvvj" event={"ID":"eab655aa-e2bf-4c83-b943-eb35856a5d59","Type":"ContainerStarted","Data":"d548ab9961d3d1559e037acd560f185eb20d790c6580254c7b78ce0c93ac0fdc"} Jul 06 20:44:17.051699 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:17.051370 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-kgvvj" Jul 06 20:44:17.069045 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:17.069001 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-67d95fdc48-kgvvj" podStartSLOduration=1.319499923 podStartE2EDuration="3.068986821s" totalImagesPullingTime="1.749486898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:44:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:44:17.06779115 +0000 UTC m=+537.886936758" watchObservedRunningTime="2026-07-06 20:44:17.068986821 +0000 UTC m=+537.888132429" Jul 06 20:44:21.346461 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:21.346418 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:44:36.678300 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.678261 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c49dcddb6-jk6xc"] Jul 06 20:44:36.682224 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.682195 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:36.694226 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.694201 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c49dcddb6-jk6xc"] Jul 06 20:44:36.764982 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.764928 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:44:36.828818 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.828746 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b67b4b6e-cbc9-49c3-88ae-e4baac7b0436-oauth-serving-cert\") pod \"console-7c49dcddb6-jk6xc\" (UID: \"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436\") " pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:36.829004 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.828829 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b67b4b6e-cbc9-49c3-88ae-e4baac7b0436-service-ca\") pod \"console-7c49dcddb6-jk6xc\" (UID: \"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436\") " pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:36.829004 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.828846 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szk94\" (UniqueName: \"kubernetes.io/projected/b67b4b6e-cbc9-49c3-88ae-e4baac7b0436-kube-api-access-szk94\") pod \"console-7c49dcddb6-jk6xc\" (UID: \"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436\") " pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:36.829004 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.828867 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b67b4b6e-cbc9-49c3-88ae-e4baac7b0436-console-oauth-config\") pod \"console-7c49dcddb6-jk6xc\" (UID: \"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436\") " pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:36.829004 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.828967 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b67b4b6e-cbc9-49c3-88ae-e4baac7b0436-console-serving-cert\") pod \"console-7c49dcddb6-jk6xc\" (UID: \"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436\") " pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:36.829209 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.829105 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b67b4b6e-cbc9-49c3-88ae-e4baac7b0436-console-config\") pod \"console-7c49dcddb6-jk6xc\" (UID: \"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436\") " pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:36.829209 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.829137 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b67b4b6e-cbc9-49c3-88ae-e4baac7b0436-trusted-ca-bundle\") pod \"console-7c49dcddb6-jk6xc\" (UID: \"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436\") " pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:36.855012 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.854973 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:44:36.930658 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.930561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b67b4b6e-cbc9-49c3-88ae-e4baac7b0436-console-serving-cert\") pod \"console-7c49dcddb6-jk6xc\" (UID: \"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436\") " pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:36.930658 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.930653 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b67b4b6e-cbc9-49c3-88ae-e4baac7b0436-console-config\") pod \"console-7c49dcddb6-jk6xc\" (UID: \"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436\") " pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:36.930907 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.930678 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b67b4b6e-cbc9-49c3-88ae-e4baac7b0436-trusted-ca-bundle\") pod \"console-7c49dcddb6-jk6xc\" (UID: \"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436\") " pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:36.930907 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.930722 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b67b4b6e-cbc9-49c3-88ae-e4baac7b0436-oauth-serving-cert\") pod \"console-7c49dcddb6-jk6xc\" (UID: \"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436\") " pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:36.930907 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.930800 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b67b4b6e-cbc9-49c3-88ae-e4baac7b0436-service-ca\") pod \"console-7c49dcddb6-jk6xc\" (UID: \"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436\") " pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:36.930907 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.930822 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szk94\" (UniqueName: \"kubernetes.io/projected/b67b4b6e-cbc9-49c3-88ae-e4baac7b0436-kube-api-access-szk94\") pod \"console-7c49dcddb6-jk6xc\" (UID: \"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436\") " pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:36.930907 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.930850 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b67b4b6e-cbc9-49c3-88ae-e4baac7b0436-console-oauth-config\") pod \"console-7c49dcddb6-jk6xc\" (UID: \"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436\") " pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:36.931540 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.931514 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b67b4b6e-cbc9-49c3-88ae-e4baac7b0436-console-config\") pod \"console-7c49dcddb6-jk6xc\" (UID: \"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436\") " pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:36.931540 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.931559 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b67b4b6e-cbc9-49c3-88ae-e4baac7b0436-oauth-serving-cert\") pod \"console-7c49dcddb6-jk6xc\" (UID: \"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436\") " pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:36.931915 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.931789 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b67b4b6e-cbc9-49c3-88ae-e4baac7b0436-service-ca\") pod \"console-7c49dcddb6-jk6xc\" (UID: \"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436\") " pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:36.931915 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.931854 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b67b4b6e-cbc9-49c3-88ae-e4baac7b0436-trusted-ca-bundle\") pod \"console-7c49dcddb6-jk6xc\" (UID: \"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436\") " pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:36.933389 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.933360 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b67b4b6e-cbc9-49c3-88ae-e4baac7b0436-console-serving-cert\") pod \"console-7c49dcddb6-jk6xc\" (UID: \"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436\") " pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:36.933509 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.933488 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b67b4b6e-cbc9-49c3-88ae-e4baac7b0436-console-oauth-config\") pod \"console-7c49dcddb6-jk6xc\" (UID: \"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436\") " pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:36.938968 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.938948 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szk94\" (UniqueName: \"kubernetes.io/projected/b67b4b6e-cbc9-49c3-88ae-e4baac7b0436-kube-api-access-szk94\") pod \"console-7c49dcddb6-jk6xc\" (UID: \"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436\") " pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:36.993464 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:36.993420 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:37.129561 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:37.129499 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c49dcddb6-jk6xc"] Jul 06 20:44:37.132469 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:44:37.132425 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb67b4b6e_cbc9_49c3_88ae_e4baac7b0436.slice/crio-cd713468a673e8feafb98081460c6b0aac4eca7e73fa392730aa41c556abb8b6 WatchSource:0}: Error finding container cd713468a673e8feafb98081460c6b0aac4eca7e73fa392730aa41c556abb8b6: Status 404 returned error can't find the container with id cd713468a673e8feafb98081460c6b0aac4eca7e73fa392730aa41c556abb8b6 Jul 06 20:44:37.139576 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:37.139458 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c49dcddb6-jk6xc" event={"ID":"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436","Type":"ContainerStarted","Data":"cd713468a673e8feafb98081460c6b0aac4eca7e73fa392730aa41c556abb8b6"} Jul 06 20:44:38.145177 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:38.145142 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c49dcddb6-jk6xc" event={"ID":"b67b4b6e-cbc9-49c3-88ae-e4baac7b0436","Type":"ContainerStarted","Data":"f1cb31cdf371dc164787fd675599d1c51e4ca80fb54b21a917becd1be10abd0e"} Jul 06 20:44:38.162741 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:38.162687 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c49dcddb6-jk6xc" podStartSLOduration=2.162671207 podStartE2EDuration="2.162671207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:44:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:44:38.162117287 +0000 UTC m=+558.981262896" watchObservedRunningTime="2026-07-06 20:44:38.162671207 +0000 UTC m=+558.981816814" Jul 06 20:44:46.993682 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:46.993640 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:46.994290 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:46.993723 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:46.998806 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:46.998783 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:47.187137 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:47.187105 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c49dcddb6-jk6xc" Jul 06 20:44:47.241706 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:47.241676 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5446c67d9-vvpj9"] Jul 06 20:44:47.370471 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:47.370439 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:44:47.477671 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:47.477636 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:44:48.060845 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:44:48.060820 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-kgvvj" Jul 06 20:45:02.693866 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:02.693832 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:45:02.777640 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:02.777601 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:45:12.270511 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.270469 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5446c67d9-vvpj9" podUID="c483db77-0f95-401d-8c30-0ff633ccd1a8" containerName="console" containerID="cri-o://f50862addc0133812466da5f09fc99c669ce43f083a7f6cc134d95095966ac1b" gracePeriod=15 Jul 06 20:45:12.516191 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.516167 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:45:12.635322 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.635289 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-oauth-serving-cert\") pod \"c483db77-0f95-401d-8c30-0ff633ccd1a8\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " Jul 06 20:45:12.635322 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.635330 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-trusted-ca-bundle\") pod \"c483db77-0f95-401d-8c30-0ff633ccd1a8\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " Jul 06 20:45:12.635575 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.635353 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b55xm\" (UniqueName: \"kubernetes.io/projected/c483db77-0f95-401d-8c30-0ff633ccd1a8-kube-api-access-b55xm\") pod \"c483db77-0f95-401d-8c30-0ff633ccd1a8\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " Jul 06 20:45:12.635575 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.635370 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c483db77-0f95-401d-8c30-0ff633ccd1a8-console-serving-cert\") pod \"c483db77-0f95-401d-8c30-0ff633ccd1a8\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " Jul 06 20:45:12.635575 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.635446 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-console-config\") pod \"c483db77-0f95-401d-8c30-0ff633ccd1a8\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " Jul 06 20:45:12.635575 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.635502 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c483db77-0f95-401d-8c30-0ff633ccd1a8-console-oauth-config\") pod \"c483db77-0f95-401d-8c30-0ff633ccd1a8\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " Jul 06 20:45:12.635575 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.635527 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-service-ca\") pod \"c483db77-0f95-401d-8c30-0ff633ccd1a8\" (UID: \"c483db77-0f95-401d-8c30-0ff633ccd1a8\") " Jul 06 20:45:12.635925 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.635736 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c483db77-0f95-401d-8c30-0ff633ccd1a8" (UID: "c483db77-0f95-401d-8c30-0ff633ccd1a8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:45:12.636016 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.635988 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-console-config" (OuterVolumeSpecName: "console-config") pod "c483db77-0f95-401d-8c30-0ff633ccd1a8" (UID: "c483db77-0f95-401d-8c30-0ff633ccd1a8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:45:12.636073 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.636013 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c483db77-0f95-401d-8c30-0ff633ccd1a8" (UID: "c483db77-0f95-401d-8c30-0ff633ccd1a8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:45:12.636073 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.636059 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-service-ca" (OuterVolumeSpecName: "service-ca") pod "c483db77-0f95-401d-8c30-0ff633ccd1a8" (UID: "c483db77-0f95-401d-8c30-0ff633ccd1a8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:45:12.637778 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.637737 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c483db77-0f95-401d-8c30-0ff633ccd1a8-kube-api-access-b55xm" (OuterVolumeSpecName: "kube-api-access-b55xm") pod "c483db77-0f95-401d-8c30-0ff633ccd1a8" (UID: "c483db77-0f95-401d-8c30-0ff633ccd1a8"). InnerVolumeSpecName "kube-api-access-b55xm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:45:12.637886 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.637754 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c483db77-0f95-401d-8c30-0ff633ccd1a8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c483db77-0f95-401d-8c30-0ff633ccd1a8" (UID: "c483db77-0f95-401d-8c30-0ff633ccd1a8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:45:12.637886 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.637860 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c483db77-0f95-401d-8c30-0ff633ccd1a8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c483db77-0f95-401d-8c30-0ff633ccd1a8" (UID: "c483db77-0f95-401d-8c30-0ff633ccd1a8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:45:12.736789 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.736740 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-console-config\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:45:12.736789 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.736791 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c483db77-0f95-401d-8c30-0ff633ccd1a8-console-oauth-config\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:45:12.736970 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.736803 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-service-ca\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:45:12.736970 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.736812 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-oauth-serving-cert\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:45:12.736970 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.736821 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c483db77-0f95-401d-8c30-0ff633ccd1a8-trusted-ca-bundle\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:45:12.736970 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.736829 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b55xm\" (UniqueName: \"kubernetes.io/projected/c483db77-0f95-401d-8c30-0ff633ccd1a8-kube-api-access-b55xm\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:45:12.736970 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:12.736838 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c483db77-0f95-401d-8c30-0ff633ccd1a8-console-serving-cert\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:45:13.291914 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:13.291875 2577 generic.go:356] "Generic (PLEG): container finished" podID="c483db77-0f95-401d-8c30-0ff633ccd1a8" containerID="f50862addc0133812466da5f09fc99c669ce43f083a7f6cc134d95095966ac1b" exitCode=0 Jul 06 20:45:13.292337 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:13.291924 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5446c67d9-vvpj9" Jul 06 20:45:13.292337 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:13.291917 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5446c67d9-vvpj9" event={"ID":"c483db77-0f95-401d-8c30-0ff633ccd1a8","Type":"ContainerDied","Data":"f50862addc0133812466da5f09fc99c669ce43f083a7f6cc134d95095966ac1b"} Jul 06 20:45:13.292337 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:13.292047 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5446c67d9-vvpj9" event={"ID":"c483db77-0f95-401d-8c30-0ff633ccd1a8","Type":"ContainerDied","Data":"9be1195e432fd824c7ba037557c6dfb88eea30e8e7e223c92ba6859282e42796"} Jul 06 20:45:13.292337 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:13.292067 2577 scope.go:117] "RemoveContainer" containerID="f50862addc0133812466da5f09fc99c669ce43f083a7f6cc134d95095966ac1b" Jul 06 20:45:13.300834 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:13.300815 2577 scope.go:117] "RemoveContainer" containerID="f50862addc0133812466da5f09fc99c669ce43f083a7f6cc134d95095966ac1b" Jul 06 20:45:13.301081 ip-10-0-140-125 kubenswrapper[2577]: E0706 20:45:13.301064 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f50862addc0133812466da5f09fc99c669ce43f083a7f6cc134d95095966ac1b\": container with ID starting with f50862addc0133812466da5f09fc99c669ce43f083a7f6cc134d95095966ac1b not found: ID does not exist" containerID="f50862addc0133812466da5f09fc99c669ce43f083a7f6cc134d95095966ac1b" Jul 06 20:45:13.301125 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:13.301093 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f50862addc0133812466da5f09fc99c669ce43f083a7f6cc134d95095966ac1b"} err="failed to get container status \"f50862addc0133812466da5f09fc99c669ce43f083a7f6cc134d95095966ac1b\": rpc error: code = NotFound desc = could not find container \"f50862addc0133812466da5f09fc99c669ce43f083a7f6cc134d95095966ac1b\": container with ID starting with f50862addc0133812466da5f09fc99c669ce43f083a7f6cc134d95095966ac1b not found: ID does not exist" Jul 06 20:45:13.312457 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:13.312409 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5446c67d9-vvpj9"] Jul 06 20:45:13.314337 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:13.314314 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5446c67d9-vvpj9"] Jul 06 20:45:13.702101 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:13.702069 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c483db77-0f95-401d-8c30-0ff633ccd1a8" path="/var/lib/kubelet/pods/c483db77-0f95-401d-8c30-0ff633ccd1a8/volumes" Jul 06 20:45:19.610209 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:19.610178 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-m8w66_7a829421-0363-40d1-941c-78b3f80a4f95/console-operator/2.log" Jul 06 20:45:19.616715 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:19.616690 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-m8w66_7a829421-0363-40d1-941c-78b3f80a4f95/console-operator/2.log" Jul 06 20:45:19.618792 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:19.618751 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/ovn-acl-logging/0.log" Jul 06 20:45:19.625533 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:19.625511 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/ovn-acl-logging/0.log" Jul 06 20:45:23.144573 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:23.144521 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:45:23.225304 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:23.225259 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:45:23.316741 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:23.316691 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:45:23.417127 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:23.417029 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:45:23.804738 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:23.804707 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:45:23.868322 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:45:23.868290 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:46:18.471237 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:46:18.471207 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:46:36.693279 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:46:36.693238 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:47:15.362131 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:15.362047 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-x8ktx"] Jul 06 20:47:15.362722 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:15.362451 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c483db77-0f95-401d-8c30-0ff633ccd1a8" containerName="console" Jul 06 20:47:15.362722 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:15.362465 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c483db77-0f95-401d-8c30-0ff633ccd1a8" containerName="console" Jul 06 20:47:15.362722 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:15.362525 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c483db77-0f95-401d-8c30-0ff633ccd1a8" containerName="console" Jul 06 20:47:15.362990 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:15.362895 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:47:15.365566 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:15.365552 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-x8ktx" Jul 06 20:47:15.368069 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:15.368051 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 06 20:47:15.368069 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:15.368060 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-x6b47\"" Jul 06 20:47:15.372009 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:15.371987 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-x8ktx"] Jul 06 20:47:15.420075 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:15.420040 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5a902179-22f3-4025-b2c8-7453e0e70b94-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-x8ktx\" (UID: \"5a902179-22f3-4025-b2c8-7453e0e70b94\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-x8ktx" Jul 06 20:47:15.420229 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:15.420109 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcd9v\" (UniqueName: \"kubernetes.io/projected/5a902179-22f3-4025-b2c8-7453e0e70b94-kube-api-access-lcd9v\") pod \"seaweedfs-tls-custom-6644bf5d6c-x8ktx\" (UID: \"5a902179-22f3-4025-b2c8-7453e0e70b94\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-x8ktx" Jul 06 20:47:15.521531 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:15.521500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5a902179-22f3-4025-b2c8-7453e0e70b94-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-x8ktx\" (UID: \"5a902179-22f3-4025-b2c8-7453e0e70b94\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-x8ktx" Jul 06 20:47:15.521692 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:15.521566 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcd9v\" (UniqueName: \"kubernetes.io/projected/5a902179-22f3-4025-b2c8-7453e0e70b94-kube-api-access-lcd9v\") pod \"seaweedfs-tls-custom-6644bf5d6c-x8ktx\" (UID: \"5a902179-22f3-4025-b2c8-7453e0e70b94\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-x8ktx" Jul 06 20:47:15.521981 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:15.521961 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5a902179-22f3-4025-b2c8-7453e0e70b94-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-x8ktx\" (UID: \"5a902179-22f3-4025-b2c8-7453e0e70b94\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-x8ktx" Jul 06 20:47:15.530017 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:15.529996 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcd9v\" (UniqueName: \"kubernetes.io/projected/5a902179-22f3-4025-b2c8-7453e0e70b94-kube-api-access-lcd9v\") pod \"seaweedfs-tls-custom-6644bf5d6c-x8ktx\" (UID: \"5a902179-22f3-4025-b2c8-7453e0e70b94\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-x8ktx" Jul 06 20:47:15.676425 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:15.676341 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-x8ktx" Jul 06 20:47:15.806825 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:15.806799 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-x8ktx"] Jul 06 20:47:15.809055 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:47:15.809018 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a902179_22f3_4025_b2c8_7453e0e70b94.slice/crio-f261538e011f602fc68700fd6ea495161c1f5e323cf3e95540a040bb73327854 WatchSource:0}: Error finding container f261538e011f602fc68700fd6ea495161c1f5e323cf3e95540a040bb73327854: Status 404 returned error can't find the container with id f261538e011f602fc68700fd6ea495161c1f5e323cf3e95540a040bb73327854 Jul 06 20:47:16.799935 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:16.799891 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-x8ktx" event={"ID":"5a902179-22f3-4025-b2c8-7453e0e70b94","Type":"ContainerStarted","Data":"f261538e011f602fc68700fd6ea495161c1f5e323cf3e95540a040bb73327854"} Jul 06 20:47:20.384082 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:20.384059 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 06 20:47:20.819588 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:20.819551 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-x8ktx" event={"ID":"5a902179-22f3-4025-b2c8-7453e0e70b94","Type":"ContainerStarted","Data":"d4b69297ac6e033dea9918e90a1307dfdc126c08e29c88b874640bb4d61611de"} Jul 06 20:47:20.837389 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:20.837342 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-x8ktx" podStartSLOduration=1.266912082 podStartE2EDuration="5.837327576s" totalImagesPullingTime="4.570415494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:47:20.836951414 +0000 UTC m=+721.656097024" watchObservedRunningTime="2026-07-06 20:47:20.837327576 +0000 UTC m=+721.656473184" Jul 06 20:47:21.578602 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:21.578567 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-x8ktx"] Jul 06 20:47:22.827609 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:22.827562 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-x8ktx" podUID="5a902179-22f3-4025-b2c8-7453e0e70b94" containerName="seaweedfs-tls-custom" containerID="cri-o://d4b69297ac6e033dea9918e90a1307dfdc126c08e29c88b874640bb4d61611de" gracePeriod=30 Jul 06 20:47:50.945930 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:50.945901 2577 generic.go:356] "Generic (PLEG): container finished" podID="5a902179-22f3-4025-b2c8-7453e0e70b94" containerID="d4b69297ac6e033dea9918e90a1307dfdc126c08e29c88b874640bb4d61611de" exitCode=0 Jul 06 20:47:50.946275 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:50.945973 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-x8ktx" event={"ID":"5a902179-22f3-4025-b2c8-7453e0e70b94","Type":"ContainerDied","Data":"d4b69297ac6e033dea9918e90a1307dfdc126c08e29c88b874640bb4d61611de"} Jul 06 20:47:51.072587 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:51.072566 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-x8ktx" Jul 06 20:47:51.142574 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:51.142543 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5a902179-22f3-4025-b2c8-7453e0e70b94-data\") pod \"5a902179-22f3-4025-b2c8-7453e0e70b94\" (UID: \"5a902179-22f3-4025-b2c8-7453e0e70b94\") " Jul 06 20:47:51.142726 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:51.142628 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcd9v\" (UniqueName: \"kubernetes.io/projected/5a902179-22f3-4025-b2c8-7453e0e70b94-kube-api-access-lcd9v\") pod \"5a902179-22f3-4025-b2c8-7453e0e70b94\" (UID: \"5a902179-22f3-4025-b2c8-7453e0e70b94\") " Jul 06 20:47:51.143460 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:51.143424 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a902179-22f3-4025-b2c8-7453e0e70b94-data" (OuterVolumeSpecName: "data") pod "5a902179-22f3-4025-b2c8-7453e0e70b94" (UID: "5a902179-22f3-4025-b2c8-7453e0e70b94"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:47:51.144797 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:51.144757 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a902179-22f3-4025-b2c8-7453e0e70b94-kube-api-access-lcd9v" (OuterVolumeSpecName: "kube-api-access-lcd9v") pod "5a902179-22f3-4025-b2c8-7453e0e70b94" (UID: "5a902179-22f3-4025-b2c8-7453e0e70b94"). InnerVolumeSpecName "kube-api-access-lcd9v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:47:51.243635 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:51.243554 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcd9v\" (UniqueName: \"kubernetes.io/projected/5a902179-22f3-4025-b2c8-7453e0e70b94-kube-api-access-lcd9v\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:47:51.243635 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:51.243582 2577 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5a902179-22f3-4025-b2c8-7453e0e70b94-data\") on node \"ip-10-0-140-125.ec2.internal\" DevicePath \"\"" Jul 06 20:47:51.954460 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:51.954419 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-x8ktx" event={"ID":"5a902179-22f3-4025-b2c8-7453e0e70b94","Type":"ContainerDied","Data":"f261538e011f602fc68700fd6ea495161c1f5e323cf3e95540a040bb73327854"} Jul 06 20:47:51.954911 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:51.954484 2577 scope.go:117] "RemoveContainer" containerID="d4b69297ac6e033dea9918e90a1307dfdc126c08e29c88b874640bb4d61611de" Jul 06 20:47:51.954911 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:51.954445 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-x8ktx" Jul 06 20:47:51.970411 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:51.970362 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-x8ktx"] Jul 06 20:47:51.974162 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:51.974143 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-x8ktx"] Jul 06 20:47:53.325910 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:53.325877 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:47:53.702803 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:47:53.702705 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a902179-22f3-4025-b2c8-7453e0e70b94" path="/var/lib/kubelet/pods/5a902179-22f3-4025-b2c8-7453e0e70b94/volumes" Jul 06 20:48:08.479318 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:08.479284 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-8nq7l"] Jul 06 20:48:08.479841 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:08.479823 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a902179-22f3-4025-b2c8-7453e0e70b94" containerName="seaweedfs-tls-custom" Jul 06 20:48:08.479928 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:08.479844 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a902179-22f3-4025-b2c8-7453e0e70b94" containerName="seaweedfs-tls-custom" Jul 06 20:48:08.479983 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:08.479963 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a902179-22f3-4025-b2c8-7453e0e70b94" containerName="seaweedfs-tls-custom" Jul 06 20:48:08.483157 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:08.483136 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-8nq7l" Jul 06 20:48:08.488555 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:08.486057 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving\"" Jul 06 20:48:08.488555 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:08.486303 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" Jul 06 20:48:08.488555 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:08.488188 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-x6b47\"" Jul 06 20:48:08.490187 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:08.490156 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:48:08.524371 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:08.524344 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-8nq7l"] Jul 06 20:48:08.592096 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:08.592063 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f0bb51ff-2cc8-432b-8b37-080f072804d6-data\") pod \"seaweedfs-tls-serving-67b7477c6d-8nq7l\" (UID: \"f0bb51ff-2cc8-432b-8b37-080f072804d6\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-8nq7l" Jul 06 20:48:08.592096 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:08.592099 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/f0bb51ff-2cc8-432b-8b37-080f072804d6-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-8nq7l\" (UID: \"f0bb51ff-2cc8-432b-8b37-080f072804d6\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-8nq7l" Jul 06 20:48:08.592301 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:08.592131 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b67f2\" (UniqueName: \"kubernetes.io/projected/f0bb51ff-2cc8-432b-8b37-080f072804d6-kube-api-access-b67f2\") pod \"seaweedfs-tls-serving-67b7477c6d-8nq7l\" (UID: \"f0bb51ff-2cc8-432b-8b37-080f072804d6\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-8nq7l" Jul 06 20:48:08.634910 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:08.634881 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:48:08.693115 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:08.693083 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f0bb51ff-2cc8-432b-8b37-080f072804d6-data\") pod \"seaweedfs-tls-serving-67b7477c6d-8nq7l\" (UID: \"f0bb51ff-2cc8-432b-8b37-080f072804d6\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-8nq7l" Jul 06 20:48:08.693265 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:08.693119 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/f0bb51ff-2cc8-432b-8b37-080f072804d6-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-8nq7l\" (UID: \"f0bb51ff-2cc8-432b-8b37-080f072804d6\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-8nq7l" Jul 06 20:48:08.693265 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:08.693143 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b67f2\" (UniqueName: \"kubernetes.io/projected/f0bb51ff-2cc8-432b-8b37-080f072804d6-kube-api-access-b67f2\") pod \"seaweedfs-tls-serving-67b7477c6d-8nq7l\" (UID: \"f0bb51ff-2cc8-432b-8b37-080f072804d6\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-8nq7l" Jul 06 20:48:08.693459 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:08.693439 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f0bb51ff-2cc8-432b-8b37-080f072804d6-data\") pod \"seaweedfs-tls-serving-67b7477c6d-8nq7l\" (UID: \"f0bb51ff-2cc8-432b-8b37-080f072804d6\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-8nq7l" Jul 06 20:48:08.695790 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:08.695744 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/f0bb51ff-2cc8-432b-8b37-080f072804d6-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-8nq7l\" (UID: \"f0bb51ff-2cc8-432b-8b37-080f072804d6\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-8nq7l" Jul 06 20:48:08.701452 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:08.701435 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b67f2\" (UniqueName: \"kubernetes.io/projected/f0bb51ff-2cc8-432b-8b37-080f072804d6-kube-api-access-b67f2\") pod \"seaweedfs-tls-serving-67b7477c6d-8nq7l\" (UID: \"f0bb51ff-2cc8-432b-8b37-080f072804d6\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-8nq7l" Jul 06 20:48:08.798347 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:08.798275 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-8nq7l" Jul 06 20:48:08.925608 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:08.925584 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-8nq7l"] Jul 06 20:48:08.928563 ip-10-0-140-125 kubenswrapper[2577]: W0706 20:48:08.928536 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0bb51ff_2cc8_432b_8b37_080f072804d6.slice/crio-4f31b4e41d30e80be58243cd4b5ee11de6aafa450617f80d6080e8765b3cb61f WatchSource:0}: Error finding container 4f31b4e41d30e80be58243cd4b5ee11de6aafa450617f80d6080e8765b3cb61f: Status 404 returned error can't find the container with id 4f31b4e41d30e80be58243cd4b5ee11de6aafa450617f80d6080e8765b3cb61f Jul 06 20:48:09.026044 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:09.026012 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-8nq7l" event={"ID":"f0bb51ff-2cc8-432b-8b37-080f072804d6","Type":"ContainerStarted","Data":"4f31b4e41d30e80be58243cd4b5ee11de6aafa450617f80d6080e8765b3cb61f"} Jul 06 20:48:10.032005 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:10.031970 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-8nq7l" event={"ID":"f0bb51ff-2cc8-432b-8b37-080f072804d6","Type":"ContainerStarted","Data":"1dc27655e0a741186a62c1abc8f503cf8e07615ee516e813142429fc9668ccb3"} Jul 06 20:48:10.048271 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:10.048217 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-serving-67b7477c6d-8nq7l" podStartSLOduration=1.575789071 podStartE2EDuration="2.048201994s" totalImagesPullingTime="472.412923ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:48:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:48:10.046081049 +0000 UTC m=+770.865226659" watchObservedRunningTime="2026-07-06 20:48:10.048201994 +0000 UTC m=+770.867347602" Jul 06 20:48:22.281105 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:22.281063 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:48:22.378416 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:22.378384 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:48:33.610856 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:33.610816 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:48:33.676547 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:48:33.676512 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:08.862911 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:50:08.862875 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:08.942681 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:50:08.942646 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:09.442220 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:50:09.442177 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:50:19.646783 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:50:19.646741 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-m8w66_7a829421-0363-40d1-941c-78b3f80a4f95/console-operator/2.log" Jul 06 20:50:19.650400 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:50:19.650380 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-m8w66_7a829421-0363-40d1-941c-78b3f80a4f95/console-operator/2.log" Jul 06 20:50:19.655319 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:50:19.655293 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/ovn-acl-logging/0.log" Jul 06 20:50:19.658905 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:50:19.658888 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/ovn-acl-logging/0.log" Jul 06 20:50:23.541304 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:50:23.541269 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:51:34.016841 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:51:34.016805 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:51:34.117996 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:51:34.117956 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:51:34.354306 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:51:34.354268 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:51:46.594266 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:51:46.594225 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:51:54.075319 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:51:54.075255 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:51:54.523569 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:51:54.523444 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:53:19.355566 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:53:19.355474 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:53:20.847039 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:53:20.847003 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:53:32.663963 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:53:32.663897 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:55:19.676620 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:55:19.676593 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-m8w66_7a829421-0363-40d1-941c-78b3f80a4f95/console-operator/2.log" Jul 06 20:55:19.677199 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:55:19.677118 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-m8w66_7a829421-0363-40d1-941c-78b3f80a4f95/console-operator/2.log" Jul 06 20:55:19.684821 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:55:19.684802 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/ovn-acl-logging/0.log" Jul 06 20:55:19.685195 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:55:19.685176 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/ovn-acl-logging/0.log" Jul 06 20:56:02.265522 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:56:02.265488 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:56:02.356178 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:56:02.356146 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:56:09.518834 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:56:09.518801 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:56:14.750726 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:56:14.750663 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:56:14.932068 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:56:14.932024 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:57:34.278466 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:57:34.278434 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:57:34.369644 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:57:34.369616 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:58:24.973089 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:58:24.973052 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:58:30.051393 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:58:30.051348 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 20:58:30.154646 ip-10-0-140-125 kubenswrapper[2577]: I0706 20:58:30.154617 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:10.285868 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:00:10.285832 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:15.337567 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:00:15.337524 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:15.525028 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:00:15.524996 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 21:00:19.711603 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:00:19.711561 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-m8w66_7a829421-0363-40d1-941c-78b3f80a4f95/console-operator/2.log" Jul 06 21:00:19.712489 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:00:19.712466 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-m8w66_7a829421-0363-40d1-941c-78b3f80a4f95/console-operator/2.log" Jul 06 21:00:19.719992 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:00:19.719970 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/ovn-acl-logging/0.log" Jul 06 21:00:19.721009 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:00:19.720992 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/ovn-acl-logging/0.log" Jul 06 21:00:55.165132 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:00:55.165094 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 21:01:40.080259 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:01:40.080220 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 21:01:55.528748 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:01:55.528703 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:00.659019 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:02:00.658988 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:00.890406 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:02:00.890367 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:30.755067 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:02:30.754983 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:37.016632 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:02:37.016600 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 21:02:37.114740 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:02:37.114708 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:04.946074 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:04.946039 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:05.100217 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:05.100178 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qqdbp/must-gather-qxkp8"] Jul 06 21:03:05.103812 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:05.103790 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qqdbp/must-gather-qxkp8" Jul 06 21:03:05.106505 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:05.106485 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qqdbp\"/\"kube-root-ca.crt\"" Jul 06 21:03:05.106641 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:05.106485 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qqdbp\"/\"default-dockercfg-h4br4\"" Jul 06 21:03:05.107589 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:05.107570 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qqdbp\"/\"openshift-service-ca.crt\"" Jul 06 21:03:05.111505 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:05.111485 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qqdbp/must-gather-qxkp8"] Jul 06 21:03:05.124620 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:05.124590 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:05.184048 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:05.184006 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fd708833-7e59-4e20-b714-bb3da7a9e151-must-gather-output\") pod \"must-gather-qxkp8\" (UID: \"fd708833-7e59-4e20-b714-bb3da7a9e151\") " pod="openshift-must-gather-qqdbp/must-gather-qxkp8" Jul 06 21:03:05.184178 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:05.184160 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbczb\" (UniqueName: \"kubernetes.io/projected/fd708833-7e59-4e20-b714-bb3da7a9e151-kube-api-access-sbczb\") pod \"must-gather-qxkp8\" (UID: \"fd708833-7e59-4e20-b714-bb3da7a9e151\") " pod="openshift-must-gather-qqdbp/must-gather-qxkp8" Jul 06 21:03:05.225584 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:05.225485 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:05.284844 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:05.284810 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbczb\" (UniqueName: \"kubernetes.io/projected/fd708833-7e59-4e20-b714-bb3da7a9e151-kube-api-access-sbczb\") pod \"must-gather-qxkp8\" (UID: \"fd708833-7e59-4e20-b714-bb3da7a9e151\") " pod="openshift-must-gather-qqdbp/must-gather-qxkp8" Jul 06 21:03:05.284988 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:05.284872 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fd708833-7e59-4e20-b714-bb3da7a9e151-must-gather-output\") pod \"must-gather-qxkp8\" (UID: \"fd708833-7e59-4e20-b714-bb3da7a9e151\") " pod="openshift-must-gather-qqdbp/must-gather-qxkp8" Jul 06 21:03:05.285200 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:05.285180 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fd708833-7e59-4e20-b714-bb3da7a9e151-must-gather-output\") pod \"must-gather-qxkp8\" (UID: \"fd708833-7e59-4e20-b714-bb3da7a9e151\") " pod="openshift-must-gather-qqdbp/must-gather-qxkp8" Jul 06 21:03:05.292947 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:05.292926 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbczb\" (UniqueName: \"kubernetes.io/projected/fd708833-7e59-4e20-b714-bb3da7a9e151-kube-api-access-sbczb\") pod \"must-gather-qxkp8\" (UID: \"fd708833-7e59-4e20-b714-bb3da7a9e151\") " pod="openshift-must-gather-qqdbp/must-gather-qxkp8" Jul 06 21:03:05.431211 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:05.431183 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qqdbp/must-gather-qxkp8" Jul 06 21:03:05.561407 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:05.561375 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qqdbp/must-gather-qxkp8"] Jul 06 21:03:05.563609 ip-10-0-140-125 kubenswrapper[2577]: W0706 21:03:05.563582 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd708833_7e59_4e20_b714_bb3da7a9e151.slice/crio-43cd9fa3d32d1b1d5a9009184443f04e621733ac8c0e1acea7ac58c4a0a34825 WatchSource:0}: Error finding container 43cd9fa3d32d1b1d5a9009184443f04e621733ac8c0e1acea7ac58c4a0a34825: Status 404 returned error can't find the container with id 43cd9fa3d32d1b1d5a9009184443f04e621733ac8c0e1acea7ac58c4a0a34825 Jul 06 21:03:05.565589 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:05.565569 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 21:03:05.730356 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:05.730276 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qqdbp/must-gather-qxkp8" event={"ID":"fd708833-7e59-4e20-b714-bb3da7a9e151","Type":"ContainerStarted","Data":"43cd9fa3d32d1b1d5a9009184443f04e621733ac8c0e1acea7ac58c4a0a34825"} Jul 06 21:03:06.738712 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:06.738679 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qqdbp/must-gather-qxkp8" event={"ID":"fd708833-7e59-4e20-b714-bb3da7a9e151","Type":"ContainerStarted","Data":"8e168a91769ccac8492c6e11a0cdf7008e1fbc8a4e4b91c26b8ea257aa00b986"} Jul 06 21:03:06.739128 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:06.738729 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qqdbp/must-gather-qxkp8" event={"ID":"fd708833-7e59-4e20-b714-bb3da7a9e151","Type":"ContainerStarted","Data":"1ccf1c92072ff5247fe067d74b76f363c0127b81a3ca8e563044a83a7350fd8f"} Jul 06 21:03:06.756343 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:06.756278 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qqdbp/must-gather-qxkp8" podStartSLOduration=0.788377349 podStartE2EDuration="1.756256922s" totalImagesPullingTime="967.879573ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:03:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:03:06.755348123 +0000 UTC m=+1667.574493746" watchObservedRunningTime="2026-07-06 21:03:06.756256922 +0000 UTC m=+1667.575402530" Jul 06 21:03:07.897042 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:07.897014 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qrmdw_20f81617-cdb7-4364-b3de-43e1a7fc32d2/global-pull-secret-syncer/0.log" Jul 06 21:03:07.963492 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:07.963452 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" Jul 06 21:03:08.111296 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:08.111265 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-125.ec2.internal_73d7c4a409d43abc3672000c2f9d10d0/haproxy/0.log" Jul 06 21:03:10.494359 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:10.494314 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:10.585392 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:10.585353 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28l4w_634f80f3-2281-4cea-aa6d-d2d1062a85de/konnectivity-agent/0.log" limit=1024 Jul 06 21:03:12.083699 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:12.083629 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7a63c887-c164-4b8d-95c0-4e96093c0bfb/alertmanager/0.log" Jul 06 21:03:12.108006 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:12.107972 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7a63c887-c164-4b8d-95c0-4e96093c0bfb/config-reloader/0.log" Jul 06 21:03:12.135523 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:12.135469 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7a63c887-c164-4b8d-95c0-4e96093c0bfb/kube-rbac-proxy-web/0.log" Jul 06 21:03:12.162677 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:12.162637 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7a63c887-c164-4b8d-95c0-4e96093c0bfb/kube-rbac-proxy/0.log" Jul 06 21:03:12.192644 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:12.192609 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7a63c887-c164-4b8d-95c0-4e96093c0bfb/kube-rbac-proxy-metric/0.log" Jul 06 21:03:12.218013 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:12.217985 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7a63c887-c164-4b8d-95c0-4e96093c0bfb/prom-label-proxy/0.log" Jul 06 21:03:12.248328 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:12.248295 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7a63c887-c164-4b8d-95c0-4e96093c0bfb/init-config-reloader/0.log" Jul 06 21:03:12.316986 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:12.316902 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-zxt5d_372828ba-d419-4991-b2e8-9e6c9af1c721/kube-state-metrics/0.log" Jul 06 21:03:12.353346 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:12.353242 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-zxt5d_372828ba-d419-4991-b2e8-9e6c9af1c721/kube-rbac-proxy-main/0.log" Jul 06 21:03:12.377418 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:12.377382 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-zxt5d_372828ba-d419-4991-b2e8-9e6c9af1c721/kube-rbac-proxy-self/0.log" Jul 06 21:03:12.407491 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:12.407449 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-b994475cc-vqrpx_9ec690eb-a7db-4614-9f73-9b4b92b03efa/metrics-server/0.log" Jul 06 21:03:12.619445 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:12.619356 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k97nr_0100222c-1684-490f-ad7d-dcc4d32d5b68/node-exporter/0.log" Jul 06 21:03:12.643205 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:12.643166 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k97nr_0100222c-1684-490f-ad7d-dcc4d32d5b68/kube-rbac-proxy/0.log" Jul 06 21:03:12.670115 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:12.670072 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k97nr_0100222c-1684-490f-ad7d-dcc4d32d5b68/init-textfile/0.log" Jul 06 21:03:13.054584 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:13.054554 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d67c85646-t6sf8_582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d/telemeter-client/0.log" Jul 06 21:03:13.076540 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:13.076511 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d67c85646-t6sf8_582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d/reload/0.log" Jul 06 21:03:13.102662 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:13.102634 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d67c85646-t6sf8_582ffe32-b6ea-4aa0-9b55-c0e9ab24df6d/kube-rbac-proxy/0.log" Jul 06 21:03:13.134799 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:13.134742 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756b85c6b-55jjr_1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f/thanos-query/0.log" Jul 06 21:03:13.155610 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:13.155583 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756b85c6b-55jjr_1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f/kube-rbac-proxy-web/0.log" Jul 06 21:03:13.179637 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:13.179598 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756b85c6b-55jjr_1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f/kube-rbac-proxy/0.log" Jul 06 21:03:13.199968 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:13.199939 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756b85c6b-55jjr_1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f/prom-label-proxy/0.log" Jul 06 21:03:13.221883 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:13.221856 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756b85c6b-55jjr_1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f/kube-rbac-proxy-rules/0.log" Jul 06 21:03:13.243108 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:13.243057 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756b85c6b-55jjr_1545e5ac-f4a8-407c-8bb6-4e8ac6998f2f/kube-rbac-proxy-metrics/0.log" Jul 06 21:03:15.052949 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:15.052922 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-m8w66_7a829421-0363-40d1-941c-78b3f80a4f95/console-operator/2.log" Jul 06 21:03:15.061553 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:15.061527 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-m8w66_7a829421-0363-40d1-941c-78b3f80a4f95/console-operator/3.log" Jul 06 21:03:15.471584 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:15.471481 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c49dcddb6-jk6xc_b67b4b6e-cbc9-49c3-88ae-e4baac7b0436/console/0.log" Jul 06 21:03:15.503809 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:15.503755 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-dmhqf_cb326133-e833-4513-bb7c-3a8ab7dad1ed/download-server/0.log" Jul 06 21:03:16.204132 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.204097 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk"] Jul 06 21:03:16.210119 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.210093 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk" Jul 06 21:03:16.216379 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.216353 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk"] Jul 06 21:03:16.298700 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.298660 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/30592b02-af2b-40c9-a738-994e832f12f0-podres\") pod \"perf-node-gather-daemonset-m42rk\" (UID: \"30592b02-af2b-40c9-a738-994e832f12f0\") " pod="openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk" Jul 06 21:03:16.298906 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.298815 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30592b02-af2b-40c9-a738-994e832f12f0-sys\") pod \"perf-node-gather-daemonset-m42rk\" (UID: \"30592b02-af2b-40c9-a738-994e832f12f0\") " pod="openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk" Jul 06 21:03:16.298906 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.298845 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/30592b02-af2b-40c9-a738-994e832f12f0-proc\") pod \"perf-node-gather-daemonset-m42rk\" (UID: \"30592b02-af2b-40c9-a738-994e832f12f0\") " pod="openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk" Jul 06 21:03:16.298906 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.298881 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30592b02-af2b-40c9-a738-994e832f12f0-lib-modules\") pod \"perf-node-gather-daemonset-m42rk\" (UID: \"30592b02-af2b-40c9-a738-994e832f12f0\") " pod="openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk" Jul 06 21:03:16.299072 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.298956 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t94bx\" (UniqueName: \"kubernetes.io/projected/30592b02-af2b-40c9-a738-994e832f12f0-kube-api-access-t94bx\") pod \"perf-node-gather-daemonset-m42rk\" (UID: \"30592b02-af2b-40c9-a738-994e832f12f0\") " pod="openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk" Jul 06 21:03:16.399889 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.399854 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t94bx\" (UniqueName: \"kubernetes.io/projected/30592b02-af2b-40c9-a738-994e832f12f0-kube-api-access-t94bx\") pod \"perf-node-gather-daemonset-m42rk\" (UID: \"30592b02-af2b-40c9-a738-994e832f12f0\") " pod="openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk" Jul 06 21:03:16.400067 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.399949 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/30592b02-af2b-40c9-a738-994e832f12f0-podres\") pod \"perf-node-gather-daemonset-m42rk\" (UID: \"30592b02-af2b-40c9-a738-994e832f12f0\") " pod="openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk" Jul 06 21:03:16.400067 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.400003 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30592b02-af2b-40c9-a738-994e832f12f0-sys\") pod \"perf-node-gather-daemonset-m42rk\" (UID: \"30592b02-af2b-40c9-a738-994e832f12f0\") " pod="openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk" Jul 06 21:03:16.400067 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.400025 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/30592b02-af2b-40c9-a738-994e832f12f0-proc\") pod \"perf-node-gather-daemonset-m42rk\" (UID: \"30592b02-af2b-40c9-a738-994e832f12f0\") " pod="openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk" Jul 06 21:03:16.400067 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.400059 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30592b02-af2b-40c9-a738-994e832f12f0-lib-modules\") pod \"perf-node-gather-daemonset-m42rk\" (UID: \"30592b02-af2b-40c9-a738-994e832f12f0\") " pod="openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk" Jul 06 21:03:16.400245 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.400098 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30592b02-af2b-40c9-a738-994e832f12f0-sys\") pod \"perf-node-gather-daemonset-m42rk\" (UID: \"30592b02-af2b-40c9-a738-994e832f12f0\") " pod="openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk" Jul 06 21:03:16.400245 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.400118 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/30592b02-af2b-40c9-a738-994e832f12f0-podres\") pod \"perf-node-gather-daemonset-m42rk\" (UID: \"30592b02-af2b-40c9-a738-994e832f12f0\") " pod="openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk" Jul 06 21:03:16.400245 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.400168 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30592b02-af2b-40c9-a738-994e832f12f0-lib-modules\") pod \"perf-node-gather-daemonset-m42rk\" (UID: \"30592b02-af2b-40c9-a738-994e832f12f0\") " pod="openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk" Jul 06 21:03:16.400245 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.400169 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/30592b02-af2b-40c9-a738-994e832f12f0-proc\") pod \"perf-node-gather-daemonset-m42rk\" (UID: \"30592b02-af2b-40c9-a738-994e832f12f0\") " pod="openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk" Jul 06 21:03:16.408602 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.408570 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t94bx\" (UniqueName: \"kubernetes.io/projected/30592b02-af2b-40c9-a738-994e832f12f0-kube-api-access-t94bx\") pod \"perf-node-gather-daemonset-m42rk\" (UID: \"30592b02-af2b-40c9-a738-994e832f12f0\") " pod="openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk" Jul 06 21:03:16.522568 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.522488 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk" Jul 06 21:03:16.701190 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.701164 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk"] Jul 06 21:03:16.703834 ip-10-0-140-125 kubenswrapper[2577]: W0706 21:03:16.703797 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod30592b02_af2b_40c9_a738_994e832f12f0.slice/crio-276e2fb7fd9a98e49c75b57434b5410023bf858787a74e34d27ce1e3d95a9baa WatchSource:0}: Error finding container 276e2fb7fd9a98e49c75b57434b5410023bf858787a74e34d27ce1e3d95a9baa: Status 404 returned error can't find the container with id 276e2fb7fd9a98e49c75b57434b5410023bf858787a74e34d27ce1e3d95a9baa Jul 06 21:03:16.811813 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.811779 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk" event={"ID":"30592b02-af2b-40c9-a738-994e832f12f0","Type":"ContainerStarted","Data":"276e2fb7fd9a98e49c75b57434b5410023bf858787a74e34d27ce1e3d95a9baa"} Jul 06 21:03:16.921353 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.921322 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4dr8s_978b822b-4b60-4700-b98e-4ba141cdb13f/dns/0.log" Jul 06 21:03:16.942369 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:16.942339 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4dr8s_978b822b-4b60-4700-b98e-4ba141cdb13f/kube-rbac-proxy/0.log" Jul 06 21:03:17.073370 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:17.073341 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f8xd2_29c1a80a-f71a-441d-95e2-d93c4af98b05/dns-node-resolver/0.log" Jul 06 21:03:17.601581 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:17.601540 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8ff4bf4f9-xvtfv_bac992c3-4bdc-439b-967b-e2a2679e09a9/registry/0.log" Jul 06 21:03:17.643452 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:17.643416 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gvgt6_a71ef46f-aee4-4690-9668-324e344d1818/node-ca/0.log" Jul 06 21:03:17.818235 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:17.818187 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk" event={"ID":"30592b02-af2b-40c9-a738-994e832f12f0","Type":"ContainerStarted","Data":"332b632632ee970e835ccbb3659b3f2eba4edf1efebda69e376523805f38b7f5"} Jul 06 21:03:17.818409 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:17.818267 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk" Jul 06 21:03:17.834546 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:17.834502 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk" podStartSLOduration=1.834485761 podStartE2EDuration="1.834485761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:03:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:03:17.833705027 +0000 UTC m=+1678.652850635" watchObservedRunningTime="2026-07-06 21:03:17.834485761 +0000 UTC m=+1678.653631368" Jul 06 21:03:18.506835 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:18.506798 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7644b4cf9c-fh2wd_582026c2-9714-442b-8550-8a2da38ef9c3/router/0.log" Jul 06 21:03:18.876998 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:18.876976 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6vmbc_5f6abc31-2ae7-4ece-a13c-119c410ad425/serve-healthcheck-canary/0.log" Jul 06 21:03:19.235444 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:19.235354 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-hxgk7_2b9454b2-a95d-49b8-bd43-66f163c3cff8/insights-operator/1.log" Jul 06 21:03:19.238449 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:19.238419 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-hxgk7_2b9454b2-a95d-49b8-bd43-66f163c3cff8/insights-operator/0.log" Jul 06 21:03:19.333905 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:19.333872 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mjkbq_aa874fc4-b66f-482c-8b20-f34f1b796be3/kube-rbac-proxy/0.log" Jul 06 21:03:19.355268 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:19.355247 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mjkbq_aa874fc4-b66f-482c-8b20-f34f1b796be3/exporter/0.log" Jul 06 21:03:19.375179 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:19.375153 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mjkbq_aa874fc4-b66f-482c-8b20-f34f1b796be3/extractor/0.log" Jul 06 21:03:21.445634 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:21.445599 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-kgvvj_eab655aa-e2bf-4c83-b943-eb35856a5d59/manager/0.log" Jul 06 21:03:21.737630 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:21.737554 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-serving-67b7477c6d-8nq7l_f0bb51ff-2cc8-432b-8b37-080f072804d6/seaweedfs-tls-serving/0.log" Jul 06 21:03:23.836711 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:23.836683 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qqdbp/perf-node-gather-daemonset-m42rk" Jul 06 21:03:25.933058 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:25.933027 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-zwvls_32e64091-395a-4a73-b236-50ec25a430ce/kube-storage-version-migrator-operator/1.log" Jul 06 21:03:25.934702 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:25.934669 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-zwvls_32e64091-395a-4a73-b236-50ec25a430ce/kube-storage-version-migrator-operator/0.log" Jul 06 21:03:26.760588 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:26.760552 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hhlrw_edad7ba3-27f4-4301-a1e0-02ed562c8ca9/kube-multus-additional-cni-plugins/0.log" Jul 06 21:03:26.780273 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:26.780242 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hhlrw_edad7ba3-27f4-4301-a1e0-02ed562c8ca9/egress-router-binary-copy/0.log" Jul 06 21:03:26.799820 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:26.799792 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hhlrw_edad7ba3-27f4-4301-a1e0-02ed562c8ca9/cni-plugins/0.log" Jul 06 21:03:26.819368 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:26.819335 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hhlrw_edad7ba3-27f4-4301-a1e0-02ed562c8ca9/bond-cni-plugin/0.log" Jul 06 21:03:26.840474 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:26.840449 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hhlrw_edad7ba3-27f4-4301-a1e0-02ed562c8ca9/routeoverride-cni/0.log" Jul 06 21:03:26.859387 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:26.859360 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hhlrw_edad7ba3-27f4-4301-a1e0-02ed562c8ca9/whereabouts-cni-bincopy/0.log" Jul 06 21:03:26.877999 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:26.877968 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hhlrw_edad7ba3-27f4-4301-a1e0-02ed562c8ca9/whereabouts-cni/0.log" Jul 06 21:03:27.268997 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:27.268960 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xpwf2_216749c6-ecf4-44ab-a86c-a72f5d91747e/kube-multus/0.log" Jul 06 21:03:27.364262 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:27.364223 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sw6qp_e3eec97f-a1ba-4160-ab43-ce2fda50659b/network-metrics-daemon/0.log" Jul 06 21:03:27.381297 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:27.381262 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sw6qp_e3eec97f-a1ba-4160-ab43-ce2fda50659b/kube-rbac-proxy/0.log" Jul 06 21:03:28.300845 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:28.300819 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/ovn-controller/0.log" Jul 06 21:03:28.316525 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:28.316494 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/ovn-acl-logging/1.log" Jul 06 21:03:28.316525 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:28.316494 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/ovn-acl-logging/0.log" Jul 06 21:03:28.334954 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:28.334903 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/kube-rbac-proxy-node/0.log" Jul 06 21:03:28.352793 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:28.352745 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/kube-rbac-proxy-ovn-metrics/0.log" Jul 06 21:03:28.368185 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:28.368158 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/northd/0.log" Jul 06 21:03:28.388320 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:28.388289 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/nbdb/0.log" Jul 06 21:03:28.412732 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:28.412701 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/sbdb/0.log" Jul 06 21:03:28.470249 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:28.470216 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8722_a7932580-f409-41e2-b455-6391cdabe96f/ovnkube-controller/0.log" Jul 06 21:03:29.611786 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:29.611741 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-2w6mq_d4af3c2d-fc4f-4558-9f58-826f7ccc10f0/network-check-target-container/0.log" Jul 06 21:03:30.486686 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:30.486653 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-drdm6_dec8ac44-a1bb-46a0-b8df-f74d8f2eed41/iptables-alerter/0.log" Jul 06 21:03:31.126604 ip-10-0-140-125 kubenswrapper[2577]: I0706 21:03:31.126574 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-6g2rz_7e0461f6-131b-4abf-a2ba-aa052aaeab10/tuned/0.log"