Jul 08 16:34:24.244069 ip-10-0-141-103 systemd[1]: Starting Kubernetes Kubelet... Jul 08 16:34:25.772980 ip-10-0-141-103 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 16:34:25.772980 ip-10-0-141-103 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 16:34:25.772980 ip-10-0-141-103 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 16:34:25.772980 ip-10-0-141-103 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 16:34:25.772980 ip-10-0-141-103 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 16:34:25.774405 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.774328 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 16:34:25.779190 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779174 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:34:25.779190 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779189 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:34:25.779258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779193 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:34:25.779258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779196 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:34:25.779258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779199 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:34:25.779258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779202 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:34:25.779258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779205 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:34:25.779258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779208 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:34:25.779258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779210 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:34:25.779258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779213 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:34:25.779258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779217 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:34:25.779258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779220 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:34:25.779258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779222 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:34:25.779258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779225 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:34:25.779258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779227 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:34:25.779258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779231 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:34:25.779258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779241 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:34:25.779258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779244 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:34:25.779258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779246 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:34:25.779258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779251 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:34:25.779258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779255 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:34:25.779751 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779258 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:34:25.779751 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779262 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:34:25.779751 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779266 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:34:25.779751 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779269 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:34:25.779751 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779272 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:34:25.779751 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779276 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:34:25.779751 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779279 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:34:25.779751 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779281 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:34:25.779751 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779284 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:34:25.779751 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779287 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:34:25.779751 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779289 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:34:25.779751 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779292 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:34:25.779751 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779294 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:34:25.779751 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779297 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:34:25.779751 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779299 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:34:25.779751 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779302 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:34:25.779751 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779305 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:34:25.779751 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779309 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:34:25.779751 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779312 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:34:25.780232 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779314 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:34:25.780232 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779316 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:34:25.780232 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779319 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:34:25.780232 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779321 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:34:25.780232 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779324 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:34:25.780232 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779326 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:34:25.780232 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779329 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:34:25.780232 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779331 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:34:25.780232 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779333 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:34:25.780232 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779337 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:34:25.780232 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779339 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:34:25.780232 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779342 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:34:25.780232 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779344 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:34:25.780232 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779347 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:34:25.780232 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779350 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:34:25.780232 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779353 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:34:25.780232 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779355 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:34:25.780232 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779357 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:34:25.780232 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779360 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:34:25.780232 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779362 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:34:25.780706 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779365 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:34:25.780706 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779367 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:34:25.780706 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779370 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:34:25.780706 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779372 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:34:25.780706 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779375 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:34:25.780706 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779377 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:34:25.780706 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779379 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:34:25.780706 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779382 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:34:25.780706 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779385 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:34:25.780706 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779387 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:34:25.780706 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779390 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:34:25.780706 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779393 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:34:25.780706 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779395 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:34:25.780706 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779398 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:34:25.780706 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779400 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:34:25.780706 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779402 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:34:25.780706 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779406 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:34:25.780706 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779408 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:34:25.780706 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779411 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:34:25.781189 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779413 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:34:25.781189 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779416 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:34:25.781189 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779418 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:34:25.781189 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779421 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:34:25.781189 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779423 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:34:25.781189 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779426 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:34:25.781189 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779428 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:34:25.781189 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779434 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:34:25.781189 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779437 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:34:25.781189 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779439 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:34:25.781189 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779442 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:34:25.781189 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779445 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:34:25.781189 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779447 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:34:25.781189 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779450 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:34:25.781189 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779452 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:34:25.781189 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779455 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:34:25.781189 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779457 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:34:25.781189 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779460 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:34:25.781189 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779463 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:34:25.781189 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.779465 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:34:25.784378 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784354 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:34:25.784378 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784370 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:34:25.784378 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784374 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:34:25.784378 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784377 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:34:25.784378 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784380 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:34:25.784378 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784383 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:34:25.784378 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784386 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:34:25.784378 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784388 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:34:25.784664 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784393 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:34:25.784664 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784396 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:34:25.784664 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784399 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:34:25.784664 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784401 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:34:25.784664 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784404 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:34:25.784664 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784407 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:34:25.784664 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784409 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:34:25.784664 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784411 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:34:25.784664 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784414 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:34:25.784664 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784416 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:34:25.784664 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784419 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:34:25.784664 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784422 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:34:25.784664 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784424 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:34:25.784664 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784427 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:34:25.784664 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784429 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:34:25.784664 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784432 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:34:25.784664 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784434 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:34:25.784664 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784440 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:34:25.784664 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784442 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:34:25.784664 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784447 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:34:25.785197 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784450 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:34:25.785197 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784454 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:34:25.785197 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784457 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:34:25.785197 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784459 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:34:25.785197 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784462 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:34:25.785197 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784465 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:34:25.785197 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784468 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:34:25.785197 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784470 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:34:25.785197 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784473 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:34:25.785197 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784475 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:34:25.785197 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784479 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:34:25.785197 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784481 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:34:25.785197 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784485 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:34:25.785197 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784488 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:34:25.785197 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784491 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:34:25.785197 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784493 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:34:25.785197 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784496 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:34:25.785197 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784499 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:34:25.785197 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784501 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:34:25.785197 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784503 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:34:25.785683 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784506 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:34:25.785683 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784509 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:34:25.785683 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784511 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:34:25.785683 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784514 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:34:25.785683 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784516 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:34:25.785683 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784519 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:34:25.785683 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784521 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:34:25.785683 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784524 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:34:25.785683 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784527 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:34:25.785683 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784530 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:34:25.785683 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784532 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:34:25.785683 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784535 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:34:25.785683 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784537 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:34:25.785683 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784540 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:34:25.785683 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784542 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:34:25.785683 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784545 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:34:25.785683 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784547 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:34:25.785683 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784549 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:34:25.785683 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784552 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:34:25.786178 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784554 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:34:25.786178 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784557 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:34:25.786178 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784559 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:34:25.786178 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784562 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:34:25.786178 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784564 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:34:25.786178 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784568 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:34:25.786178 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784570 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:34:25.786178 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784573 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:34:25.786178 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784575 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:34:25.786178 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784578 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:34:25.786178 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784582 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:34:25.786178 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784586 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:34:25.786178 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784590 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:34:25.786178 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784592 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:34:25.786178 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784596 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:34:25.786178 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784598 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:34:25.786178 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784608 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:34:25.786178 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784611 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:34:25.786178 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784613 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:34:25.786178 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784616 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:34:25.786669 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784619 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:34:25.786669 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784621 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:34:25.786669 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784624 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:34:25.786669 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784626 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:34:25.786669 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784629 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:34:25.786669 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784631 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:34:25.786669 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784634 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:34:25.786669 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784637 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:34:25.786669 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784641 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:34:25.786669 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784643 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:34:25.786669 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784647 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:34:25.786669 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.784650 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:34:25.786669 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785078 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:34:25.786669 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785084 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:34:25.786669 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785087 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:34:25.786669 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785092 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:34:25.786669 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785095 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:34:25.786669 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785098 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:34:25.786669 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785103 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:34:25.787136 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785106 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:34:25.787136 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785110 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:34:25.787136 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785114 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:34:25.787136 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785117 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:34:25.787136 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785120 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:34:25.787136 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785123 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:34:25.787136 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785125 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:34:25.787136 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785128 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:34:25.787136 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785130 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:34:25.787136 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785140 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:34:25.787136 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785143 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:34:25.787136 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785145 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:34:25.787136 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785148 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:34:25.787136 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785150 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:34:25.787136 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785153 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:34:25.787136 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785155 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:34:25.787136 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785158 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:34:25.787136 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785160 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:34:25.787136 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785163 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:34:25.787586 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785165 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:34:25.787586 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785168 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:34:25.787586 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785170 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:34:25.787586 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785173 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:34:25.787586 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785175 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:34:25.787586 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785178 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:34:25.787586 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785182 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:34:25.787586 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785186 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:34:25.787586 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785189 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:34:25.787586 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785192 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:34:25.787586 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785194 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:34:25.787586 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785197 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:34:25.787586 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785200 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:34:25.787586 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785203 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:34:25.787586 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785206 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:34:25.787586 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785208 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:34:25.787586 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785211 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:34:25.787586 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785214 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:34:25.787586 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785216 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:34:25.787586 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785219 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:34:25.788081 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785221 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:34:25.788081 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785224 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:34:25.788081 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785226 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:34:25.788081 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785234 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:34:25.788081 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785237 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:34:25.788081 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785239 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:34:25.788081 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785242 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:34:25.788081 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785244 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:34:25.788081 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785247 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:34:25.788081 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785249 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:34:25.788081 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785252 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:34:25.788081 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785254 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:34:25.788081 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785257 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:34:25.788081 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785259 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:34:25.788081 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785261 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:34:25.788081 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785264 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:34:25.788081 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785266 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:34:25.788081 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785270 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:34:25.788081 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785273 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:34:25.788081 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785275 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:34:25.788560 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785278 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:34:25.788560 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785280 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:34:25.788560 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785282 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:34:25.788560 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785285 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:34:25.788560 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785288 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:34:25.788560 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785291 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:34:25.788560 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785293 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:34:25.788560 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785296 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:34:25.788560 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785298 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:34:25.788560 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785301 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:34:25.788560 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785303 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:34:25.788560 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785306 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:34:25.788560 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785308 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:34:25.788560 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785310 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:34:25.788560 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785313 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:34:25.788560 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785315 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:34:25.788560 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785324 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:34:25.788560 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785326 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:34:25.788560 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785329 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:34:25.788560 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785331 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:34:25.789110 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785333 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:34:25.789110 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785336 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:34:25.789110 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785338 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:34:25.789110 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785341 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:34:25.789110 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785343 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:34:25.789110 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785345 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:34:25.789110 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785348 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:34:25.789110 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785350 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:34:25.789110 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785353 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:34:25.789110 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785355 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:34:25.789110 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785358 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:34:25.789110 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785361 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:34:25.789110 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.785363 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:34:25.789110 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785429 2573 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 16:34:25.789110 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785436 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 16:34:25.789110 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785449 2573 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 16:34:25.789110 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785453 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 16:34:25.789110 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785458 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 16:34:25.789110 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785461 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 16:34:25.789110 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785465 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 16:34:25.789110 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785469 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785472 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785475 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785478 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785481 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785484 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785487 2573 flags.go:64] FLAG: --cgroup-root="" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785490 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785493 2573 flags.go:64] FLAG: --client-ca-file="" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785501 2573 flags.go:64] FLAG: --cloud-provider="external" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785504 2573 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785511 2573 flags.go:64] FLAG: --cluster-domain="" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785513 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785516 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785519 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785522 2573 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785526 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785529 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785532 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785535 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785538 2573 flags.go:64] FLAG: --contention-profiling="false" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785541 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785544 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785547 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 16:34:25.789609 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785550 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785554 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785557 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785560 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785563 2573 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785566 2573 flags.go:64] FLAG: --enable-server="true" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785569 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785576 2573 flags.go:64] FLAG: --event-burst="100" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785579 2573 flags.go:64] FLAG: --event-qps="50" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785582 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785585 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785588 2573 flags.go:64] FLAG: --eviction-hard="" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785591 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785594 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785597 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785600 2573 flags.go:64] FLAG: --eviction-soft="" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785603 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785606 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785614 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785617 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785621 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785624 2573 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785627 2573 flags.go:64] FLAG: --feature-gates="" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785634 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785637 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 16:34:25.790191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785640 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785643 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785646 2573 flags.go:64] FLAG: --healthz-port="10248" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785649 2573 flags.go:64] FLAG: --help="false" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785651 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-141-103.ec2.internal" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785655 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785658 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785660 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785664 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785667 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785669 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785672 2573 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785675 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785678 2573 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785681 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785684 2573 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785687 2573 flags.go:64] FLAG: --kube-reserved="" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785689 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785692 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785695 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785698 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785701 2573 flags.go:64] FLAG: --lock-file="" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785703 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785706 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 16:34:25.790815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785709 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785714 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785724 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785727 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785730 2573 flags.go:64] FLAG: --logging-format="text" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785735 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785738 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785740 2573 flags.go:64] FLAG: --manifest-url="" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785743 2573 flags.go:64] FLAG: --manifest-url-header="" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785747 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785750 2573 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785754 2573 flags.go:64] FLAG: --max-pods="110" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785757 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785760 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785763 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785766 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785769 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785771 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785774 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785781 2573 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785784 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785787 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785789 2573 flags.go:64] FLAG: --pod-cidr="" Jul 08 16:34:25.791429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785792 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785797 2573 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785800 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785803 2573 flags.go:64] FLAG: --pods-per-core="0" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785806 2573 flags.go:64] FLAG: --port="10250" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785808 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785811 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00e8c308616d88f51" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785814 2573 flags.go:64] FLAG: --qos-reserved="" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785817 2573 flags.go:64] FLAG: --read-only-port="10255" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785820 2573 flags.go:64] FLAG: --register-node="true" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785822 2573 flags.go:64] FLAG: --register-with-taints="" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785826 2573 flags.go:64] FLAG: --registry-burst="10" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785834 2573 flags.go:64] FLAG: --registry-qps="5" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785837 2573 flags.go:64] FLAG: --reserved-cpus="" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785841 2573 flags.go:64] FLAG: --reserved-memory="" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785844 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785847 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785850 2573 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785853 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785855 2573 flags.go:64] FLAG: --runonce="false" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785858 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785861 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785864 2573 flags.go:64] FLAG: --seccomp-default="false" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785866 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785871 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785874 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 16:34:25.792004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785877 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785880 2573 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785883 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785902 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785905 2573 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785908 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785910 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785913 2573 flags.go:64] FLAG: --system-cgroups="" Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785916 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785922 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785925 2573 flags.go:64] FLAG: --tls-cert-file="" Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785927 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785934 2573 flags.go:64] FLAG: --tls-min-version="" Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785937 2573 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785940 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785942 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785945 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785948 2573 flags.go:64] FLAG: --v="2" Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785951 2573 flags.go:64] FLAG: --version="false" Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785956 2573 flags.go:64] FLAG: --vmodule="" Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785962 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.785965 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786075 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786079 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:34:25.792663 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786082 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:34:25.793258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786085 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:34:25.793258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786088 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:34:25.793258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786090 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:34:25.793258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786093 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:34:25.793258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786096 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:34:25.793258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786100 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:34:25.793258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786103 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:34:25.793258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786105 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:34:25.793258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786108 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:34:25.793258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786111 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:34:25.793258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786114 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:34:25.793258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786116 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:34:25.793258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786119 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:34:25.793258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786121 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:34:25.793258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786124 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:34:25.793258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786126 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:34:25.793258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786129 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:34:25.793258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786131 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:34:25.793258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786134 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:34:25.793258 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786137 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:34:25.793729 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786139 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:34:25.793729 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786141 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:34:25.793729 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786144 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:34:25.793729 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786146 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:34:25.793729 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786149 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:34:25.793729 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786152 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:34:25.793729 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786154 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:34:25.793729 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786158 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:34:25.793729 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786161 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:34:25.793729 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786163 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:34:25.793729 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786166 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:34:25.793729 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786168 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:34:25.793729 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786172 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:34:25.793729 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786176 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:34:25.793729 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786179 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:34:25.793729 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786182 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:34:25.793729 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786184 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:34:25.793729 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786189 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:34:25.793729 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786192 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:34:25.794229 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786194 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:34:25.794229 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786198 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:34:25.794229 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786201 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:34:25.794229 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786204 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:34:25.794229 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786207 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:34:25.794229 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786210 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:34:25.794229 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786213 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:34:25.794229 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786216 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:34:25.794229 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786219 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:34:25.794229 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786222 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:34:25.794229 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786224 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:34:25.794229 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786227 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:34:25.794229 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786230 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:34:25.794229 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786233 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:34:25.794229 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786236 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:34:25.794229 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786238 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:34:25.794229 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786241 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:34:25.794229 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786243 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:34:25.794229 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786246 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:34:25.794681 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786248 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:34:25.794681 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786252 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:34:25.794681 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786256 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:34:25.794681 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786258 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:34:25.794681 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786261 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:34:25.794681 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786263 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:34:25.794681 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786266 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:34:25.794681 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786268 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:34:25.794681 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786271 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:34:25.794681 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786273 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:34:25.794681 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786276 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:34:25.794681 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786279 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:34:25.794681 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786282 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:34:25.794681 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786285 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:34:25.794681 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786287 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:34:25.794681 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786290 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:34:25.794681 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786293 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:34:25.794681 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786296 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:34:25.794681 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786299 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:34:25.794681 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786302 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:34:25.795224 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786304 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:34:25.795224 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786306 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:34:25.795224 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786309 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:34:25.795224 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786311 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:34:25.795224 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786314 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:34:25.795224 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786316 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:34:25.795224 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786318 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:34:25.795224 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786321 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:34:25.795224 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786323 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:34:25.795224 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786326 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:34:25.795224 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786329 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:34:25.795224 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786331 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:34:25.795224 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786333 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:34:25.795224 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786337 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:34:25.795224 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786340 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:34:25.795224 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786343 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:34:25.795224 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786345 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:34:25.795224 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.786348 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:34:25.795656 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.786353 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 16:34:25.795656 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.792752 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 16:34:25.795656 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.792770 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 16:34:25.795656 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.793528 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 16:34:25.795656 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.793535 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 16:34:25.795656 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793593 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:34:25.795656 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793598 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:34:25.795656 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793602 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:34:25.795656 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793605 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:34:25.795656 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793608 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:34:25.795656 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793611 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:34:25.795656 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793614 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:34:25.795656 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793617 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:34:25.795656 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793620 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:34:25.796025 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793622 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:34:25.796025 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793625 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:34:25.796025 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793627 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:34:25.796025 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793630 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:34:25.796025 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793633 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:34:25.796025 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793635 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:34:25.796025 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793638 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:34:25.796025 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793640 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:34:25.796025 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793643 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:34:25.796025 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793645 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:34:25.796025 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793648 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:34:25.796025 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793650 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:34:25.796025 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793653 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:34:25.796025 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793655 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:34:25.796025 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793658 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:34:25.796025 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793664 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:34:25.796025 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793667 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:34:25.796025 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793670 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:34:25.796025 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793672 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:34:25.796025 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793675 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:34:25.796498 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793678 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:34:25.796498 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793681 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:34:25.796498 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793683 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:34:25.796498 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793688 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:34:25.796498 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793691 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:34:25.796498 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793694 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:34:25.796498 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793697 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:34:25.796498 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793700 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:34:25.796498 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793703 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:34:25.796498 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793706 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:34:25.796498 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793708 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:34:25.796498 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793711 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:34:25.796498 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793713 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:34:25.796498 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793716 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:34:25.796498 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793718 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:34:25.796498 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793721 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:34:25.796498 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793724 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:34:25.796498 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793726 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:34:25.796498 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793729 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:34:25.796985 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793732 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:34:25.796985 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793735 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:34:25.796985 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793737 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:34:25.796985 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793740 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:34:25.796985 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793743 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:34:25.796985 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793745 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:34:25.796985 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793748 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:34:25.796985 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793750 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:34:25.796985 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793753 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:34:25.796985 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793756 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:34:25.796985 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793759 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:34:25.796985 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793761 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:34:25.796985 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793764 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:34:25.796985 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793767 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:34:25.796985 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793770 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:34:25.796985 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793773 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:34:25.796985 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793775 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:34:25.796985 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793778 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:34:25.796985 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793780 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:34:25.796985 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793783 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:34:25.797521 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793786 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:34:25.797521 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793788 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:34:25.797521 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793791 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:34:25.797521 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793793 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:34:25.797521 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793796 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:34:25.797521 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793799 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:34:25.797521 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793801 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:34:25.797521 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793804 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:34:25.797521 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793806 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:34:25.797521 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793808 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:34:25.797521 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793811 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:34:25.797521 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793814 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:34:25.797521 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793818 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:34:25.797521 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793821 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:34:25.797521 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793823 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:34:25.797521 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793826 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:34:25.797521 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793829 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:34:25.797521 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793831 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:34:25.797521 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793834 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:34:25.797521 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793836 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:34:25.798048 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793839 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:34:25.798048 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793843 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:34:25.798048 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793847 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:34:25.798048 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793850 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:34:25.798048 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793852 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:34:25.798048 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793856 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:34:25.798048 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793858 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:34:25.798048 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793861 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:34:25.798048 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793864 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:34:25.798048 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793866 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:34:25.798048 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.793869 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:34:25.798048 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.793873 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 16:34:25.798048 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794022 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:34:25.798048 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794027 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:34:25.798048 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794030 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:34:25.798423 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794033 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:34:25.798423 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794036 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:34:25.798423 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794039 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:34:25.798423 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794041 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:34:25.798423 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794044 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:34:25.798423 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794047 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:34:25.798423 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794049 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:34:25.798423 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794052 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:34:25.798423 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794054 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:34:25.798423 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794057 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:34:25.798423 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794059 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:34:25.798423 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794062 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:34:25.798423 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794064 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:34:25.798423 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794067 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:34:25.798423 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794069 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:34:25.798423 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794072 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:34:25.798423 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794075 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:34:25.798423 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794078 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:34:25.798423 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794081 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:34:25.798423 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794083 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:34:25.798937 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794086 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:34:25.798937 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794090 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:34:25.798937 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794093 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:34:25.798937 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794096 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:34:25.798937 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794098 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:34:25.798937 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794101 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:34:25.798937 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794103 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:34:25.798937 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794106 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:34:25.798937 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794108 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:34:25.798937 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794111 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:34:25.798937 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794114 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:34:25.798937 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794116 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:34:25.798937 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794119 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:34:25.798937 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794121 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:34:25.798937 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794124 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:34:25.798937 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794127 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:34:25.798937 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794129 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:34:25.798937 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794132 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:34:25.798937 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794134 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:34:25.799389 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794137 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:34:25.799389 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794139 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:34:25.799389 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794141 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:34:25.799389 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794144 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:34:25.799389 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794146 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:34:25.799389 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794149 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:34:25.799389 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794151 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:34:25.799389 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794155 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:34:25.799389 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794158 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:34:25.799389 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794161 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:34:25.799389 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794163 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:34:25.799389 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794166 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:34:25.799389 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794168 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:34:25.799389 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794171 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:34:25.799389 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794175 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:34:25.799389 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794177 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:34:25.799389 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794180 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:34:25.799389 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794182 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:34:25.799389 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794185 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:34:25.799389 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794187 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:34:25.799899 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794190 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:34:25.799899 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794192 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:34:25.799899 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794196 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:34:25.799899 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794199 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:34:25.799899 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794202 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:34:25.799899 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794205 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:34:25.799899 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794208 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:34:25.799899 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794211 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:34:25.799899 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794214 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:34:25.799899 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794216 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:34:25.799899 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794219 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:34:25.799899 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794221 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:34:25.799899 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794223 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:34:25.799899 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794226 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:34:25.799899 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794229 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:34:25.799899 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794233 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:34:25.799899 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794236 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:34:25.799899 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794239 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:34:25.799899 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794242 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:34:25.800364 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794244 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:34:25.800364 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794247 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:34:25.800364 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794250 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:34:25.800364 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794252 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:34:25.800364 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794255 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:34:25.800364 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794257 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:34:25.800364 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794260 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:34:25.800364 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794262 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:34:25.800364 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794265 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:34:25.800364 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794268 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:34:25.800364 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794270 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:34:25.800364 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794273 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:34:25.800364 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794276 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:34:25.800364 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794278 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:34:25.800364 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794281 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:34:25.800364 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794283 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:34:25.800364 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794286 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:34:25.800364 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:25.794288 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:34:25.800787 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.794293 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 16:34:25.800787 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.794385 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 16:34:25.800787 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.797068 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 16:34:25.800787 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.798649 2573 server.go:1019] "Starting client certificate rotation" Jul 08 16:34:25.800787 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.798750 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 16:34:25.800787 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.798781 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 16:34:25.801477 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.801464 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 16:34:25.802923 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.802902 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 16:34:25.809646 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.809628 2573 log.go:25] "Validated CRI v1 runtime API" Jul 08 16:34:25.811539 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.811527 2573 log.go:25] "Validated CRI v1 image API" Jul 08 16:34:25.812338 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.812312 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 16:34:25.815931 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.815907 2573 fs.go:135] Filesystem UUIDs: map[51a1391d-8d73-4eb8-af6c-c1f16f1b1ff7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cc400cf0-8c89-40be-bfda-acf5b2623f26:/dev/nvme0n1p4] Jul 08 16:34:25.815995 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.815930 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 16:34:25.821636 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.821527 2573 manager.go:216] Machine: {Timestamp:2026-07-08 16:34:25.821045741 +0000 UTC m=+0.369069470 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099691 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a23e46f6b88f06388df7b3eef2f6d SystemUUID:ec2a23e4-6f6b-88f0-6388-df7b3eef2f6d BootID:dd1d3cf2-14cc-4a6d-ad4c-a4679bf6e3ae Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1a:2d:42:b0:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1a:2d:42:b0:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:b9:e3:31:fe:2e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 16:34:25.821636 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.821624 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 16:34:25.821773 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.821692 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 16:34:25.825118 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.825091 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 16:34:25.825259 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.825121 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-103.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 16:34:25.825837 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.825828 2573 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 16:34:25.825866 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.825839 2573 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 16:34:25.825866 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.825846 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 16:34:25.825866 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.825859 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 16:34:25.827116 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.827106 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 16:34:25.831191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.831179 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 08 16:34:25.831315 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.831305 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 16:34:25.832064 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.832054 2573 kubelet.go:486] "Attempting to sync node with API server" Jul 08 16:34:25.832101 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.832073 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 16:34:25.832101 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.832087 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 16:34:25.832101 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.832095 2573 kubelet.go:398] "Adding apiserver pod source" Jul 08 16:34:25.832213 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.832103 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 16:34:25.832425 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.832414 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 16:34:25.832453 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.832432 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 16:34:25.834767 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.834752 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 16:34:25.836495 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.836482 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 16:34:25.836557 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.836511 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 16:34:25.838216 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.838201 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 16:34:25.838216 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.838217 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 16:34:25.838319 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.838224 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 16:34:25.838319 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.838229 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 16:34:25.838319 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.838238 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 16:34:25.838319 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.838244 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 16:34:25.838319 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.838251 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 16:34:25.838319 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.838256 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 16:34:25.838319 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.838262 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 16:34:25.838319 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.838268 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 16:34:25.838319 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.838277 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 16:34:25.838319 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.838283 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 16:34:25.838958 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.838947 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 16:34:25.838958 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.838959 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 16:34:25.840964 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.840943 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 16:34:25.842057 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.842041 2573 server.go:1268] "Started kubelet" Jul 08 16:34:25.842174 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.842127 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 16:34:25.842951 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.842856 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 16:34:25.842972 ip-10-0-141-103 systemd[1]: Started Kubernetes Kubelet. Jul 08 16:34:25.843091 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.843037 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 16:34:25.843303 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:25.843276 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 16:34:25.844976 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:25.844407 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-103.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 16:34:25.845236 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.845200 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-103.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 16:34:25.846073 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.846035 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 16:34:25.846343 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.846331 2573 server.go:310] "Adding debug handlers to kubelet server" Jul 08 16:34:25.848338 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:25.848318 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 16:34:25.850354 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:25.849239 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-103.ec2.internal.18c05db0ad4f9933 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-103.ec2.internal,UID:ip-10-0-141-103.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-103.ec2.internal,},FirstTimestamp:2026-07-08 16:34:25.842018611 +0000 UTC m=+0.390042338,LastTimestamp:2026-07-08 16:34:25.842018611 +0000 UTC m=+0.390042338,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-103.ec2.internal,}" Jul 08 16:34:25.852162 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.852127 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 16:34:25.852278 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.852137 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 16:34:25.852829 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:25.852803 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-103.ec2.internal\" not found" Jul 08 16:34:25.853352 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.853330 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 16:34:25.853486 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.853456 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 16:34:25.853552 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.853491 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 16:34:25.853663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.853650 2573 reconstruct.go:97] "Volume reconstruction finished" Jul 08 16:34:25.853716 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.853664 2573 reconciler.go:29] "Reconciler: start to sync state" Jul 08 16:34:25.854009 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.853992 2573 factory.go:55] Registering systemd factory Jul 08 16:34:25.854009 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.854010 2573 factory.go:223] Registration of the systemd container factory successfully Jul 08 16:34:25.854270 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.854258 2573 factory.go:153] Registering CRI-O factory Jul 08 16:34:25.854270 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.854271 2573 factory.go:223] Registration of the crio container factory successfully Jul 08 16:34:25.854387 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.854309 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 16:34:25.854387 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.854339 2573 factory.go:103] Registering Raw factory Jul 08 16:34:25.854387 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.854355 2573 manager.go:1196] Started watching for new ooms in manager Jul 08 16:34:25.854934 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.854918 2573 manager.go:349] Starting recovery of all containers Jul 08 16:34:25.858363 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:25.858335 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 16:34:25.858456 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:25.858418 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-103.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 16:34:25.864033 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.863932 2573 manager.go:354] Recovery completed Jul 08 16:34:25.867884 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.867867 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:34:25.869561 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.869538 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-103.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:34:25.869635 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.869576 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-103.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:34:25.869635 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.869590 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-103.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:34:25.870093 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.870076 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 16:34:25.870093 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.870091 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 16:34:25.870184 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.870108 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 08 16:34:25.870184 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.870093 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:34:25.870762 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.870749 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-103.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:34:25.870820 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.870771 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-103.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:34:25.870820 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.870780 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-103.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:34:25.871975 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:25.871904 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-103.ec2.internal.18c05db0aef3da3a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-103.ec2.internal,UID:ip-10-0-141-103.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-103.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-103.ec2.internal,},FirstTimestamp:2026-07-08 16:34:25.869560378 +0000 UTC m=+0.417584110,LastTimestamp:2026-07-08 16:34:25.869560378 +0000 UTC m=+0.417584110,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-103.ec2.internal,}" Jul 08 16:34:25.872242 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.872231 2573 policy_none.go:49] "None policy: Start" Jul 08 16:34:25.872272 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.872247 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 16:34:25.872272 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.872256 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 16:34:25.874117 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.874105 2573 policy_none.go:47] "Start" Jul 08 16:34:25.880206 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:25.880130 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-103.ec2.internal.18c05db0aef43104 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-103.ec2.internal,UID:ip-10-0-141-103.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-103.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-103.ec2.internal,},FirstTimestamp:2026-07-08 16:34:25.869582596 +0000 UTC m=+0.417606324,LastTimestamp:2026-07-08 16:34:25.869582596 +0000 UTC m=+0.417606324,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-103.ec2.internal,}" Jul 08 16:34:25.890912 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:25.890836 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-103.ec2.internal.18c05db0aef464b2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-103.ec2.internal,UID:ip-10-0-141-103.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-103.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-103.ec2.internal,},FirstTimestamp:2026-07-08 16:34:25.869595826 +0000 UTC m=+0.417619555,LastTimestamp:2026-07-08 16:34:25.869595826 +0000 UTC m=+0.417619555,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-103.ec2.internal,}" Jul 08 16:34:25.894321 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.894302 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ww2v8" Jul 08 16:34:25.902227 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:25.902168 2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-103.ec2.internal.18c05db0aef3da3a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-103.ec2.internal.18c05db0aef3da3a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-103.ec2.internal,UID:ip-10-0-141-103.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-103.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-103.ec2.internal,},FirstTimestamp:2026-07-08 16:34:25.869560378 +0000 UTC m=+0.417584110,LastTimestamp:2026-07-08 16:34:25.870759963 +0000 UTC m=+0.418783690,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-103.ec2.internal,}" Jul 08 16:34:25.902715 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.902699 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ww2v8" Jul 08 16:34:25.908412 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.908397 2573 manager.go:337] "Starting Device Plugin manager" Jul 08 16:34:25.908461 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:25.908427 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 16:34:25.908461 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.908436 2573 server.go:87] "Starting device plugin registration server" Jul 08 16:34:25.908655 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.908643 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 16:34:25.908699 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.908658 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 16:34:25.908759 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.908741 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 16:34:25.908866 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.908851 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 16:34:25.908956 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.908867 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 16:34:25.909275 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:25.909259 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 16:34:25.909328 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:25.909301 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-103.ec2.internal\" not found" Jul 08 16:34:25.989100 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.989061 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 16:34:25.991027 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.990225 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 16:34:25.991027 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.990256 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 16:34:25.991027 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.990277 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 16:34:25.991027 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:25.990304 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 16:34:25.992753 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:25.992735 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 16:34:26.009758 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.009743 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:34:26.010799 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.010781 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-103.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:34:26.010861 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.010814 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-103.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:34:26.010861 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.010826 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-103.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:34:26.010861 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.010848 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-103.ec2.internal" Jul 08 16:34:26.020568 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.020555 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-103.ec2.internal" Jul 08 16:34:26.020619 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:26.020575 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-103.ec2.internal\": node \"ip-10-0-141-103.ec2.internal\" not found" Jul 08 16:34:26.055641 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:26.055597 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-103.ec2.internal\" not found" Jul 08 16:34:26.090484 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.090465 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-103.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-103.ec2.internal"] Jul 08 16:34:26.090567 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.090519 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:34:26.091329 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.091310 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-103.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:34:26.091402 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.091338 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-103.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:34:26.091402 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.091348 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-103.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:34:26.093370 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.093359 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:34:26.093491 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.093477 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-103.ec2.internal" Jul 08 16:34:26.093534 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.093509 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:34:26.094014 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.093993 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-103.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:34:26.094014 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.094004 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-103.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:34:26.094014 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.094017 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-103.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:34:26.094203 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.094026 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-103.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:34:26.094203 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.094041 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-103.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:34:26.094203 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.094028 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-103.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:34:26.096073 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.096060 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-103.ec2.internal" Jul 08 16:34:26.096128 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.096085 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:34:26.096658 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.096644 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-103.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:34:26.096718 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.096673 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-103.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:34:26.096718 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.096684 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-103.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:34:26.119448 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:26.119431 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-103.ec2.internal\" not found" node="ip-10-0-141-103.ec2.internal" Jul 08 16:34:26.123770 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:26.123747 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-103.ec2.internal\" not found" node="ip-10-0-141-103.ec2.internal" Jul 08 16:34:26.154240 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.154220 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/60c3f5bb8bb39a45b6e87f698f42daba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-103.ec2.internal\" (UID: \"60c3f5bb8bb39a45b6e87f698f42daba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-103.ec2.internal" Jul 08 16:34:26.154316 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.154242 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60c3f5bb8bb39a45b6e87f698f42daba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-103.ec2.internal\" (UID: \"60c3f5bb8bb39a45b6e87f698f42daba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-103.ec2.internal" Jul 08 16:34:26.154316 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.154258 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b852df87ea15bc3486a84b15999fcc65-config\") pod \"kube-apiserver-proxy-ip-10-0-141-103.ec2.internal\" (UID: \"b852df87ea15bc3486a84b15999fcc65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-103.ec2.internal" Jul 08 16:34:26.155786 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:26.155772 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-103.ec2.internal\" not found" Jul 08 16:34:26.255052 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.255026 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/60c3f5bb8bb39a45b6e87f698f42daba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-103.ec2.internal\" (UID: \"60c3f5bb8bb39a45b6e87f698f42daba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-103.ec2.internal" Jul 08 16:34:26.255052 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.255053 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60c3f5bb8bb39a45b6e87f698f42daba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-103.ec2.internal\" (UID: \"60c3f5bb8bb39a45b6e87f698f42daba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-103.ec2.internal" Jul 08 16:34:26.255216 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.255069 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b852df87ea15bc3486a84b15999fcc65-config\") pod \"kube-apiserver-proxy-ip-10-0-141-103.ec2.internal\" (UID: \"b852df87ea15bc3486a84b15999fcc65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-103.ec2.internal" Jul 08 16:34:26.255216 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.255108 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b852df87ea15bc3486a84b15999fcc65-config\") pod \"kube-apiserver-proxy-ip-10-0-141-103.ec2.internal\" (UID: \"b852df87ea15bc3486a84b15999fcc65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-103.ec2.internal" Jul 08 16:34:26.255216 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.255132 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/60c3f5bb8bb39a45b6e87f698f42daba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-103.ec2.internal\" (UID: \"60c3f5bb8bb39a45b6e87f698f42daba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-103.ec2.internal" Jul 08 16:34:26.255216 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.255141 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60c3f5bb8bb39a45b6e87f698f42daba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-103.ec2.internal\" (UID: \"60c3f5bb8bb39a45b6e87f698f42daba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-103.ec2.internal" Jul 08 16:34:26.256071 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:26.256056 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-103.ec2.internal\" not found" Jul 08 16:34:26.356741 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:26.356722 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-103.ec2.internal\" not found" Jul 08 16:34:26.421936 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.421886 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-103.ec2.internal" Jul 08 16:34:26.426805 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.426632 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-103.ec2.internal" Jul 08 16:34:26.457301 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:26.457271 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-103.ec2.internal\" not found" Jul 08 16:34:26.557717 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:26.557684 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-103.ec2.internal\" not found" Jul 08 16:34:26.658150 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:26.658088 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-103.ec2.internal\" not found" Jul 08 16:34:26.758609 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:26.758581 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-103.ec2.internal\" not found" Jul 08 16:34:26.797759 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.797736 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 16:34:26.798216 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.797910 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 16:34:26.832381 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.832362 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 16:34:26.852712 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.852695 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 16:34:26.853108 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.853091 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-103.ec2.internal" Jul 08 16:34:26.863882 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.863862 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 16:34:26.866698 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.866685 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 16:34:26.869306 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.869282 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-103.ec2.internal" Jul 08 16:34:26.875816 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.875803 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 16:34:26.892026 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.892009 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vt8bk" Jul 08 16:34:26.898526 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.898510 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vt8bk" Jul 08 16:34:26.907717 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.907692 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 16:29:25 +0000 UTC" deadline="2028-03-12 20:54:34.07817824 +0000 UTC" Jul 08 16:34:26.907717 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.907715 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14716h20m7.170465704s" Jul 08 16:34:26.962465 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:26.962423 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 16:34:27.105878 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:27.105847 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb852df87ea15bc3486a84b15999fcc65.slice/crio-08c98cbaf14067c73b1967046c07f7b76886ed3faa04a662456150422973e148 WatchSource:0}: Error finding container 08c98cbaf14067c73b1967046c07f7b76886ed3faa04a662456150422973e148: Status 404 returned error can't find the container with id 08c98cbaf14067c73b1967046c07f7b76886ed3faa04a662456150422973e148 Jul 08 16:34:27.106137 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:27.106115 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60c3f5bb8bb39a45b6e87f698f42daba.slice/crio-7a8d7fe2ff8d17a99624466171ef0069ef193ad6b0a612a7db0db2ed8190a9e2 WatchSource:0}: Error finding container 7a8d7fe2ff8d17a99624466171ef0069ef193ad6b0a612a7db0db2ed8190a9e2: Status 404 returned error can't find the container with id 7a8d7fe2ff8d17a99624466171ef0069ef193ad6b0a612a7db0db2ed8190a9e2 Jul 08 16:34:27.112244 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.112224 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 16:34:27.375578 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.375552 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 16:34:27.832976 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.832950 2573 apiserver.go:52] "Watching apiserver" Jul 08 16:34:27.845334 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.845305 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 16:34:27.846626 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.846253 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-6flz5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-103.ec2.internal","openshift-multus/multus-55np5","openshift-multus/multus-additional-cni-plugins-fhvqv","openshift-multus/network-metrics-daemon-bgxr6","openshift-network-operator/iptables-alerter-8tmjf","kube-system/kube-apiserver-proxy-ip-10-0-141-103.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv","openshift-cluster-node-tuning-operator/tuned-zv2j8","openshift-dns/node-resolver-r88w9","openshift-network-diagnostics/network-check-target-68grn","openshift-ovn-kubernetes/ovnkube-node-xmpkp","kube-system/global-pull-secret-syncer-66hzl","kube-system/konnectivity-agent-4dbwk"] Jul 08 16:34:27.848961 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.848932 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6flz5" Jul 08 16:34:27.852051 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.851231 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-55np5" Jul 08 16:34:27.852051 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.851500 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 16:34:27.852051 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.851675 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 16:34:27.852051 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.851770 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 16:34:27.852051 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.851819 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-r2k9g\"" Jul 08 16:34:27.854386 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.853990 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 16:34:27.854386 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.854138 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 16:34:27.854386 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.854168 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 16:34:27.854386 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.854342 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 16:34:27.854643 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.854536 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.855221 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.855059 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2xsnp\"" Jul 08 16:34:27.856653 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.856318 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:27.856653 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:27.856379 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxr6" podUID="ab6fc392-dce6-4bfc-aa9d-2f99fd378c53" Jul 08 16:34:27.857357 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.857337 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 16:34:27.857549 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.857525 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 16:34:27.857787 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.857771 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bdg5t\"" Jul 08 16:34:27.858219 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.858202 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8tmjf" Jul 08 16:34:27.860388 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.860368 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 16:34:27.861123 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.860664 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:27.861123 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.860711 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g6dzc\"" Jul 08 16:34:27.861123 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.860949 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 16:34:27.861567 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.861142 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 16:34:27.862687 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.862658 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 16:34:27.863474 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.862938 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pld78\"" Jul 08 16:34:27.863474 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863134 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 16:34:27.863474 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863231 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-cnibin\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.863474 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863262 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-os-release\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.863474 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863293 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-host-run-k8s-cni-cncf-io\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.863474 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863316 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-host-run-netns\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.863474 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863339 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 16:34:27.863474 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863338 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-multus-conf-dir\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.863474 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863409 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq6wv\" (UniqueName: \"kubernetes.io/projected/967f78fb-318f-47a8-95a5-776c45f8eb8a-kube-api-access-dq6wv\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.863474 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863434 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs\") pod \"network-metrics-daemon-bgxr6\" (UID: \"ab6fc392-dce6-4bfc-aa9d-2f99fd378c53\") " pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:27.863474 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863458 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-multus-socket-dir-parent\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.864028 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863497 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7eac5be-6022-406e-8a03-f6e22b5a1f20-os-release\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.864028 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863520 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7eac5be-6022-406e-8a03-f6e22b5a1f20-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.864028 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863542 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a7eac5be-6022-406e-8a03-f6e22b5a1f20-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.864028 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863552 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:27.864028 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863568 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/781fe4a6-3af0-440e-959e-5a1201135619-host\") pod \"node-ca-6flz5\" (UID: \"781fe4a6-3af0-440e-959e-5a1201135619\") " pod="openshift-image-registry/node-ca-6flz5" Jul 08 16:34:27.864028 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863590 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-host-var-lib-cni-multus\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.864028 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863617 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-hostroot\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.864028 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863639 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a7eac5be-6022-406e-8a03-f6e22b5a1f20-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.864028 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863662 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/781fe4a6-3af0-440e-959e-5a1201135619-serviceca\") pod \"node-ca-6flz5\" (UID: \"781fe4a6-3af0-440e-959e-5a1201135619\") " pod="openshift-image-registry/node-ca-6flz5" Jul 08 16:34:27.864028 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863697 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-host-run-multus-certs\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.864028 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863736 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7eac5be-6022-406e-8a03-f6e22b5a1f20-system-cni-dir\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.864028 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863773 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7eac5be-6022-406e-8a03-f6e22b5a1f20-cni-binary-copy\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.864028 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863807 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-system-cni-dir\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.864028 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863837 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/967f78fb-318f-47a8-95a5-776c45f8eb8a-multus-daemon-config\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.864028 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863905 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-etc-kubernetes\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.864028 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863938 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm92r\" (UniqueName: \"kubernetes.io/projected/781fe4a6-3af0-440e-959e-5a1201135619-kube-api-access-cm92r\") pod \"node-ca-6flz5\" (UID: \"781fe4a6-3af0-440e-959e-5a1201135619\") " pod="openshift-image-registry/node-ca-6flz5" Jul 08 16:34:27.864028 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.863962 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-multus-cni-dir\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.864563 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.864001 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7eac5be-6022-406e-8a03-f6e22b5a1f20-cnibin\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.864563 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.864034 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh5vx\" (UniqueName: \"kubernetes.io/projected/a7eac5be-6022-406e-8a03-f6e22b5a1f20-kube-api-access-gh5vx\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.864563 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.864100 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/967f78fb-318f-47a8-95a5-776c45f8eb8a-cni-binary-copy\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.864563 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.864126 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-host-var-lib-cni-bin\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.864563 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.864150 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-host-var-lib-kubelet\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.864563 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.864174 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fhb6\" (UniqueName: \"kubernetes.io/projected/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-kube-api-access-7fhb6\") pod \"network-metrics-daemon-bgxr6\" (UID: \"ab6fc392-dce6-4bfc-aa9d-2f99fd378c53\") " pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:27.865597 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.865576 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s67jr\"" Jul 08 16:34:27.865597 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.865590 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r88w9" Jul 08 16:34:27.865863 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.865849 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 16:34:27.866102 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.866085 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 16:34:27.867517 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.867473 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 16:34:27.867932 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.867915 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 16:34:27.868683 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.868647 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wlvf8\"" Jul 08 16:34:27.868872 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.868856 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:27.869115 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:27.868945 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68grn" podUID="0cfa0994-c414-44f2-b02f-27b70e765bc0" Jul 08 16:34:27.871561 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.871014 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:27.874266 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.873129 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 16:34:27.874266 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.873316 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 16:34:27.874266 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.873797 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 16:34:27.874266 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.873850 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 16:34:27.874266 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.874039 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q7cbp\"" Jul 08 16:34:27.874266 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.874050 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 16:34:27.874266 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.874134 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 16:34:27.874266 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.874181 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:27.874266 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:27.874234 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66hzl" podUID="b7fb2341-8281-4190-896d-c994c69fbc08" Jul 08 16:34:27.875555 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.875537 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4dbwk" Jul 08 16:34:27.878691 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.877856 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 16:34:27.878691 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.878113 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5zqjt\"" Jul 08 16:34:27.878691 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.878520 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 16:34:27.901680 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.901652 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 16:29:26 +0000 UTC" deadline="2027-12-25 16:21:22.959379417 +0000 UTC" Jul 08 16:34:27.901772 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.901681 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12839h46m55.057702285s" Jul 08 16:34:27.954719 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.954695 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 16:34:27.964582 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.964555 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7eac5be-6022-406e-8a03-f6e22b5a1f20-cni-binary-copy\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.964697 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.964600 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04d6fce6-7129-47b4-80d3-72185a0a4bc9-iptables-alerter-script\") pod \"iptables-alerter-8tmjf\" (UID: \"04d6fce6-7129-47b4-80d3-72185a0a4bc9\") " pod="openshift-network-operator/iptables-alerter-8tmjf" Jul 08 16:34:27.964697 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.964633 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-run-ovn\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:27.964697 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.964658 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-system-cni-dir\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.964697 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.964683 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/967f78fb-318f-47a8-95a5-776c45f8eb8a-multus-daemon-config\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.964959 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.964706 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04d6fce6-7129-47b4-80d3-72185a0a4bc9-host-slash\") pod \"iptables-alerter-8tmjf\" (UID: \"04d6fce6-7129-47b4-80d3-72185a0a4bc9\") " pod="openshift-network-operator/iptables-alerter-8tmjf" Jul 08 16:34:27.964959 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.964778 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-system-cni-dir\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.964959 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.964829 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-var-lib-openvswitch\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:27.964959 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.964865 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cfebfd20-7c02-468d-8ce6-3cae5e30391a-ovn-node-metrics-cert\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:27.964959 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.964918 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-multus-cni-dir\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.964959 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.964947 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh5vx\" (UniqueName: \"kubernetes.io/projected/a7eac5be-6022-406e-8a03-f6e22b5a1f20-kube-api-access-gh5vx\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.965285 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.964972 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-etc-systemd\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:27.965285 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.964998 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-host-kubelet\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:27.965285 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965065 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-etc-openvswitch\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:27.965285 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965088 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-run-openvswitch\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:27.965285 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965111 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-host-cni-bin\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:27.965285 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965125 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7eac5be-6022-406e-8a03-f6e22b5a1f20-cni-binary-copy\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.965285 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965135 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj7nx\" (UniqueName: \"kubernetes.io/projected/cfebfd20-7c02-468d-8ce6-3cae5e30391a-kube-api-access-sj7nx\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:27.965285 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965161 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-host-var-lib-cni-bin\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.965285 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965252 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/967f78fb-318f-47a8-95a5-776c45f8eb8a-multus-daemon-config\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.965696 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965308 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5768158-bf7e-4352-aaef-55503d187b80-socket-dir\") pod \"aws-ebs-csi-driver-node-sdnpv\" (UID: \"a5768158-bf7e-4352-aaef-55503d187b80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:27.965696 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965334 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-host\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:27.965696 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965358 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-sys\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:27.965696 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965384 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-var-lib-kubelet\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:27.965696 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965396 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-host-var-lib-cni-bin\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.965696 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965405 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b7fb2341-8281-4190-896d-c994c69fbc08-dbus\") pod \"global-pull-secret-syncer-66hzl\" (UID: \"b7fb2341-8281-4190-896d-c994c69fbc08\") " pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:27.965696 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965401 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-multus-cni-dir\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.965696 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965420 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-host-slash\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:27.965696 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965437 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-node-log\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:27.965696 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965458 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs\") pod \"network-metrics-daemon-bgxr6\" (UID: \"ab6fc392-dce6-4bfc-aa9d-2f99fd378c53\") " pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:27.965696 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965477 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-etc-kubernetes\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:27.965696 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965500 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-etc-sysctl-conf\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:27.965696 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965522 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-lib-modules\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:27.965696 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965544 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8smz9\" (UniqueName: \"kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9\") pod \"network-check-target-68grn\" (UID: \"0cfa0994-c414-44f2-b02f-27b70e765bc0\") " pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:27.965696 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965567 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-host-cni-netd\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:27.965696 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:27.965581 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:27.965696 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965591 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7eac5be-6022-406e-8a03-f6e22b5a1f20-os-release\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.966708 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965634 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7eac5be-6022-406e-8a03-f6e22b5a1f20-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.966708 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:27.965668 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs podName:ab6fc392-dce6-4bfc-aa9d-2f99fd378c53 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:28.465637767 +0000 UTC m=+3.013661499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs") pod "network-metrics-daemon-bgxr6" (UID: "ab6fc392-dce6-4bfc-aa9d-2f99fd378c53") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:27.966708 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965686 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7eac5be-6022-406e-8a03-f6e22b5a1f20-os-release\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.966708 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965721 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a7eac5be-6022-406e-8a03-f6e22b5a1f20-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.966708 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965749 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52e67dfa-9497-4bd7-aadd-aa91672c561c-agent-certs\") pod \"konnectivity-agent-4dbwk\" (UID: \"52e67dfa-9497-4bd7-aadd-aa91672c561c\") " pod="kube-system/konnectivity-agent-4dbwk" Jul 08 16:34:27.966708 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965765 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7eac5be-6022-406e-8a03-f6e22b5a1f20-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.966708 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965796 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52e67dfa-9497-4bd7-aadd-aa91672c561c-konnectivity-ca\") pod \"konnectivity-agent-4dbwk\" (UID: \"52e67dfa-9497-4bd7-aadd-aa91672c561c\") " pod="kube-system/konnectivity-agent-4dbwk" Jul 08 16:34:27.966708 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965920 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5768158-bf7e-4352-aaef-55503d187b80-registration-dir\") pod \"aws-ebs-csi-driver-node-sdnpv\" (UID: \"a5768158-bf7e-4352-aaef-55503d187b80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:27.966708 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965956 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-etc-modprobe-d\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:27.966708 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.965990 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-etc-sysctl-d\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:27.966708 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966018 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-hostroot\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.966708 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966063 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-hostroot\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.966708 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966094 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5768158-bf7e-4352-aaef-55503d187b80-device-dir\") pod \"aws-ebs-csi-driver-node-sdnpv\" (UID: \"a5768158-bf7e-4352-aaef-55503d187b80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:27.966708 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966120 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-tmp\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:27.966708 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966155 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b7fb2341-8281-4190-896d-c994c69fbc08-kubelet-config\") pod \"global-pull-secret-syncer-66hzl\" (UID: \"b7fb2341-8281-4190-896d-c994c69fbc08\") " pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:27.966708 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966180 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cfebfd20-7c02-468d-8ce6-3cae5e30391a-env-overrides\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:27.967514 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966206 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-host-run-multus-certs\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.967514 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966234 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-etc-tuned\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:27.967514 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966264 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a7eac5be-6022-406e-8a03-f6e22b5a1f20-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.967514 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966272 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-host-run-multus-certs\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.967514 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966286 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxpd7\" (UniqueName: \"kubernetes.io/projected/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-kube-api-access-rxpd7\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:27.967514 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966332 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-host-run-netns\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:27.967514 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966361 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:27.967514 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966390 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-etc-kubernetes\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.967514 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966407 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cfebfd20-7c02-468d-8ce6-3cae5e30391a-ovnkube-config\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:27.967514 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966436 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cfebfd20-7c02-468d-8ce6-3cae5e30391a-ovnkube-script-lib\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:27.967514 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966463 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm92r\" (UniqueName: \"kubernetes.io/projected/781fe4a6-3af0-440e-959e-5a1201135619-kube-api-access-cm92r\") pod \"node-ca-6flz5\" (UID: \"781fe4a6-3af0-440e-959e-5a1201135619\") " pod="openshift-image-registry/node-ca-6flz5" Jul 08 16:34:27.967514 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966467 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-etc-kubernetes\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.967514 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966509 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7eac5be-6022-406e-8a03-f6e22b5a1f20-cnibin\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.967514 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966559 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5768158-bf7e-4352-aaef-55503d187b80-sys-fs\") pod \"aws-ebs-csi-driver-node-sdnpv\" (UID: \"a5768158-bf7e-4352-aaef-55503d187b80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:27.967514 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966582 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7eac5be-6022-406e-8a03-f6e22b5a1f20-cnibin\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.967514 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966629 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-run\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:27.967514 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966671 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/967f78fb-318f-47a8-95a5-776c45f8eb8a-cni-binary-copy\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.968282 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966696 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-host-var-lib-kubelet\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.968282 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966735 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fhb6\" (UniqueName: \"kubernetes.io/projected/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-kube-api-access-7fhb6\") pod \"network-metrics-daemon-bgxr6\" (UID: \"ab6fc392-dce6-4bfc-aa9d-2f99fd378c53\") " pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:27.968282 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966771 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5768158-bf7e-4352-aaef-55503d187b80-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sdnpv\" (UID: \"a5768158-bf7e-4352-aaef-55503d187b80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:27.968282 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966807 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-etc-sysconfig\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:27.968282 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966814 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-host-var-lib-kubelet\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.968282 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966835 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2af41183-3d27-438a-a4b4-d1cea1df572a-tmp-dir\") pod \"node-resolver-r88w9\" (UID: \"2af41183-3d27-438a-a4b4-d1cea1df572a\") " pod="openshift-dns/node-resolver-r88w9" Jul 08 16:34:27.968282 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966859 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72769\" (UniqueName: \"kubernetes.io/projected/04d6fce6-7129-47b4-80d3-72185a0a4bc9-kube-api-access-72769\") pod \"iptables-alerter-8tmjf\" (UID: \"04d6fce6-7129-47b4-80d3-72185a0a4bc9\") " pod="openshift-network-operator/iptables-alerter-8tmjf" Jul 08 16:34:27.968282 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966885 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-cnibin\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.968282 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966924 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-os-release\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.968282 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966947 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-host-run-k8s-cni-cncf-io\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.968282 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966969 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-host-run-netns\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.968282 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.966990 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-multus-conf-dir\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.968282 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967012 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq6wv\" (UniqueName: \"kubernetes.io/projected/967f78fb-318f-47a8-95a5-776c45f8eb8a-kube-api-access-dq6wv\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.968282 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967018 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-os-release\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.968282 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967037 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret\") pod \"global-pull-secret-syncer-66hzl\" (UID: \"b7fb2341-8281-4190-896d-c994c69fbc08\") " pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:27.968282 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967065 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-cnibin\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.968282 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967068 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-host-run-k8s-cni-cncf-io\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.969088 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967083 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-host-run-ovn-kubernetes\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:27.969088 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967073 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-multus-conf-dir\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.969088 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967109 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5768158-bf7e-4352-aaef-55503d187b80-etc-selinux\") pod \"aws-ebs-csi-driver-node-sdnpv\" (UID: \"a5768158-bf7e-4352-aaef-55503d187b80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:27.969088 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967126 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-host-run-netns\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.969088 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967134 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2af41183-3d27-438a-a4b4-d1cea1df572a-hosts-file\") pod \"node-resolver-r88w9\" (UID: \"2af41183-3d27-438a-a4b4-d1cea1df572a\") " pod="openshift-dns/node-resolver-r88w9" Jul 08 16:34:27.969088 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967147 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/967f78fb-318f-47a8-95a5-776c45f8eb8a-cni-binary-copy\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.969088 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967158 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qr95\" (UniqueName: \"kubernetes.io/projected/2af41183-3d27-438a-a4b4-d1cea1df572a-kube-api-access-5qr95\") pod \"node-resolver-r88w9\" (UID: \"2af41183-3d27-438a-a4b4-d1cea1df572a\") " pod="openshift-dns/node-resolver-r88w9" Jul 08 16:34:27.969088 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967189 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-log-socket\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:27.969088 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967219 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-multus-socket-dir-parent\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.969088 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967243 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-systemd-units\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:27.969088 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967268 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/781fe4a6-3af0-440e-959e-5a1201135619-host\") pod \"node-ca-6flz5\" (UID: \"781fe4a6-3af0-440e-959e-5a1201135619\") " pod="openshift-image-registry/node-ca-6flz5" Jul 08 16:34:27.969088 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967285 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-multus-socket-dir-parent\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.969088 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967293 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-host-var-lib-cni-multus\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.969088 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967330 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/967f78fb-318f-47a8-95a5-776c45f8eb8a-host-var-lib-cni-multus\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.969088 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967336 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/781fe4a6-3af0-440e-959e-5a1201135619-host\") pod \"node-ca-6flz5\" (UID: \"781fe4a6-3af0-440e-959e-5a1201135619\") " pod="openshift-image-registry/node-ca-6flz5" Jul 08 16:34:27.969088 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967365 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a7eac5be-6022-406e-8a03-f6e22b5a1f20-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.969088 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967396 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl8dr\" (UniqueName: \"kubernetes.io/projected/a5768158-bf7e-4352-aaef-55503d187b80-kube-api-access-rl8dr\") pod \"aws-ebs-csi-driver-node-sdnpv\" (UID: \"a5768158-bf7e-4352-aaef-55503d187b80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:27.969788 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967419 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-run-systemd\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:27.969788 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967444 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/781fe4a6-3af0-440e-959e-5a1201135619-serviceca\") pod \"node-ca-6flz5\" (UID: \"781fe4a6-3af0-440e-959e-5a1201135619\") " pod="openshift-image-registry/node-ca-6flz5" Jul 08 16:34:27.969788 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967466 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7eac5be-6022-406e-8a03-f6e22b5a1f20-system-cni-dir\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.969788 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967541 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7eac5be-6022-406e-8a03-f6e22b5a1f20-system-cni-dir\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.969788 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967833 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a7eac5be-6022-406e-8a03-f6e22b5a1f20-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.969788 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.967969 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/781fe4a6-3af0-440e-959e-5a1201135619-serviceca\") pod \"node-ca-6flz5\" (UID: \"781fe4a6-3af0-440e-959e-5a1201135619\") " pod="openshift-image-registry/node-ca-6flz5" Jul 08 16:34:27.975137 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.975097 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 16:34:27.978868 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.978844 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh5vx\" (UniqueName: \"kubernetes.io/projected/a7eac5be-6022-406e-8a03-f6e22b5a1f20-kube-api-access-gh5vx\") pod \"multus-additional-cni-plugins-fhvqv\" (UID: \"a7eac5be-6022-406e-8a03-f6e22b5a1f20\") " pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:27.979000 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.978981 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fhb6\" (UniqueName: \"kubernetes.io/projected/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-kube-api-access-7fhb6\") pod \"network-metrics-daemon-bgxr6\" (UID: \"ab6fc392-dce6-4bfc-aa9d-2f99fd378c53\") " pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:27.979292 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.979266 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm92r\" (UniqueName: \"kubernetes.io/projected/781fe4a6-3af0-440e-959e-5a1201135619-kube-api-access-cm92r\") pod \"node-ca-6flz5\" (UID: \"781fe4a6-3af0-440e-959e-5a1201135619\") " pod="openshift-image-registry/node-ca-6flz5" Jul 08 16:34:27.979561 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.979540 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq6wv\" (UniqueName: \"kubernetes.io/projected/967f78fb-318f-47a8-95a5-776c45f8eb8a-kube-api-access-dq6wv\") pod \"multus-55np5\" (UID: \"967f78fb-318f-47a8-95a5-776c45f8eb8a\") " pod="openshift-multus/multus-55np5" Jul 08 16:34:27.997083 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.997029 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-103.ec2.internal" event={"ID":"b852df87ea15bc3486a84b15999fcc65","Type":"ContainerStarted","Data":"08c98cbaf14067c73b1967046c07f7b76886ed3faa04a662456150422973e148"} Jul 08 16:34:27.998705 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:27.998680 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-103.ec2.internal" event={"ID":"60c3f5bb8bb39a45b6e87f698f42daba","Type":"ContainerStarted","Data":"7a8d7fe2ff8d17a99624466171ef0069ef193ad6b0a612a7db0db2ed8190a9e2"} Jul 08 16:34:28.008738 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.008718 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 16:34:28.068406 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.068378 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-etc-tuned\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.068568 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.068416 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxpd7\" (UniqueName: \"kubernetes.io/projected/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-kube-api-access-rxpd7\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.068568 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.068445 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-host-run-netns\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.068568 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.068472 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.068568 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.068511 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cfebfd20-7c02-468d-8ce6-3cae5e30391a-ovnkube-config\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.068568 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.068534 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cfebfd20-7c02-468d-8ce6-3cae5e30391a-ovnkube-script-lib\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.068568 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.068565 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5768158-bf7e-4352-aaef-55503d187b80-sys-fs\") pod \"aws-ebs-csi-driver-node-sdnpv\" (UID: \"a5768158-bf7e-4352-aaef-55503d187b80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:28.068941 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.068588 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-run\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.068941 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.068613 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5768158-bf7e-4352-aaef-55503d187b80-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sdnpv\" (UID: \"a5768158-bf7e-4352-aaef-55503d187b80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:28.068941 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.068674 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.068941 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.068697 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-run\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.068941 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.068724 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-etc-sysconfig\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.068941 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.068759 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2af41183-3d27-438a-a4b4-d1cea1df572a-tmp-dir\") pod \"node-resolver-r88w9\" (UID: \"2af41183-3d27-438a-a4b4-d1cea1df572a\") " pod="openshift-dns/node-resolver-r88w9" Jul 08 16:34:28.068941 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.068777 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-etc-sysconfig\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.068941 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.068854 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-host-run-netns\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.068941 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.068857 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5768158-bf7e-4352-aaef-55503d187b80-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sdnpv\" (UID: \"a5768158-bf7e-4352-aaef-55503d187b80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:28.068941 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.068906 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72769\" (UniqueName: \"kubernetes.io/projected/04d6fce6-7129-47b4-80d3-72185a0a4bc9-kube-api-access-72769\") pod \"iptables-alerter-8tmjf\" (UID: \"04d6fce6-7129-47b4-80d3-72185a0a4bc9\") " pod="openshift-network-operator/iptables-alerter-8tmjf" Jul 08 16:34:28.069494 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.068946 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5768158-bf7e-4352-aaef-55503d187b80-sys-fs\") pod \"aws-ebs-csi-driver-node-sdnpv\" (UID: \"a5768158-bf7e-4352-aaef-55503d187b80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:28.069494 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.068949 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret\") pod \"global-pull-secret-syncer-66hzl\" (UID: \"b7fb2341-8281-4190-896d-c994c69fbc08\") " pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:28.069494 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.068976 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-host-run-ovn-kubernetes\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.069494 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069001 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5768158-bf7e-4352-aaef-55503d187b80-etc-selinux\") pod \"aws-ebs-csi-driver-node-sdnpv\" (UID: \"a5768158-bf7e-4352-aaef-55503d187b80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:28.069494 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069025 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2af41183-3d27-438a-a4b4-d1cea1df572a-hosts-file\") pod \"node-resolver-r88w9\" (UID: \"2af41183-3d27-438a-a4b4-d1cea1df572a\") " pod="openshift-dns/node-resolver-r88w9" Jul 08 16:34:28.069494 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069050 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qr95\" (UniqueName: \"kubernetes.io/projected/2af41183-3d27-438a-a4b4-d1cea1df572a-kube-api-access-5qr95\") pod \"node-resolver-r88w9\" (UID: \"2af41183-3d27-438a-a4b4-d1cea1df572a\") " pod="openshift-dns/node-resolver-r88w9" Jul 08 16:34:28.069494 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069066 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2af41183-3d27-438a-a4b4-d1cea1df572a-tmp-dir\") pod \"node-resolver-r88w9\" (UID: \"2af41183-3d27-438a-a4b4-d1cea1df572a\") " pod="openshift-dns/node-resolver-r88w9" Jul 08 16:34:28.069494 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069075 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-log-socket\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.069494 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069104 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-systemd-units\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.069494 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069138 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2af41183-3d27-438a-a4b4-d1cea1df572a-hosts-file\") pod \"node-resolver-r88w9\" (UID: \"2af41183-3d27-438a-a4b4-d1cea1df572a\") " pod="openshift-dns/node-resolver-r88w9" Jul 08 16:34:28.069494 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069144 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-systemd-units\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.069494 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069150 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl8dr\" (UniqueName: \"kubernetes.io/projected/a5768158-bf7e-4352-aaef-55503d187b80-kube-api-access-rl8dr\") pod \"aws-ebs-csi-driver-node-sdnpv\" (UID: \"a5768158-bf7e-4352-aaef-55503d187b80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:28.069494 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:28.069026 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:28.069494 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069178 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-run-systemd\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.069494 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069184 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-host-run-ovn-kubernetes\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.069494 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:28.069210 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret podName:b7fb2341-8281-4190-896d-c994c69fbc08 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:28.569193158 +0000 UTC m=+3.117216879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret") pod "global-pull-secret-syncer-66hzl" (UID: "b7fb2341-8281-4190-896d-c994c69fbc08") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:28.069494 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069230 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04d6fce6-7129-47b4-80d3-72185a0a4bc9-iptables-alerter-script\") pod \"iptables-alerter-8tmjf\" (UID: \"04d6fce6-7129-47b4-80d3-72185a0a4bc9\") " pod="openshift-network-operator/iptables-alerter-8tmjf" Jul 08 16:34:28.070520 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069233 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-run-systemd\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.070520 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069255 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-run-ovn\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.070520 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069286 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04d6fce6-7129-47b4-80d3-72185a0a4bc9-host-slash\") pod \"iptables-alerter-8tmjf\" (UID: \"04d6fce6-7129-47b4-80d3-72185a0a4bc9\") " pod="openshift-network-operator/iptables-alerter-8tmjf" Jul 08 16:34:28.070520 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069286 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5768158-bf7e-4352-aaef-55503d187b80-etc-selinux\") pod \"aws-ebs-csi-driver-node-sdnpv\" (UID: \"a5768158-bf7e-4352-aaef-55503d187b80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:28.070520 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069298 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-log-socket\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.070520 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069254 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cfebfd20-7c02-468d-8ce6-3cae5e30391a-ovnkube-script-lib\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.070520 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069345 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04d6fce6-7129-47b4-80d3-72185a0a4bc9-host-slash\") pod \"iptables-alerter-8tmjf\" (UID: \"04d6fce6-7129-47b4-80d3-72185a0a4bc9\") " pod="openshift-network-operator/iptables-alerter-8tmjf" Jul 08 16:34:28.070520 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069346 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-run-ovn\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.070520 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069366 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-var-lib-openvswitch\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.070520 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069395 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cfebfd20-7c02-468d-8ce6-3cae5e30391a-ovn-node-metrics-cert\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.070520 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069418 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-var-lib-openvswitch\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.070520 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069429 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-etc-systemd\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.070520 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069456 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-host-kubelet\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.070520 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069472 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-etc-systemd\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.070520 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069480 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-etc-openvswitch\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.070520 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069508 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-run-openvswitch\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.070520 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069511 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-host-kubelet\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.070520 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069533 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-host-cni-bin\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.071362 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069552 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-etc-openvswitch\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.071362 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069558 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj7nx\" (UniqueName: \"kubernetes.io/projected/cfebfd20-7c02-468d-8ce6-3cae5e30391a-kube-api-access-sj7nx\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.071362 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069592 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-host-cni-bin\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.071362 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069601 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5768158-bf7e-4352-aaef-55503d187b80-socket-dir\") pod \"aws-ebs-csi-driver-node-sdnpv\" (UID: \"a5768158-bf7e-4352-aaef-55503d187b80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:28.071362 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069625 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-host\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.071362 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069647 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-sys\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.071362 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069669 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-var-lib-kubelet\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.071362 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069692 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b7fb2341-8281-4190-896d-c994c69fbc08-dbus\") pod \"global-pull-secret-syncer-66hzl\" (UID: \"b7fb2341-8281-4190-896d-c994c69fbc08\") " pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:28.071362 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069715 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-host-slash\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.071362 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069734 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-node-log\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.071362 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069756 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-etc-kubernetes\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.071362 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069772 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-etc-sysctl-conf\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.071362 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069785 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-lib-modules\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.071362 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069802 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-var-lib-kubelet\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.071362 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069842 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04d6fce6-7129-47b4-80d3-72185a0a4bc9-iptables-alerter-script\") pod \"iptables-alerter-8tmjf\" (UID: \"04d6fce6-7129-47b4-80d3-72185a0a4bc9\") " pod="openshift-network-operator/iptables-alerter-8tmjf" Jul 08 16:34:28.071362 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069860 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cfebfd20-7c02-468d-8ce6-3cae5e30391a-ovnkube-config\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.071362 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069559 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-run-openvswitch\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.071362 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069915 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b7fb2341-8281-4190-896d-c994c69fbc08-dbus\") pod \"global-pull-secret-syncer-66hzl\" (UID: \"b7fb2341-8281-4190-896d-c994c69fbc08\") " pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:28.072268 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069941 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-host\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.072268 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069953 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-etc-kubernetes\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.072268 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069996 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-host-slash\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.072268 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070002 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-etc-sysctl-conf\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.072268 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.069801 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8smz9\" (UniqueName: \"kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9\") pod \"network-check-target-68grn\" (UID: \"0cfa0994-c414-44f2-b02f-27b70e765bc0\") " pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:28.072268 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070038 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-sys\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.072268 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070056 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-lib-modules\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.072268 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070059 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-node-log\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.072268 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070108 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-host-cni-netd\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.072268 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070153 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52e67dfa-9497-4bd7-aadd-aa91672c561c-agent-certs\") pod \"konnectivity-agent-4dbwk\" (UID: \"52e67dfa-9497-4bd7-aadd-aa91672c561c\") " pod="kube-system/konnectivity-agent-4dbwk" Jul 08 16:34:28.072268 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070155 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cfebfd20-7c02-468d-8ce6-3cae5e30391a-host-cni-netd\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.072268 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070171 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52e67dfa-9497-4bd7-aadd-aa91672c561c-konnectivity-ca\") pod \"konnectivity-agent-4dbwk\" (UID: \"52e67dfa-9497-4bd7-aadd-aa91672c561c\") " pod="kube-system/konnectivity-agent-4dbwk" Jul 08 16:34:28.072268 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070200 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5768158-bf7e-4352-aaef-55503d187b80-registration-dir\") pod \"aws-ebs-csi-driver-node-sdnpv\" (UID: \"a5768158-bf7e-4352-aaef-55503d187b80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:28.072268 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070218 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-etc-modprobe-d\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.072268 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070236 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-etc-sysctl-d\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.072268 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070232 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5768158-bf7e-4352-aaef-55503d187b80-socket-dir\") pod \"aws-ebs-csi-driver-node-sdnpv\" (UID: \"a5768158-bf7e-4352-aaef-55503d187b80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:28.072268 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070254 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5768158-bf7e-4352-aaef-55503d187b80-device-dir\") pod \"aws-ebs-csi-driver-node-sdnpv\" (UID: \"a5768158-bf7e-4352-aaef-55503d187b80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:28.073107 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070286 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5768158-bf7e-4352-aaef-55503d187b80-device-dir\") pod \"aws-ebs-csi-driver-node-sdnpv\" (UID: \"a5768158-bf7e-4352-aaef-55503d187b80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:28.073107 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070290 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-tmp\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.073107 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070293 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5768158-bf7e-4352-aaef-55503d187b80-registration-dir\") pod \"aws-ebs-csi-driver-node-sdnpv\" (UID: \"a5768158-bf7e-4352-aaef-55503d187b80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:28.073107 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070321 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b7fb2341-8281-4190-896d-c994c69fbc08-kubelet-config\") pod \"global-pull-secret-syncer-66hzl\" (UID: \"b7fb2341-8281-4190-896d-c994c69fbc08\") " pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:28.073107 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070345 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cfebfd20-7c02-468d-8ce6-3cae5e30391a-env-overrides\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.073107 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070356 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-etc-modprobe-d\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.073107 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070472 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-etc-sysctl-d\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.073107 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070485 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b7fb2341-8281-4190-896d-c994c69fbc08-kubelet-config\") pod \"global-pull-secret-syncer-66hzl\" (UID: \"b7fb2341-8281-4190-896d-c994c69fbc08\") " pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:28.073107 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070802 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52e67dfa-9497-4bd7-aadd-aa91672c561c-konnectivity-ca\") pod \"konnectivity-agent-4dbwk\" (UID: \"52e67dfa-9497-4bd7-aadd-aa91672c561c\") " pod="kube-system/konnectivity-agent-4dbwk" Jul 08 16:34:28.073107 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.070825 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cfebfd20-7c02-468d-8ce6-3cae5e30391a-env-overrides\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.075278 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.075029 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cfebfd20-7c02-468d-8ce6-3cae5e30391a-ovn-node-metrics-cert\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.075278 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.075227 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-etc-tuned\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.075454 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.075335 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-tmp\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.076506 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.075777 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52e67dfa-9497-4bd7-aadd-aa91672c561c-agent-certs\") pod \"konnectivity-agent-4dbwk\" (UID: \"52e67dfa-9497-4bd7-aadd-aa91672c561c\") " pod="kube-system/konnectivity-agent-4dbwk" Jul 08 16:34:28.077433 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:28.077411 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:34:28.077625 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:28.077438 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:34:28.077625 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:28.077458 2573 projected.go:196] Error preparing data for projected volume kube-api-access-8smz9 for pod openshift-network-diagnostics/network-check-target-68grn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:28.078478 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:28.078453 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9 podName:0cfa0994-c414-44f2-b02f-27b70e765bc0 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:28.57840606 +0000 UTC m=+3.126429788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8smz9" (UniqueName: "kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9") pod "network-check-target-68grn" (UID: "0cfa0994-c414-44f2-b02f-27b70e765bc0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:28.080110 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.080078 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qr95\" (UniqueName: \"kubernetes.io/projected/2af41183-3d27-438a-a4b4-d1cea1df572a-kube-api-access-5qr95\") pod \"node-resolver-r88w9\" (UID: \"2af41183-3d27-438a-a4b4-d1cea1df572a\") " pod="openshift-dns/node-resolver-r88w9" Jul 08 16:34:28.080458 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.080238 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxpd7\" (UniqueName: \"kubernetes.io/projected/6d610c40-b3e2-43e0-9c3e-cb0913dd90a6-kube-api-access-rxpd7\") pod \"tuned-zv2j8\" (UID: \"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6\") " pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.081385 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.081367 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72769\" (UniqueName: \"kubernetes.io/projected/04d6fce6-7129-47b4-80d3-72185a0a4bc9-kube-api-access-72769\") pod \"iptables-alerter-8tmjf\" (UID: \"04d6fce6-7129-47b4-80d3-72185a0a4bc9\") " pod="openshift-network-operator/iptables-alerter-8tmjf" Jul 08 16:34:28.082874 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.082598 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl8dr\" (UniqueName: \"kubernetes.io/projected/a5768158-bf7e-4352-aaef-55503d187b80-kube-api-access-rl8dr\") pod \"aws-ebs-csi-driver-node-sdnpv\" (UID: \"a5768158-bf7e-4352-aaef-55503d187b80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:28.082874 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.082768 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj7nx\" (UniqueName: \"kubernetes.io/projected/cfebfd20-7c02-468d-8ce6-3cae5e30391a-kube-api-access-sj7nx\") pod \"ovnkube-node-xmpkp\" (UID: \"cfebfd20-7c02-468d-8ce6-3cae5e30391a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.167591 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.167502 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6flz5" Jul 08 16:34:28.176546 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.176524 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-55np5" Jul 08 16:34:28.187206 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.187186 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fhvqv" Jul 08 16:34:28.192770 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.192750 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8tmjf" Jul 08 16:34:28.199383 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.199362 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" Jul 08 16:34:28.211003 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.210985 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" Jul 08 16:34:28.219656 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.219638 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r88w9" Jul 08 16:34:28.226269 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.226251 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:28.232917 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.232879 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4dbwk" Jul 08 16:34:28.474784 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.474697 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs\") pod \"network-metrics-daemon-bgxr6\" (UID: \"ab6fc392-dce6-4bfc-aa9d-2f99fd378c53\") " pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:28.474957 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:28.474840 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:28.474957 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:28.474929 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs podName:ab6fc392-dce6-4bfc-aa9d-2f99fd378c53 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:29.474909402 +0000 UTC m=+4.022933120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs") pod "network-metrics-daemon-bgxr6" (UID: "ab6fc392-dce6-4bfc-aa9d-2f99fd378c53") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:28.575558 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.575526 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret\") pod \"global-pull-secret-syncer-66hzl\" (UID: \"b7fb2341-8281-4190-896d-c994c69fbc08\") " pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:28.575734 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:28.575631 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:28.575734 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:28.575684 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret podName:b7fb2341-8281-4190-896d-c994c69fbc08 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:29.575670841 +0000 UTC m=+4.123694555 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret") pod "global-pull-secret-syncer-66hzl" (UID: "b7fb2341-8281-4190-896d-c994c69fbc08") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:28.676208 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.676167 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8smz9\" (UniqueName: \"kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9\") pod \"network-check-target-68grn\" (UID: \"0cfa0994-c414-44f2-b02f-27b70e765bc0\") " pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:28.676368 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:28.676333 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:34:28.676368 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:28.676354 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:34:28.676368 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:28.676364 2573 projected.go:196] Error preparing data for projected volume kube-api-access-8smz9 for pod openshift-network-diagnostics/network-check-target-68grn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:28.676484 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:28.676415 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9 podName:0cfa0994-c414-44f2-b02f-27b70e765bc0 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:29.676402116 +0000 UTC m=+4.224425832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8smz9" (UniqueName: "kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9") pod "network-check-target-68grn" (UID: "0cfa0994-c414-44f2-b02f-27b70e765bc0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:28.902537 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.902472 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 16:29:26 +0000 UTC" deadline="2028-03-10 09:08:54.186615849 +0000 UTC" Jul 08 16:34:28.902537 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:28.902531 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14656h34m25.284088392s" Jul 08 16:34:29.064077 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:29.064045 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af41183_3d27_438a_a4b4_d1cea1df572a.slice/crio-f5ba03f6e0c771022d17ed46d4c79b35a5711ca5fd56cd8b17d88d18d888cbad WatchSource:0}: Error finding container f5ba03f6e0c771022d17ed46d4c79b35a5711ca5fd56cd8b17d88d18d888cbad: Status 404 returned error can't find the container with id f5ba03f6e0c771022d17ed46d4c79b35a5711ca5fd56cd8b17d88d18d888cbad Jul 08 16:34:29.066213 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:29.066096 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7eac5be_6022_406e_8a03_f6e22b5a1f20.slice/crio-4f70d02002e6c6beb4bd15c26e992e8ddec63107e3a5c8fb02549f826016ee1c WatchSource:0}: Error finding container 4f70d02002e6c6beb4bd15c26e992e8ddec63107e3a5c8fb02549f826016ee1c: Status 404 returned error can't find the container with id 4f70d02002e6c6beb4bd15c26e992e8ddec63107e3a5c8fb02549f826016ee1c Jul 08 16:34:29.069139 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:29.069113 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52e67dfa_9497_4bd7_aadd_aa91672c561c.slice/crio-8bf14dfeebad01e608dfc1c63a8a05629f37c642f9f1a537393740d8dbf9cbc1 WatchSource:0}: Error finding container 8bf14dfeebad01e608dfc1c63a8a05629f37c642f9f1a537393740d8dbf9cbc1: Status 404 returned error can't find the container with id 8bf14dfeebad01e608dfc1c63a8a05629f37c642f9f1a537393740d8dbf9cbc1 Jul 08 16:34:29.069797 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:29.069777 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod967f78fb_318f_47a8_95a5_776c45f8eb8a.slice/crio-c0a876fab2839d4d5993972d416a7b1138ac864823cd8a70e16300697e679e3d WatchSource:0}: Error finding container c0a876fab2839d4d5993972d416a7b1138ac864823cd8a70e16300697e679e3d: Status 404 returned error can't find the container with id c0a876fab2839d4d5993972d416a7b1138ac864823cd8a70e16300697e679e3d Jul 08 16:34:29.071807 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:29.071774 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod781fe4a6_3af0_440e_959e_5a1201135619.slice/crio-5c633700f8857ce4c91005a451f7f9234d8c7b66c2b240b74c5a4d0939e0558f WatchSource:0}: Error finding container 5c633700f8857ce4c91005a451f7f9234d8c7b66c2b240b74c5a4d0939e0558f: Status 404 returned error can't find the container with id 5c633700f8857ce4c91005a451f7f9234d8c7b66c2b240b74c5a4d0939e0558f Jul 08 16:34:29.075930 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:29.075862 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d610c40_b3e2_43e0_9c3e_cb0913dd90a6.slice/crio-dd9f6139ba8f6d83de5a3f1751f7bf7fbe847c9213f08cb1c863b02165ba9286 WatchSource:0}: Error finding container dd9f6139ba8f6d83de5a3f1751f7bf7fbe847c9213f08cb1c863b02165ba9286: Status 404 returned error can't find the container with id dd9f6139ba8f6d83de5a3f1751f7bf7fbe847c9213f08cb1c863b02165ba9286 Jul 08 16:34:29.076761 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:34:29.076736 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfebfd20_7c02_468d_8ce6_3cae5e30391a.slice/crio-4950295f207e0f219e72db816a4f398493172f8e0c1f2612b9442656fa8f5f3b WatchSource:0}: Error finding container 4950295f207e0f219e72db816a4f398493172f8e0c1f2612b9442656fa8f5f3b: Status 404 returned error can't find the container with id 4950295f207e0f219e72db816a4f398493172f8e0c1f2612b9442656fa8f5f3b Jul 08 16:34:29.482630 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:29.482444 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs\") pod \"network-metrics-daemon-bgxr6\" (UID: \"ab6fc392-dce6-4bfc-aa9d-2f99fd378c53\") " pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:29.482789 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:29.482599 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:29.482789 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:29.482693 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs podName:ab6fc392-dce6-4bfc-aa9d-2f99fd378c53 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:31.482678966 +0000 UTC m=+6.030702681 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs") pod "network-metrics-daemon-bgxr6" (UID: "ab6fc392-dce6-4bfc-aa9d-2f99fd378c53") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:29.583375 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:29.583336 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret\") pod \"global-pull-secret-syncer-66hzl\" (UID: \"b7fb2341-8281-4190-896d-c994c69fbc08\") " pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:29.583557 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:29.583537 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:29.583659 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:29.583607 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret podName:b7fb2341-8281-4190-896d-c994c69fbc08 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:31.583589008 +0000 UTC m=+6.131612739 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret") pod "global-pull-secret-syncer-66hzl" (UID: "b7fb2341-8281-4190-896d-c994c69fbc08") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:29.684664 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:29.684624 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8smz9\" (UniqueName: \"kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9\") pod \"network-check-target-68grn\" (UID: \"0cfa0994-c414-44f2-b02f-27b70e765bc0\") " pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:29.684868 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:29.684852 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:34:29.685085 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:29.684877 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:34:29.685085 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:29.684971 2573 projected.go:196] Error preparing data for projected volume kube-api-access-8smz9 for pod openshift-network-diagnostics/network-check-target-68grn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:29.685085 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:29.685045 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9 podName:0cfa0994-c414-44f2-b02f-27b70e765bc0 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:31.685024379 +0000 UTC m=+6.233048109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8smz9" (UniqueName: "kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9") pod "network-check-target-68grn" (UID: "0cfa0994-c414-44f2-b02f-27b70e765bc0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:29.992090 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:29.992013 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:29.992517 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:29.992155 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxr6" podUID="ab6fc392-dce6-4bfc-aa9d-2f99fd378c53" Jul 08 16:34:29.993377 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:29.992624 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:29.993377 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:29.992715 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68grn" podUID="0cfa0994-c414-44f2-b02f-27b70e765bc0" Jul 08 16:34:29.993377 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:29.992775 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:29.993377 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:29.992849 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66hzl" podUID="b7fb2341-8281-4190-896d-c994c69fbc08" Jul 08 16:34:30.014769 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:30.014163 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-103.ec2.internal" event={"ID":"b852df87ea15bc3486a84b15999fcc65","Type":"ContainerStarted","Data":"378e82d332ab4a86c6da5701b6c804bc677746356cfaa29eec0c3c85710b30e5"} Jul 08 16:34:30.018149 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:30.018120 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6flz5" event={"ID":"781fe4a6-3af0-440e-959e-5a1201135619","Type":"ContainerStarted","Data":"5c633700f8857ce4c91005a451f7f9234d8c7b66c2b240b74c5a4d0939e0558f"} Jul 08 16:34:30.023816 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:30.023785 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-55np5" event={"ID":"967f78fb-318f-47a8-95a5-776c45f8eb8a","Type":"ContainerStarted","Data":"c0a876fab2839d4d5993972d416a7b1138ac864823cd8a70e16300697e679e3d"} Jul 08 16:34:30.031795 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:30.031764 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4dbwk" event={"ID":"52e67dfa-9497-4bd7-aadd-aa91672c561c","Type":"ContainerStarted","Data":"8bf14dfeebad01e608dfc1c63a8a05629f37c642f9f1a537393740d8dbf9cbc1"} Jul 08 16:34:30.042325 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:30.042294 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r88w9" event={"ID":"2af41183-3d27-438a-a4b4-d1cea1df572a","Type":"ContainerStarted","Data":"f5ba03f6e0c771022d17ed46d4c79b35a5711ca5fd56cd8b17d88d18d888cbad"} Jul 08 16:34:30.057622 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:30.057574 2573 generic.go:356] "Generic (PLEG): container finished" podID="60c3f5bb8bb39a45b6e87f698f42daba" containerID="e475470328ae02dfd26063e6c6ee46990f6fe0e1e4c748406b91430c804b476d" exitCode=0 Jul 08 16:34:30.057741 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:30.057661 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-103.ec2.internal" event={"ID":"60c3f5bb8bb39a45b6e87f698f42daba","Type":"ContainerDied","Data":"e475470328ae02dfd26063e6c6ee46990f6fe0e1e4c748406b91430c804b476d"} Jul 08 16:34:30.066880 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:30.066855 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" event={"ID":"cfebfd20-7c02-468d-8ce6-3cae5e30391a","Type":"ContainerStarted","Data":"4950295f207e0f219e72db816a4f398493172f8e0c1f2612b9442656fa8f5f3b"} Jul 08 16:34:30.073052 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:30.072982 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" event={"ID":"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6","Type":"ContainerStarted","Data":"dd9f6139ba8f6d83de5a3f1751f7bf7fbe847c9213f08cb1c863b02165ba9286"} Jul 08 16:34:30.074971 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:30.073750 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-103.ec2.internal" podStartSLOduration=4.073732013 podStartE2EDuration="4.073732013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:30.032491151 +0000 UTC m=+4.580514891" watchObservedRunningTime="2026-07-08 16:34:30.073732013 +0000 UTC m=+4.621755755" Jul 08 16:34:30.091462 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:30.091365 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" event={"ID":"a5768158-bf7e-4352-aaef-55503d187b80","Type":"ContainerStarted","Data":"1ccc0c0d2b457064af2c21244d673ee6edaaa802991c2d4b066ee8da1584ac8b"} Jul 08 16:34:30.100335 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:30.100273 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8tmjf" event={"ID":"04d6fce6-7129-47b4-80d3-72185a0a4bc9","Type":"ContainerStarted","Data":"02aeac39d07c4346ca8170a18f508caa0e003706b878a357fe54c479ef6cb3c6"} Jul 08 16:34:30.111514 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:30.111439 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhvqv" event={"ID":"a7eac5be-6022-406e-8a03-f6e22b5a1f20","Type":"ContainerStarted","Data":"4f70d02002e6c6beb4bd15c26e992e8ddec63107e3a5c8fb02549f826016ee1c"} Jul 08 16:34:31.126974 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:31.126941 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-103.ec2.internal" event={"ID":"60c3f5bb8bb39a45b6e87f698f42daba","Type":"ContainerStarted","Data":"61af725ceafb0e9fd06b8ec36a8fe716c8b18683d043bd87e1b7de63e551ba74"} Jul 08 16:34:31.504330 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:31.504247 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs\") pod \"network-metrics-daemon-bgxr6\" (UID: \"ab6fc392-dce6-4bfc-aa9d-2f99fd378c53\") " pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:31.504497 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:31.504418 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:31.504497 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:31.504486 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs podName:ab6fc392-dce6-4bfc-aa9d-2f99fd378c53 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:35.504466755 +0000 UTC m=+10.052490473 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs") pod "network-metrics-daemon-bgxr6" (UID: "ab6fc392-dce6-4bfc-aa9d-2f99fd378c53") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:31.605428 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:31.605387 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret\") pod \"global-pull-secret-syncer-66hzl\" (UID: \"b7fb2341-8281-4190-896d-c994c69fbc08\") " pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:31.605757 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:31.605527 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:31.605757 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:31.605590 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret podName:b7fb2341-8281-4190-896d-c994c69fbc08 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:35.605573175 +0000 UTC m=+10.153596895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret") pod "global-pull-secret-syncer-66hzl" (UID: "b7fb2341-8281-4190-896d-c994c69fbc08") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:31.706551 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:31.706473 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8smz9\" (UniqueName: \"kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9\") pod \"network-check-target-68grn\" (UID: \"0cfa0994-c414-44f2-b02f-27b70e765bc0\") " pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:31.706869 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:31.706666 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:34:31.706869 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:31.706688 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:34:31.706869 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:31.706701 2573 projected.go:196] Error preparing data for projected volume kube-api-access-8smz9 for pod openshift-network-diagnostics/network-check-target-68grn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:31.706869 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:31.706757 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9 podName:0cfa0994-c414-44f2-b02f-27b70e765bc0 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:35.706739998 +0000 UTC m=+10.254763726 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8smz9" (UniqueName: "kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9") pod "network-check-target-68grn" (UID: "0cfa0994-c414-44f2-b02f-27b70e765bc0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:31.993314 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:31.992689 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:31.993314 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:31.992802 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxr6" podUID="ab6fc392-dce6-4bfc-aa9d-2f99fd378c53" Jul 08 16:34:31.993314 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:31.992869 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:31.993314 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:31.992939 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68grn" podUID="0cfa0994-c414-44f2-b02f-27b70e765bc0" Jul 08 16:34:31.993314 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:31.992982 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:31.993314 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:31.993037 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66hzl" podUID="b7fb2341-8281-4190-896d-c994c69fbc08" Jul 08 16:34:33.992755 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:33.992685 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:33.992755 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:33.992704 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:33.993162 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:33.992830 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxr6" podUID="ab6fc392-dce6-4bfc-aa9d-2f99fd378c53" Jul 08 16:34:33.993162 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:33.993039 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:33.993162 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:33.993123 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66hzl" podUID="b7fb2341-8281-4190-896d-c994c69fbc08" Jul 08 16:34:33.993291 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:33.993185 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68grn" podUID="0cfa0994-c414-44f2-b02f-27b70e765bc0" Jul 08 16:34:35.541477 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:35.541437 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs\") pod \"network-metrics-daemon-bgxr6\" (UID: \"ab6fc392-dce6-4bfc-aa9d-2f99fd378c53\") " pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:35.541978 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:35.541604 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:35.541978 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:35.541663 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs podName:ab6fc392-dce6-4bfc-aa9d-2f99fd378c53 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:43.541645555 +0000 UTC m=+18.089669275 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs") pod "network-metrics-daemon-bgxr6" (UID: "ab6fc392-dce6-4bfc-aa9d-2f99fd378c53") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:35.642139 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:35.642095 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret\") pod \"global-pull-secret-syncer-66hzl\" (UID: \"b7fb2341-8281-4190-896d-c994c69fbc08\") " pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:35.642316 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:35.642265 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:35.642376 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:35.642331 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret podName:b7fb2341-8281-4190-896d-c994c69fbc08 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:43.642297968 +0000 UTC m=+18.190321682 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret") pod "global-pull-secret-syncer-66hzl" (UID: "b7fb2341-8281-4190-896d-c994c69fbc08") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:35.742600 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:35.742557 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8smz9\" (UniqueName: \"kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9\") pod \"network-check-target-68grn\" (UID: \"0cfa0994-c414-44f2-b02f-27b70e765bc0\") " pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:35.742778 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:35.742706 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:34:35.742778 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:35.742728 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:34:35.742778 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:35.742740 2573 projected.go:196] Error preparing data for projected volume kube-api-access-8smz9 for pod openshift-network-diagnostics/network-check-target-68grn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:35.742959 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:35.742798 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9 podName:0cfa0994-c414-44f2-b02f-27b70e765bc0 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:43.742779495 +0000 UTC m=+18.290803210 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8smz9" (UniqueName: "kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9") pod "network-check-target-68grn" (UID: "0cfa0994-c414-44f2-b02f-27b70e765bc0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:35.992275 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:35.992201 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:35.992478 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:35.992307 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:35.992478 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:35.992319 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxr6" podUID="ab6fc392-dce6-4bfc-aa9d-2f99fd378c53" Jul 08 16:34:35.992478 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:35.992414 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68grn" podUID="0cfa0994-c414-44f2-b02f-27b70e765bc0" Jul 08 16:34:35.992478 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:35.992476 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:35.992672 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:35.992545 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66hzl" podUID="b7fb2341-8281-4190-896d-c994c69fbc08" Jul 08 16:34:37.991170 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:37.991134 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:37.991629 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:37.991277 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxr6" podUID="ab6fc392-dce6-4bfc-aa9d-2f99fd378c53" Jul 08 16:34:37.991629 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:37.991558 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:37.991732 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:37.991637 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68grn" podUID="0cfa0994-c414-44f2-b02f-27b70e765bc0" Jul 08 16:34:37.991732 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:37.991666 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:37.991732 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:37.991716 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66hzl" podUID="b7fb2341-8281-4190-896d-c994c69fbc08" Jul 08 16:34:39.994246 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:39.994214 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:39.994651 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:39.994335 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:39.994651 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:39.994343 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66hzl" podUID="b7fb2341-8281-4190-896d-c994c69fbc08" Jul 08 16:34:39.994651 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:39.994393 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:39.994651 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:39.994498 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxr6" podUID="ab6fc392-dce6-4bfc-aa9d-2f99fd378c53" Jul 08 16:34:39.994651 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:39.994581 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68grn" podUID="0cfa0994-c414-44f2-b02f-27b70e765bc0" Jul 08 16:34:41.991505 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:41.991469 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:41.991505 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:41.991488 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:41.991505 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:41.991469 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:41.992074 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:41.991616 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66hzl" podUID="b7fb2341-8281-4190-896d-c994c69fbc08" Jul 08 16:34:41.992074 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:41.991686 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68grn" podUID="0cfa0994-c414-44f2-b02f-27b70e765bc0" Jul 08 16:34:41.992074 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:41.991777 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxr6" podUID="ab6fc392-dce6-4bfc-aa9d-2f99fd378c53" Jul 08 16:34:43.599931 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:43.599875 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs\") pod \"network-metrics-daemon-bgxr6\" (UID: \"ab6fc392-dce6-4bfc-aa9d-2f99fd378c53\") " pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:43.600418 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:43.599996 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:43.600418 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:43.600066 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs podName:ab6fc392-dce6-4bfc-aa9d-2f99fd378c53 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:59.600046849 +0000 UTC m=+34.148070595 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs") pod "network-metrics-daemon-bgxr6" (UID: "ab6fc392-dce6-4bfc-aa9d-2f99fd378c53") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:43.701240 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:43.701151 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret\") pod \"global-pull-secret-syncer-66hzl\" (UID: \"b7fb2341-8281-4190-896d-c994c69fbc08\") " pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:43.701396 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:43.701287 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:43.701396 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:43.701357 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret podName:b7fb2341-8281-4190-896d-c994c69fbc08 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:59.701340018 +0000 UTC m=+34.249363737 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret") pod "global-pull-secret-syncer-66hzl" (UID: "b7fb2341-8281-4190-896d-c994c69fbc08") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:43.801763 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:43.801723 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8smz9\" (UniqueName: \"kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9\") pod \"network-check-target-68grn\" (UID: \"0cfa0994-c414-44f2-b02f-27b70e765bc0\") " pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:43.801950 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:43.801920 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:34:43.801950 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:43.801943 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:34:43.802045 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:43.801953 2573 projected.go:196] Error preparing data for projected volume kube-api-access-8smz9 for pod openshift-network-diagnostics/network-check-target-68grn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:43.802045 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:43.802014 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9 podName:0cfa0994-c414-44f2-b02f-27b70e765bc0 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:59.801995354 +0000 UTC m=+34.350019092 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8smz9" (UniqueName: "kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9") pod "network-check-target-68grn" (UID: "0cfa0994-c414-44f2-b02f-27b70e765bc0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:43.990723 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:43.990628 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:43.990723 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:43.990669 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:43.990723 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:43.990632 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:43.991003 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:43.990756 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68grn" podUID="0cfa0994-c414-44f2-b02f-27b70e765bc0" Jul 08 16:34:43.991003 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:43.990844 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66hzl" podUID="b7fb2341-8281-4190-896d-c994c69fbc08" Jul 08 16:34:43.991003 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:43.990937 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxr6" podUID="ab6fc392-dce6-4bfc-aa9d-2f99fd378c53" Jul 08 16:34:45.991871 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:45.991834 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:45.992358 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:45.992016 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:45.992358 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:45.992026 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxr6" podUID="ab6fc392-dce6-4bfc-aa9d-2f99fd378c53" Jul 08 16:34:45.992358 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:45.992064 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:45.992358 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:45.992142 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68grn" podUID="0cfa0994-c414-44f2-b02f-27b70e765bc0" Jul 08 16:34:45.992358 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:45.992236 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66hzl" podUID="b7fb2341-8281-4190-896d-c994c69fbc08" Jul 08 16:34:47.991164 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:47.990986 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:47.991764 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:47.991056 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:47.991764 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:47.990986 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:47.991764 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:47.991264 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66hzl" podUID="b7fb2341-8281-4190-896d-c994c69fbc08" Jul 08 16:34:47.991764 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:47.991351 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68grn" podUID="0cfa0994-c414-44f2-b02f-27b70e765bc0" Jul 08 16:34:47.991764 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:47.991430 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxr6" podUID="ab6fc392-dce6-4bfc-aa9d-2f99fd378c53" Jul 08 16:34:48.159294 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:48.159259 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6flz5" event={"ID":"781fe4a6-3af0-440e-959e-5a1201135619","Type":"ContainerStarted","Data":"735cdc97e68d6300afde2bd4918d7531ba436bdcc89b0eb763844c8a469835ab"} Jul 08 16:34:48.160571 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:48.160546 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-55np5" event={"ID":"967f78fb-318f-47a8-95a5-776c45f8eb8a","Type":"ContainerStarted","Data":"baf4f9e1ac9b4cea6129fc9eeaef8b425d8d5e4238286624cce8ffad425c6d10"} Jul 08 16:34:48.161797 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:48.161776 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4dbwk" event={"ID":"52e67dfa-9497-4bd7-aadd-aa91672c561c","Type":"ContainerStarted","Data":"3cf67e8b8a0caef4f47eca638c4f2b11bd86d1cd3e2905e1e5a7d32aac4733ab"} Jul 08 16:34:48.163026 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:48.163009 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r88w9" event={"ID":"2af41183-3d27-438a-a4b4-d1cea1df572a","Type":"ContainerStarted","Data":"9ad2002687097cb2d8b16dac914125ae52f7ed64c9fabebd801734497cacae4d"} Jul 08 16:34:48.165273 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:48.165254 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" event={"ID":"cfebfd20-7c02-468d-8ce6-3cae5e30391a","Type":"ContainerStarted","Data":"054b63fa18563511ed3f6f832b800e09dc90cf0dfce476b4974b670a5ca52373"} Jul 08 16:34:48.165344 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:48.165318 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" event={"ID":"cfebfd20-7c02-468d-8ce6-3cae5e30391a","Type":"ContainerStarted","Data":"8f8b31695119d2d07fa92b51199f2af714cb9b6b41a9c614a841d7a4366754ef"} Jul 08 16:34:48.165406 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:48.165349 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" event={"ID":"cfebfd20-7c02-468d-8ce6-3cae5e30391a","Type":"ContainerStarted","Data":"561893b1a16fd7738b31ede2f81ca3cd02458864f3ddfc58e6bc4cd0e9f9537f"} Jul 08 16:34:48.165406 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:48.165384 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" event={"ID":"cfebfd20-7c02-468d-8ce6-3cae5e30391a","Type":"ContainerStarted","Data":"9129c66e0569113a3c928d160ba19a207d482c073fc044bde420579267afe456"} Jul 08 16:34:48.165493 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:48.165420 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" event={"ID":"cfebfd20-7c02-468d-8ce6-3cae5e30391a","Type":"ContainerStarted","Data":"f79707050ab7a330098dfa7996b79f860f23ce86f438939aeae78e235335925e"} Jul 08 16:34:48.166725 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:48.166701 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" event={"ID":"6d610c40-b3e2-43e0-9c3e-cb0913dd90a6","Type":"ContainerStarted","Data":"e97774412a80955fbcd3fa2e1dbf274321b1332a846e589c99efa768df4b980d"} Jul 08 16:34:48.170156 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:48.170130 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" event={"ID":"a5768158-bf7e-4352-aaef-55503d187b80","Type":"ContainerStarted","Data":"34952abea4a84a23013c1938e6f790afb85700a466464c23254c13492153b71e"} Jul 08 16:34:48.171389 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:48.171367 2573 generic.go:356] "Generic (PLEG): container finished" podID="a7eac5be-6022-406e-8a03-f6e22b5a1f20" containerID="4d2398f832e67159570f7978b8e8824a97c5905369834ed9262a7fe8f5243a66" exitCode=0 Jul 08 16:34:48.171496 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:48.171399 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhvqv" event={"ID":"a7eac5be-6022-406e-8a03-f6e22b5a1f20","Type":"ContainerDied","Data":"4d2398f832e67159570f7978b8e8824a97c5905369834ed9262a7fe8f5243a66"} Jul 08 16:34:48.183874 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:48.183833 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-103.ec2.internal" podStartSLOduration=22.18382113 podStartE2EDuration="22.18382113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:31.143032293 +0000 UTC m=+5.691056030" watchObservedRunningTime="2026-07-08 16:34:48.18382113 +0000 UTC m=+22.731844913" Jul 08 16:34:48.184001 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:48.183924 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-55np5" podStartSLOduration=3.6580721069999997 podStartE2EDuration="22.183916666s" totalImagesPullingTime="18.525844559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:48.183393024 +0000 UTC m=+22.731416779" watchObservedRunningTime="2026-07-08 16:34:48.183916666 +0000 UTC m=+22.731940403" Jul 08 16:34:48.200514 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:48.200475 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zv2j8" podStartSLOduration=3.735106433 podStartE2EDuration="22.20046082s" totalImagesPullingTime="18.465354387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:48.200041812 +0000 UTC m=+22.748065569" watchObservedRunningTime="2026-07-08 16:34:48.20046082 +0000 UTC m=+22.748484557" Jul 08 16:34:48.298541 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:48.298429 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-r88w9" podStartSLOduration=3.820858924 podStartE2EDuration="22.298404842s" totalImagesPullingTime="18.477545918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:48.268312655 +0000 UTC m=+22.816336392" watchObservedRunningTime="2026-07-08 16:34:48.298404842 +0000 UTC m=+22.846428580" Jul 08 16:34:48.298775 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:48.298748 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4dbwk" podStartSLOduration=3.846991163 podStartE2EDuration="22.298736132s" totalImagesPullingTime="18.451744969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:48.298522705 +0000 UTC m=+22.846546460" watchObservedRunningTime="2026-07-08 16:34:48.298736132 +0000 UTC m=+22.846759869" Jul 08 16:34:48.832644 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:48.832615 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4dbwk" Jul 08 16:34:48.833264 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:48.833246 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4dbwk" Jul 08 16:34:48.848599 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:48.848557 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6flz5" podStartSLOduration=4.398798996 podStartE2EDuration="22.848538366s" totalImagesPullingTime="18.44973937s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:48.317754989 +0000 UTC m=+22.865778725" watchObservedRunningTime="2026-07-08 16:34:48.848538366 +0000 UTC m=+23.396562152" Jul 08 16:34:49.176727 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:49.176692 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" event={"ID":"cfebfd20-7c02-468d-8ce6-3cae5e30391a","Type":"ContainerStarted","Data":"3fa82a31dbe80493df1e1e8fc1579c625e06a043512047b19caa06e92f92b4a0"} Jul 08 16:34:49.178174 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:49.178144 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8tmjf" event={"ID":"04d6fce6-7129-47b4-80d3-72185a0a4bc9","Type":"ContainerStarted","Data":"503882d80d43f7eb6c5a58a23804ca681727d62afbe5af41ca1402bad5033dce"} Jul 08 16:34:49.178571 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:49.178545 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4dbwk" Jul 08 16:34:49.178974 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:49.178944 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4dbwk" Jul 08 16:34:49.194380 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:49.194336 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8tmjf" podStartSLOduration=4.744577969 podStartE2EDuration="23.194324403s" totalImagesPullingTime="18.449746434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:49.193976666 +0000 UTC m=+23.742000403" watchObservedRunningTime="2026-07-08 16:34:49.194324403 +0000 UTC m=+23.742348140" Jul 08 16:34:49.221810 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:49.221787 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 16:34:49.920660 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:49.920561 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T16:34:49.221805944Z","UUID":"42024ded-a2f7-4945-94c4-2a5ddb1e1231","Handler":null,"Name":"","Endpoint":""} Jul 08 16:34:49.922600 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:49.922572 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 16:34:49.922731 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:49.922619 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 16:34:49.991060 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:49.991027 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:49.991239 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:49.991027 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:49.991239 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:49.991155 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxr6" podUID="ab6fc392-dce6-4bfc-aa9d-2f99fd378c53" Jul 08 16:34:49.991239 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:49.991038 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:49.991239 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:49.991224 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66hzl" podUID="b7fb2341-8281-4190-896d-c994c69fbc08" Jul 08 16:34:49.991420 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:49.991276 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68grn" podUID="0cfa0994-c414-44f2-b02f-27b70e765bc0" Jul 08 16:34:50.183980 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:50.183866 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" event={"ID":"a5768158-bf7e-4352-aaef-55503d187b80","Type":"ContainerStarted","Data":"8127d159a8aeb6ccbccca7dd60720b69cd9ff5a6d3953c69f2d998f04c9cb938"} Jul 08 16:34:51.187715 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:51.187500 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" event={"ID":"a5768158-bf7e-4352-aaef-55503d187b80","Type":"ContainerStarted","Data":"44ec20875ea9f11329e7e3f0908f13e498987b4b2c990fd4aa1db140339afb00"} Jul 08 16:34:51.191372 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:51.191343 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" event={"ID":"cfebfd20-7c02-468d-8ce6-3cae5e30391a","Type":"ContainerStarted","Data":"4d82e86b933e36969aa3b956917b4dba57614f7cb0e6d4cc25c82041ddfb4193"} Jul 08 16:34:51.208590 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:51.208538 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sdnpv" podStartSLOduration=4.012738856 podStartE2EDuration="25.208510932s" totalImagesPullingTime="21.195772076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:51.207998804 +0000 UTC m=+25.756022569" watchObservedRunningTime="2026-07-08 16:34:51.208510932 +0000 UTC m=+25.756534668" Jul 08 16:34:51.991352 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:51.991318 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:51.991574 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:51.991359 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:51.991574 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:51.991451 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:51.991574 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:51.991464 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxr6" podUID="ab6fc392-dce6-4bfc-aa9d-2f99fd378c53" Jul 08 16:34:51.991574 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:51.991543 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68grn" podUID="0cfa0994-c414-44f2-b02f-27b70e765bc0" Jul 08 16:34:51.991801 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:51.991635 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66hzl" podUID="b7fb2341-8281-4190-896d-c994c69fbc08" Jul 08 16:34:53.199090 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:53.198869 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" event={"ID":"cfebfd20-7c02-468d-8ce6-3cae5e30391a","Type":"ContainerStarted","Data":"e9cc3f4f1619bb537f3ba377fe01512c1663c8d0872bfc40dc63387ceb58ca23"} Jul 08 16:34:53.199971 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:53.199133 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:53.200783 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:53.200754 2573 generic.go:356] "Generic (PLEG): container finished" podID="a7eac5be-6022-406e-8a03-f6e22b5a1f20" containerID="6f5a4f48b71844a2533e394953abc82154b18c47488a4820d99b8945cf434549" exitCode=0 Jul 08 16:34:53.200909 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:53.200798 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhvqv" event={"ID":"a7eac5be-6022-406e-8a03-f6e22b5a1f20","Type":"ContainerDied","Data":"6f5a4f48b71844a2533e394953abc82154b18c47488a4820d99b8945cf434549"} Jul 08 16:34:53.215519 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:53.215493 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:53.233145 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:53.233105 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" podStartSLOduration=8.700905921 podStartE2EDuration="27.233093075s" totalImagesPullingTime="18.532187154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:53.231961168 +0000 UTC m=+27.779984907" watchObservedRunningTime="2026-07-08 16:34:53.233093075 +0000 UTC m=+27.781116810" Jul 08 16:34:53.993443 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:53.993412 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:53.993722 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:53.993539 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68grn" podUID="0cfa0994-c414-44f2-b02f-27b70e765bc0" Jul 08 16:34:53.993902 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:53.993866 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:53.994027 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:53.994002 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxr6" podUID="ab6fc392-dce6-4bfc-aa9d-2f99fd378c53" Jul 08 16:34:53.994096 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:53.994073 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:53.994165 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:53.994145 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66hzl" podUID="b7fb2341-8281-4190-896d-c994c69fbc08" Jul 08 16:34:54.203825 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:54.203791 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:54.204345 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:54.203864 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:54.219512 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:54.219485 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:34:54.638404 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:54.638379 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bgxr6"] Jul 08 16:34:54.638528 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:54.638466 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:54.638570 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:54.638547 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxr6" podUID="ab6fc392-dce6-4bfc-aa9d-2f99fd378c53" Jul 08 16:34:54.641970 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:54.641948 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-66hzl"] Jul 08 16:34:54.642100 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:54.642032 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:54.642158 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:54.642117 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66hzl" podUID="b7fb2341-8281-4190-896d-c994c69fbc08" Jul 08 16:34:54.642654 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:54.642634 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-68grn"] Jul 08 16:34:54.642751 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:54.642704 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:54.642798 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:54.642781 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68grn" podUID="0cfa0994-c414-44f2-b02f-27b70e765bc0" Jul 08 16:34:55.207539 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:55.207501 2573 generic.go:356] "Generic (PLEG): container finished" podID="a7eac5be-6022-406e-8a03-f6e22b5a1f20" containerID="5e5723825af4e3ec0ff85f62cee6bf96a47b98a7ff5eafc9a64276db744ac6b4" exitCode=0 Jul 08 16:34:55.208012 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:55.207550 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhvqv" event={"ID":"a7eac5be-6022-406e-8a03-f6e22b5a1f20","Type":"ContainerDied","Data":"5e5723825af4e3ec0ff85f62cee6bf96a47b98a7ff5eafc9a64276db744ac6b4"} Jul 08 16:34:55.993494 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:55.993468 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:55.993667 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:55.993468 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:55.993667 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:55.993560 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66hzl" podUID="b7fb2341-8281-4190-896d-c994c69fbc08" Jul 08 16:34:55.993667 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:55.993649 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68grn" podUID="0cfa0994-c414-44f2-b02f-27b70e765bc0" Jul 08 16:34:55.993841 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:55.993468 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:55.993841 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:55.993763 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxr6" podUID="ab6fc392-dce6-4bfc-aa9d-2f99fd378c53" Jul 08 16:34:57.214208 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:57.213981 2573 generic.go:356] "Generic (PLEG): container finished" podID="a7eac5be-6022-406e-8a03-f6e22b5a1f20" containerID="026c72c16c49bbe1e255ad29de6e6638f4c4a711de8afb75737f49b1df8971ed" exitCode=0 Jul 08 16:34:57.214208 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:57.214028 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhvqv" event={"ID":"a7eac5be-6022-406e-8a03-f6e22b5a1f20","Type":"ContainerDied","Data":"026c72c16c49bbe1e255ad29de6e6638f4c4a711de8afb75737f49b1df8971ed"} Jul 08 16:34:57.990709 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:57.990670 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:57.990922 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:57.990776 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68grn" podUID="0cfa0994-c414-44f2-b02f-27b70e765bc0" Jul 08 16:34:57.990922 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:57.990670 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:57.990922 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:57.990839 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66hzl" podUID="b7fb2341-8281-4190-896d-c994c69fbc08" Jul 08 16:34:57.990922 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:57.990670 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:57.990922 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:57.990919 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxr6" podUID="ab6fc392-dce6-4bfc-aa9d-2f99fd378c53" Jul 08 16:34:59.629136 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:59.629093 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs\") pod \"network-metrics-daemon-bgxr6\" (UID: \"ab6fc392-dce6-4bfc-aa9d-2f99fd378c53\") " pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:59.629763 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:59.629248 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:59.629763 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:59.629318 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs podName:ab6fc392-dce6-4bfc-aa9d-2f99fd378c53 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:31.629296268 +0000 UTC m=+66.177320001 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs") pod "network-metrics-daemon-bgxr6" (UID: "ab6fc392-dce6-4bfc-aa9d-2f99fd378c53") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:59.730077 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:59.730041 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret\") pod \"global-pull-secret-syncer-66hzl\" (UID: \"b7fb2341-8281-4190-896d-c994c69fbc08\") " pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:59.730248 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:59.730197 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:59.730311 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:59.730271 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret podName:b7fb2341-8281-4190-896d-c994c69fbc08 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:31.730251649 +0000 UTC m=+66.278275379 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret") pod "global-pull-secret-syncer-66hzl" (UID: "b7fb2341-8281-4190-896d-c994c69fbc08") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:59.831164 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:59.831124 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8smz9\" (UniqueName: \"kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9\") pod \"network-check-target-68grn\" (UID: \"0cfa0994-c414-44f2-b02f-27b70e765bc0\") " pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:59.831332 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:59.831310 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:34:59.831384 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:59.831333 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:34:59.831384 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:59.831347 2573 projected.go:196] Error preparing data for projected volume kube-api-access-8smz9 for pod openshift-network-diagnostics/network-check-target-68grn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:59.831477 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:59.831410 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9 podName:0cfa0994-c414-44f2-b02f-27b70e765bc0 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:31.831390436 +0000 UTC m=+66.379414165 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8smz9" (UniqueName: "kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9") pod "network-check-target-68grn" (UID: "0cfa0994-c414-44f2-b02f-27b70e765bc0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:59.991545 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:59.991416 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:34:59.991545 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:59.991448 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:34:59.991545 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:34:59.991421 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:34:59.991796 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:59.991555 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxr6" podUID="ab6fc392-dce6-4bfc-aa9d-2f99fd378c53" Jul 08 16:34:59.991796 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:59.991692 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68grn" podUID="0cfa0994-c414-44f2-b02f-27b70e765bc0" Jul 08 16:34:59.991796 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:34:59.991778 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-66hzl" podUID="b7fb2341-8281-4190-896d-c994c69fbc08" Jul 08 16:35:01.251951 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.251920 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-103.ec2.internal" event="NodeReady" Jul 08 16:35:01.252441 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.252056 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 16:35:01.294684 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.294651 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-599d8ff9f8-djwp8"] Jul 08 16:35:01.297095 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.297075 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.299285 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.299222 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 16:35:01.299392 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.299371 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 16:35:01.299669 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.299655 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c8q5q\"" Jul 08 16:35:01.299817 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.299802 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 16:35:01.305583 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.305410 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 16:35:01.311812 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.311770 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-599d8ff9f8-djwp8"] Jul 08 16:35:01.320178 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.320141 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-48pb8"] Jul 08 16:35:01.321882 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.321863 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8xwcl"] Jul 08 16:35:01.322026 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.322008 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-48pb8" Jul 08 16:35:01.323630 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.323609 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8xwcl" Jul 08 16:35:01.326178 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.326161 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ztnq7\"" Jul 08 16:35:01.326475 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.326441 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 16:35:01.326475 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.326467 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 16:35:01.326903 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.326864 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 16:35:01.327014 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.326920 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 16:35:01.327014 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.326870 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 16:35:01.327114 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.327011 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6mtpn\"" Jul 08 16:35:01.333735 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.333706 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8xwcl"] Jul 08 16:35:01.338711 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.338654 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-48pb8"] Jul 08 16:35:01.445524 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.445483 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e82aa850-caf7-4a18-9901-2cf2c383a16e-image-registry-private-configuration\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.445524 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.445528 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-tmp-dir\") pod \"dns-default-48pb8\" (UID: \"ab27cf16-00d0-4e83-a2a8-2fd78083cfe4\") " pod="openshift-dns/dns-default-48pb8" Jul 08 16:35:01.445752 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.445549 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg827\" (UniqueName: \"kubernetes.io/projected/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-kube-api-access-gg827\") pod \"dns-default-48pb8\" (UID: \"ab27cf16-00d0-4e83-a2a8-2fd78083cfe4\") " pod="openshift-dns/dns-default-48pb8" Jul 08 16:35:01.445752 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.445627 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-certificates\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.445752 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.445674 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e82aa850-caf7-4a18-9901-2cf2c383a16e-ca-trust-extracted\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.445752 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.445702 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e82aa850-caf7-4a18-9901-2cf2c383a16e-trusted-ca\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.445752 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.445731 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e82aa850-caf7-4a18-9901-2cf2c383a16e-installation-pull-secrets\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.446018 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.445760 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b165419b-99f2-46fc-944a-588f787fbda8-cert\") pod \"ingress-canary-8xwcl\" (UID: \"b165419b-99f2-46fc-944a-588f787fbda8\") " pod="openshift-ingress-canary/ingress-canary-8xwcl" Jul 08 16:35:01.446018 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.445823 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-config-volume\") pod \"dns-default-48pb8\" (UID: \"ab27cf16-00d0-4e83-a2a8-2fd78083cfe4\") " pod="openshift-dns/dns-default-48pb8" Jul 08 16:35:01.446018 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.445871 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-bound-sa-token\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.446018 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.445956 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-metrics-tls\") pod \"dns-default-48pb8\" (UID: \"ab27cf16-00d0-4e83-a2a8-2fd78083cfe4\") " pod="openshift-dns/dns-default-48pb8" Jul 08 16:35:01.446018 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.445986 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.446018 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.446009 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9wl4\" (UniqueName: \"kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-kube-api-access-f9wl4\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.446236 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.446043 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c97w\" (UniqueName: \"kubernetes.io/projected/b165419b-99f2-46fc-944a-588f787fbda8-kube-api-access-7c97w\") pod \"ingress-canary-8xwcl\" (UID: \"b165419b-99f2-46fc-944a-588f787fbda8\") " pod="openshift-ingress-canary/ingress-canary-8xwcl" Jul 08 16:35:01.546877 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.546842 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-metrics-tls\") pod \"dns-default-48pb8\" (UID: \"ab27cf16-00d0-4e83-a2a8-2fd78083cfe4\") " pod="openshift-dns/dns-default-48pb8" Jul 08 16:35:01.547061 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.546907 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.547061 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.546931 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9wl4\" (UniqueName: \"kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-kube-api-access-f9wl4\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.547061 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.546953 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c97w\" (UniqueName: \"kubernetes.io/projected/b165419b-99f2-46fc-944a-588f787fbda8-kube-api-access-7c97w\") pod \"ingress-canary-8xwcl\" (UID: \"b165419b-99f2-46fc-944a-588f787fbda8\") " pod="openshift-ingress-canary/ingress-canary-8xwcl" Jul 08 16:35:01.547061 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.547005 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e82aa850-caf7-4a18-9901-2cf2c383a16e-image-registry-private-configuration\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.547061 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:01.547034 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 16:35:01.547313 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:01.547072 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 16:35:01.547313 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:01.547099 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-599d8ff9f8-djwp8: secret "image-registry-tls" not found Jul 08 16:35:01.547313 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:01.547111 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-metrics-tls podName:ab27cf16-00d0-4e83-a2a8-2fd78083cfe4 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:02.047093651 +0000 UTC m=+36.595117365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-metrics-tls") pod "dns-default-48pb8" (UID: "ab27cf16-00d0-4e83-a2a8-2fd78083cfe4") : secret "dns-default-metrics-tls" not found Jul 08 16:35:01.547313 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.547134 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-tmp-dir\") pod \"dns-default-48pb8\" (UID: \"ab27cf16-00d0-4e83-a2a8-2fd78083cfe4\") " pod="openshift-dns/dns-default-48pb8" Jul 08 16:35:01.547313 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:01.547156 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls podName:e82aa850-caf7-4a18-9901-2cf2c383a16e nodeName:}" failed. No retries permitted until 2026-07-08 16:35:02.047140516 +0000 UTC m=+36.595164235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls") pod "image-registry-599d8ff9f8-djwp8" (UID: "e82aa850-caf7-4a18-9901-2cf2c383a16e") : secret "image-registry-tls" not found Jul 08 16:35:01.547313 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.547183 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg827\" (UniqueName: \"kubernetes.io/projected/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-kube-api-access-gg827\") pod \"dns-default-48pb8\" (UID: \"ab27cf16-00d0-4e83-a2a8-2fd78083cfe4\") " pod="openshift-dns/dns-default-48pb8" Jul 08 16:35:01.547313 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.547220 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-certificates\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.547313 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.547265 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e82aa850-caf7-4a18-9901-2cf2c383a16e-ca-trust-extracted\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.547313 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.547287 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e82aa850-caf7-4a18-9901-2cf2c383a16e-trusted-ca\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.547313 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.547306 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e82aa850-caf7-4a18-9901-2cf2c383a16e-installation-pull-secrets\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.547776 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.547330 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b165419b-99f2-46fc-944a-588f787fbda8-cert\") pod \"ingress-canary-8xwcl\" (UID: \"b165419b-99f2-46fc-944a-588f787fbda8\") " pod="openshift-ingress-canary/ingress-canary-8xwcl" Jul 08 16:35:01.547776 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.547407 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-config-volume\") pod \"dns-default-48pb8\" (UID: \"ab27cf16-00d0-4e83-a2a8-2fd78083cfe4\") " pod="openshift-dns/dns-default-48pb8" Jul 08 16:35:01.547776 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.547428 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-tmp-dir\") pod \"dns-default-48pb8\" (UID: \"ab27cf16-00d0-4e83-a2a8-2fd78083cfe4\") " pod="openshift-dns/dns-default-48pb8" Jul 08 16:35:01.547776 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.547431 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-bound-sa-token\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.547999 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.547834 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-certificates\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.547999 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.547942 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-config-volume\") pod \"dns-default-48pb8\" (UID: \"ab27cf16-00d0-4e83-a2a8-2fd78083cfe4\") " pod="openshift-dns/dns-default-48pb8" Jul 08 16:35:01.548351 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.548312 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e82aa850-caf7-4a18-9901-2cf2c383a16e-trusted-ca\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.548351 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.548322 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e82aa850-caf7-4a18-9901-2cf2c383a16e-ca-trust-extracted\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.551926 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.551855 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e82aa850-caf7-4a18-9901-2cf2c383a16e-image-registry-private-configuration\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.551926 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.551910 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e82aa850-caf7-4a18-9901-2cf2c383a16e-installation-pull-secrets\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.552024 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.552015 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b165419b-99f2-46fc-944a-588f787fbda8-cert\") pod \"ingress-canary-8xwcl\" (UID: \"b165419b-99f2-46fc-944a-588f787fbda8\") " pod="openshift-ingress-canary/ingress-canary-8xwcl" Jul 08 16:35:01.559365 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.559306 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg827\" (UniqueName: \"kubernetes.io/projected/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-kube-api-access-gg827\") pod \"dns-default-48pb8\" (UID: \"ab27cf16-00d0-4e83-a2a8-2fd78083cfe4\") " pod="openshift-dns/dns-default-48pb8" Jul 08 16:35:01.560308 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.560287 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-bound-sa-token\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.560770 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.560754 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c97w\" (UniqueName: \"kubernetes.io/projected/b165419b-99f2-46fc-944a-588f787fbda8-kube-api-access-7c97w\") pod \"ingress-canary-8xwcl\" (UID: \"b165419b-99f2-46fc-944a-588f787fbda8\") " pod="openshift-ingress-canary/ingress-canary-8xwcl" Jul 08 16:35:01.562033 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.562010 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9wl4\" (UniqueName: \"kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-kube-api-access-f9wl4\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:01.588090 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.588060 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:01.639099 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.639067 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8xwcl" Jul 08 16:35:01.691930 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.691877 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:01.786613 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.786412 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:01.860002 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.859980 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8xwcl"] Jul 08 16:35:01.862853 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:35:01.862832 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb165419b_99f2_46fc_944a_588f787fbda8.slice/crio-65e6c34c4acf773c3137037b13455ea6a8bfb403aac4839c2da582fe84c9a9b8 WatchSource:0}: Error finding container 65e6c34c4acf773c3137037b13455ea6a8bfb403aac4839c2da582fe84c9a9b8: Status 404 returned error can't find the container with id 65e6c34c4acf773c3137037b13455ea6a8bfb403aac4839c2da582fe84c9a9b8 Jul 08 16:35:01.991027 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.991002 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:35:01.991117 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.991002 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:35:01.991299 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.991002 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:35:01.993656 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.993640 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 16:35:01.993656 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.993650 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pp6cc\"" Jul 08 16:35:01.993790 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.993671 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kw94b\"" Jul 08 16:35:01.993980 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.993957 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 16:35:01.994098 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.993957 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 16:35:01.994098 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:01.993969 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 16:35:02.052839 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:02.052800 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-metrics-tls\") pod \"dns-default-48pb8\" (UID: \"ab27cf16-00d0-4e83-a2a8-2fd78083cfe4\") " pod="openshift-dns/dns-default-48pb8" Jul 08 16:35:02.052991 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:02.052844 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:02.052991 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:02.052951 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 16:35:02.052991 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:02.052963 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-599d8ff9f8-djwp8: secret "image-registry-tls" not found Jul 08 16:35:02.052991 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:02.052976 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 16:35:02.053149 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:02.053020 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls podName:e82aa850-caf7-4a18-9901-2cf2c383a16e nodeName:}" failed. No retries permitted until 2026-07-08 16:35:03.053007078 +0000 UTC m=+37.601030792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls") pod "image-registry-599d8ff9f8-djwp8" (UID: "e82aa850-caf7-4a18-9901-2cf2c383a16e") : secret "image-registry-tls" not found Jul 08 16:35:02.053149 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:02.053047 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-metrics-tls podName:ab27cf16-00d0-4e83-a2a8-2fd78083cfe4 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:03.053028924 +0000 UTC m=+37.601052658 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-metrics-tls") pod "dns-default-48pb8" (UID: "ab27cf16-00d0-4e83-a2a8-2fd78083cfe4") : secret "dns-default-metrics-tls" not found Jul 08 16:35:02.227180 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:02.227146 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8xwcl" event={"ID":"b165419b-99f2-46fc-944a-588f787fbda8","Type":"ContainerStarted","Data":"65e6c34c4acf773c3137037b13455ea6a8bfb403aac4839c2da582fe84c9a9b8"} Jul 08 16:35:02.229632 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:02.229608 2573 generic.go:356] "Generic (PLEG): container finished" podID="a7eac5be-6022-406e-8a03-f6e22b5a1f20" containerID="45a4dd5d06cc349ed0f8eadd325e14cbdca0d6fd634bce5eda0de7e71dcf8d53" exitCode=0 Jul 08 16:35:02.229736 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:02.229643 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhvqv" event={"ID":"a7eac5be-6022-406e-8a03-f6e22b5a1f20","Type":"ContainerDied","Data":"45a4dd5d06cc349ed0f8eadd325e14cbdca0d6fd634bce5eda0de7e71dcf8d53"} Jul 08 16:35:03.061554 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:03.061516 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-metrics-tls\") pod \"dns-default-48pb8\" (UID: \"ab27cf16-00d0-4e83-a2a8-2fd78083cfe4\") " pod="openshift-dns/dns-default-48pb8" Jul 08 16:35:03.062097 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:03.061565 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:03.062097 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:03.061695 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 16:35:03.062097 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:03.061738 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 16:35:03.062097 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:03.061753 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-599d8ff9f8-djwp8: secret "image-registry-tls" not found Jul 08 16:35:03.062097 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:03.061772 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-metrics-tls podName:ab27cf16-00d0-4e83-a2a8-2fd78083cfe4 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:05.061752228 +0000 UTC m=+39.609775945 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-metrics-tls") pod "dns-default-48pb8" (UID: "ab27cf16-00d0-4e83-a2a8-2fd78083cfe4") : secret "dns-default-metrics-tls" not found Jul 08 16:35:03.062097 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:03.061792 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls podName:e82aa850-caf7-4a18-9901-2cf2c383a16e nodeName:}" failed. No retries permitted until 2026-07-08 16:35:05.061780319 +0000 UTC m=+39.609804034 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls") pod "image-registry-599d8ff9f8-djwp8" (UID: "e82aa850-caf7-4a18-9901-2cf2c383a16e") : secret "image-registry-tls" not found Jul 08 16:35:03.235977 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:03.235950 2573 generic.go:356] "Generic (PLEG): container finished" podID="a7eac5be-6022-406e-8a03-f6e22b5a1f20" containerID="676ffcc6275a15602856a2bc8a0c1d6af834bd0726b25bb1d447b48ffe812c21" exitCode=0 Jul 08 16:35:03.236111 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:03.235996 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhvqv" event={"ID":"a7eac5be-6022-406e-8a03-f6e22b5a1f20","Type":"ContainerDied","Data":"676ffcc6275a15602856a2bc8a0c1d6af834bd0726b25bb1d447b48ffe812c21"} Jul 08 16:35:03.518394 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:03.518218 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:03.582579 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:03.582544 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:03.700387 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:03.700350 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:04.242409 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:04.242378 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fhvqv" event={"ID":"a7eac5be-6022-406e-8a03-f6e22b5a1f20","Type":"ContainerStarted","Data":"dd03421b93f95dc55f4fbbc0738ee643e663992d46699a4b89a1354915b62e3e"} Jul 08 16:35:04.269264 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:04.269217 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fhvqv" podStartSLOduration=7.704872907 podStartE2EDuration="38.269201505s" totalImagesPullingTime="30.564328598s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:04.26774146 +0000 UTC m=+38.815765225" watchObservedRunningTime="2026-07-08 16:35:04.269201505 +0000 UTC m=+38.817225382" Jul 08 16:35:04.480265 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:04.480199 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:04.547531 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:04.547502 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:04.652923 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:04.652878 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:04.749120 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:04.749028 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:04.818743 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:04.818717 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:04.906816 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:04.906767 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:05.008120 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.008053 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:05.083328 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.083299 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-metrics-tls\") pod \"dns-default-48pb8\" (UID: \"ab27cf16-00d0-4e83-a2a8-2fd78083cfe4\") " pod="openshift-dns/dns-default-48pb8" Jul 08 16:35:05.083328 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.083328 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:05.083517 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:05.083442 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 16:35:05.083517 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:05.083489 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 16:35:05.083517 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:05.083501 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-metrics-tls podName:ab27cf16-00d0-4e83-a2a8-2fd78083cfe4 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:09.083487433 +0000 UTC m=+43.631511147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-metrics-tls") pod "dns-default-48pb8" (UID: "ab27cf16-00d0-4e83-a2a8-2fd78083cfe4") : secret "dns-default-metrics-tls" not found Jul 08 16:35:05.083517 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:05.083501 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-599d8ff9f8-djwp8: secret "image-registry-tls" not found Jul 08 16:35:05.083650 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:05.083530 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls podName:e82aa850-caf7-4a18-9901-2cf2c383a16e nodeName:}" failed. No retries permitted until 2026-07-08 16:35:09.083524197 +0000 UTC m=+43.631547911 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls") pod "image-registry-599d8ff9f8-djwp8" (UID: "e82aa850-caf7-4a18-9901-2cf2c383a16e") : secret "image-registry-tls" not found Jul 08 16:35:05.108232 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.108208 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:05.247146 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.247112 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8xwcl" event={"ID":"b165419b-99f2-46fc-944a-588f787fbda8","Type":"ContainerStarted","Data":"e8a9d4e5d667c04899009266290268c6653ff21d299ef10f5f9a4d4e787fe529"} Jul 08 16:35:05.266506 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.263687 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8xwcl" podStartSLOduration=1.588392012 podStartE2EDuration="4.263668237s" totalImagesPullingTime="2.675276225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:05.262686474 +0000 UTC m=+39.810710221" watchObservedRunningTime="2026-07-08 16:35:05.263668237 +0000 UTC m=+39.811691971" Jul 08 16:35:05.522642 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.522564 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv"] Jul 08 16:35:05.529236 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.529207 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:05.545464 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.545441 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-kbftc"] Jul 08 16:35:05.545591 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.545568 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv" Jul 08 16:35:05.548952 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.548920 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 16:35:05.548952 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.548920 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 16:35:05.549111 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.548976 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 08 16:35:05.549111 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.549050 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 08 16:35:05.549236 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.549224 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-q8t47\"" Jul 08 16:35:05.565536 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.565518 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-55c8746687-c4jzc"] Jul 08 16:35:05.565655 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.565641 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" Jul 08 16:35:05.568819 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.568792 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 08 16:35:05.568819 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.568802 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 08 16:35:05.569017 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.568861 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 16:35:05.569017 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.568798 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 16:35:05.569017 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.568975 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4ks85\"" Jul 08 16:35:05.573918 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.573883 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 08 16:35:05.591618 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.591601 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv"] Jul 08 16:35:05.591703 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.591637 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-kbftc"] Jul 08 16:35:05.591703 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.591651 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55c8746687-c4jzc"] Jul 08 16:35:05.591776 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.591722 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:05.594070 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.594049 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 16:35:05.594165 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.594049 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-p8c92\"" Jul 08 16:35:05.594165 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.594054 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 16:35:05.594464 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.594449 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 08 16:35:05.594511 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.594454 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 08 16:35:05.594511 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.594474 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 08 16:35:05.594687 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.594674 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 08 16:35:05.619433 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.619410 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h9ph9"] Jul 08 16:35:05.635677 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.635652 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-vsdvp"] Jul 08 16:35:05.635776 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.635695 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h9ph9" Jul 08 16:35:05.639320 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.639301 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 08 16:35:05.639436 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.639304 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6ptd7\"" Jul 08 16:35:05.639436 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.639389 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 08 16:35:05.657811 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.657782 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hgnz2"] Jul 08 16:35:05.657946 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.657908 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" Jul 08 16:35:05.660861 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.660842 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 08 16:35:05.661046 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.661033 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-9x55n\"" Jul 08 16:35:05.661095 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.661035 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 08 16:35:05.661213 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.661178 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 08 16:35:05.662261 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.661962 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 08 16:35:05.670442 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.670422 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 08 16:35:05.681896 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.681875 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6rgk2"] Jul 08 16:35:05.682015 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.682001 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hgnz2" Jul 08 16:35:05.684288 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.684269 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 08 16:35:05.684396 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.684298 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 08 16:35:05.684957 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.684937 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 08 16:35:05.685081 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.685066 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 08 16:35:05.685144 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.685079 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-m28q5\"" Jul 08 16:35:05.687209 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.687188 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/38f0ff13-08e1-408a-b4c9-3526ab67f705-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-vzlfv\" (UID: \"38f0ff13-08e1-408a-b4c9-3526ab67f705\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv" Jul 08 16:35:05.687298 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.687213 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1816c65a-cbd4-4aa1-a834-577c758bd2b8-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-kbftc\" (UID: \"1816c65a-cbd4-4aa1-a834-577c758bd2b8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" Jul 08 16:35:05.687298 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.687232 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1816c65a-cbd4-4aa1-a834-577c758bd2b8-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-kbftc\" (UID: \"1816c65a-cbd4-4aa1-a834-577c758bd2b8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" Jul 08 16:35:05.687298 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.687257 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d742f12e-0c93-4210-8ec1-88167c556ae5-service-ca-bundle\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:05.687452 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.687315 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-stats-auth\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:05.687452 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.687356 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74tmw\" (UniqueName: \"kubernetes.io/projected/d742f12e-0c93-4210-8ec1-88167c556ae5-kube-api-access-74tmw\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:05.687452 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.687382 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb99v\" (UniqueName: \"kubernetes.io/projected/1816c65a-cbd4-4aa1-a834-577c758bd2b8-kube-api-access-rb99v\") pod \"insights-operator-5c847dcfc4-kbftc\" (UID: \"1816c65a-cbd4-4aa1-a834-577c758bd2b8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" Jul 08 16:35:05.687452 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.687411 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-default-certificate\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:05.687733 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.687455 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-metrics-certs\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:05.687733 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.687523 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtzj6\" (UniqueName: \"kubernetes.io/projected/38f0ff13-08e1-408a-b4c9-3526ab67f705-kube-api-access-vtzj6\") pod \"cluster-monitoring-operator-64786d9cbb-vzlfv\" (UID: \"38f0ff13-08e1-408a-b4c9-3526ab67f705\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv" Jul 08 16:35:05.687733 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.687549 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1816c65a-cbd4-4aa1-a834-577c758bd2b8-snapshots\") pod \"insights-operator-5c847dcfc4-kbftc\" (UID: \"1816c65a-cbd4-4aa1-a834-577c758bd2b8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" Jul 08 16:35:05.687733 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.687573 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1816c65a-cbd4-4aa1-a834-577c758bd2b8-serving-cert\") pod \"insights-operator-5c847dcfc4-kbftc\" (UID: \"1816c65a-cbd4-4aa1-a834-577c758bd2b8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" Jul 08 16:35:05.687733 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.687601 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38f0ff13-08e1-408a-b4c9-3526ab67f705-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vzlfv\" (UID: \"38f0ff13-08e1-408a-b4c9-3526ab67f705\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv" Jul 08 16:35:05.687733 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.687625 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1816c65a-cbd4-4aa1-a834-577c758bd2b8-tmp\") pod \"insights-operator-5c847dcfc4-kbftc\" (UID: \"1816c65a-cbd4-4aa1-a834-577c758bd2b8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" Jul 08 16:35:05.701952 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.701930 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww2f6"] Jul 08 16:35:05.702052 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.702040 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6rgk2" Jul 08 16:35:05.705115 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.705092 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 08 16:35:05.705184 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.705146 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rsxpg\"" Jul 08 16:35:05.705417 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.705402 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 08 16:35:05.705495 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.705482 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 08 16:35:05.706172 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.706156 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 08 16:35:05.724139 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.724122 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h9ph9"] Jul 08 16:35:05.724241 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.724155 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-vsdvp"] Jul 08 16:35:05.724241 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.724174 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww2f6"] Jul 08 16:35:05.724241 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.724198 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hgnz2"] Jul 08 16:35:05.724241 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.724216 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6rgk2"] Jul 08 16:35:05.724241 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.724228 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww2f6" Jul 08 16:35:05.726407 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.726390 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 08 16:35:05.726487 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.726430 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 08 16:35:05.726487 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.726472 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 08 16:35:05.726594 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.726504 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pvrjc\"" Jul 08 16:35:05.760058 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.760029 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:05.788903 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.788830 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8-serving-cert\") pod \"console-operator-68b757fb67-vsdvp\" (UID: \"6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8\") " pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" Jul 08 16:35:05.788903 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.788867 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtzj6\" (UniqueName: \"kubernetes.io/projected/38f0ff13-08e1-408a-b4c9-3526ab67f705-kube-api-access-vtzj6\") pod \"cluster-monitoring-operator-64786d9cbb-vzlfv\" (UID: \"38f0ff13-08e1-408a-b4c9-3526ab67f705\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv" Jul 08 16:35:05.789026 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.788904 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1816c65a-cbd4-4aa1-a834-577c758bd2b8-snapshots\") pod \"insights-operator-5c847dcfc4-kbftc\" (UID: \"1816c65a-cbd4-4aa1-a834-577c758bd2b8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" Jul 08 16:35:05.789026 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.788928 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1816c65a-cbd4-4aa1-a834-577c758bd2b8-serving-cert\") pod \"insights-operator-5c847dcfc4-kbftc\" (UID: \"1816c65a-cbd4-4aa1-a834-577c758bd2b8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" Jul 08 16:35:05.789026 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.788974 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38f0ff13-08e1-408a-b4c9-3526ab67f705-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vzlfv\" (UID: \"38f0ff13-08e1-408a-b4c9-3526ab67f705\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv" Jul 08 16:35:05.789026 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.788994 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1816c65a-cbd4-4aa1-a834-577c758bd2b8-tmp\") pod \"insights-operator-5c847dcfc4-kbftc\" (UID: \"1816c65a-cbd4-4aa1-a834-577c758bd2b8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" Jul 08 16:35:05.789172 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.789033 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s72dc\" (UniqueName: \"kubernetes.io/projected/0b3c6c71-4820-4470-b23a-538a5422b776-kube-api-access-s72dc\") pod \"service-ca-operator-5d46d9ffd4-hgnz2\" (UID: \"0b3c6c71-4820-4470-b23a-538a5422b776\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hgnz2" Jul 08 16:35:05.789172 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.789070 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8-config\") pod \"console-operator-68b757fb67-vsdvp\" (UID: \"6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8\") " pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" Jul 08 16:35:05.789172 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:05.789085 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:05.789172 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.789113 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/38f0ff13-08e1-408a-b4c9-3526ab67f705-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-vzlfv\" (UID: \"38f0ff13-08e1-408a-b4c9-3526ab67f705\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv" Jul 08 16:35:05.789172 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.789136 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1816c65a-cbd4-4aa1-a834-577c758bd2b8-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-kbftc\" (UID: \"1816c65a-cbd4-4aa1-a834-577c758bd2b8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" Jul 08 16:35:05.789172 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:05.789155 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38f0ff13-08e1-408a-b4c9-3526ab67f705-cluster-monitoring-operator-tls podName:38f0ff13-08e1-408a-b4c9-3526ab67f705 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:06.289137384 +0000 UTC m=+40.837161116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/38f0ff13-08e1-408a-b4c9-3526ab67f705-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vzlfv" (UID: "38f0ff13-08e1-408a-b4c9-3526ab67f705") : secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:05.789437 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.789195 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1816c65a-cbd4-4aa1-a834-577c758bd2b8-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-kbftc\" (UID: \"1816c65a-cbd4-4aa1-a834-577c758bd2b8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" Jul 08 16:35:05.789437 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.789224 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d742f12e-0c93-4210-8ec1-88167c556ae5-service-ca-bundle\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:05.789437 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.789258 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8-trusted-ca\") pod \"console-operator-68b757fb67-vsdvp\" (UID: \"6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8\") " pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" Jul 08 16:35:05.789437 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.789299 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqxct\" (UniqueName: \"kubernetes.io/projected/6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8-kube-api-access-fqxct\") pod \"console-operator-68b757fb67-vsdvp\" (UID: \"6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8\") " pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" Jul 08 16:35:05.789437 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.789326 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0b3c6c71-4820-4470-b23a-538a5422b776-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-hgnz2\" (UID: \"0b3c6c71-4820-4470-b23a-538a5422b776\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hgnz2" Jul 08 16:35:05.789437 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.789366 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-stats-auth\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:05.789437 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.789390 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74tmw\" (UniqueName: \"kubernetes.io/projected/d742f12e-0c93-4210-8ec1-88167c556ae5-kube-api-access-74tmw\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:05.789437 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.789422 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb99v\" (UniqueName: \"kubernetes.io/projected/1816c65a-cbd4-4aa1-a834-577c758bd2b8-kube-api-access-rb99v\") pod \"insights-operator-5c847dcfc4-kbftc\" (UID: \"1816c65a-cbd4-4aa1-a834-577c758bd2b8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" Jul 08 16:35:05.789803 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.789467 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-default-certificate\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:05.789803 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.789512 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1816c65a-cbd4-4aa1-a834-577c758bd2b8-tmp\") pod \"insights-operator-5c847dcfc4-kbftc\" (UID: \"1816c65a-cbd4-4aa1-a834-577c758bd2b8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" Jul 08 16:35:05.789803 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.789533 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-metrics-certs\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:05.789803 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.789572 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0b3c6c71-4820-4470-b23a-538a5422b776-config\") pod \"service-ca-operator-5d46d9ffd4-hgnz2\" (UID: \"0b3c6c71-4820-4470-b23a-538a5422b776\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hgnz2" Jul 08 16:35:05.789803 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.789576 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1816c65a-cbd4-4aa1-a834-577c758bd2b8-snapshots\") pod \"insights-operator-5c847dcfc4-kbftc\" (UID: \"1816c65a-cbd4-4aa1-a834-577c758bd2b8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" Jul 08 16:35:05.789803 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.789615 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfjqp\" (UniqueName: \"kubernetes.io/projected/9c5e1f75-e9f6-46e0-91b0-3d362290a384-kube-api-access-kfjqp\") pod \"volume-data-source-validator-5d456fdbcd-h9ph9\" (UID: \"9c5e1f75-e9f6-46e0-91b0-3d362290a384\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h9ph9" Jul 08 16:35:05.789803 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:05.789668 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 16:35:05.789803 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:05.789724 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-metrics-certs podName:d742f12e-0c93-4210-8ec1-88167c556ae5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:06.28970914 +0000 UTC m=+40.837732867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-metrics-certs") pod "router-default-55c8746687-c4jzc" (UID: "d742f12e-0c93-4210-8ec1-88167c556ae5") : secret "router-metrics-certs-default" not found Jul 08 16:35:05.789803 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:05.789767 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d742f12e-0c93-4210-8ec1-88167c556ae5-service-ca-bundle podName:d742f12e-0c93-4210-8ec1-88167c556ae5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:06.289752758 +0000 UTC m=+40.837776504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d742f12e-0c93-4210-8ec1-88167c556ae5-service-ca-bundle") pod "router-default-55c8746687-c4jzc" (UID: "d742f12e-0c93-4210-8ec1-88167c556ae5") : configmap references non-existent config key: service-ca.crt Jul 08 16:35:05.790273 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.789956 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/38f0ff13-08e1-408a-b4c9-3526ab67f705-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-vzlfv\" (UID: \"38f0ff13-08e1-408a-b4c9-3526ab67f705\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv" Jul 08 16:35:05.790273 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.790105 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1816c65a-cbd4-4aa1-a834-577c758bd2b8-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-kbftc\" (UID: \"1816c65a-cbd4-4aa1-a834-577c758bd2b8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" Jul 08 16:35:05.790610 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.790585 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1816c65a-cbd4-4aa1-a834-577c758bd2b8-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-kbftc\" (UID: \"1816c65a-cbd4-4aa1-a834-577c758bd2b8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" Jul 08 16:35:05.793190 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.793166 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1816c65a-cbd4-4aa1-a834-577c758bd2b8-serving-cert\") pod \"insights-operator-5c847dcfc4-kbftc\" (UID: \"1816c65a-cbd4-4aa1-a834-577c758bd2b8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" Jul 08 16:35:05.793274 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.793258 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-stats-auth\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:05.793347 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.793329 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-default-certificate\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:05.799996 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.799973 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb99v\" (UniqueName: \"kubernetes.io/projected/1816c65a-cbd4-4aa1-a834-577c758bd2b8-kube-api-access-rb99v\") pod \"insights-operator-5c847dcfc4-kbftc\" (UID: \"1816c65a-cbd4-4aa1-a834-577c758bd2b8\") " pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" Jul 08 16:35:05.800240 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.800222 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtzj6\" (UniqueName: \"kubernetes.io/projected/38f0ff13-08e1-408a-b4c9-3526ab67f705-kube-api-access-vtzj6\") pod \"cluster-monitoring-operator-64786d9cbb-vzlfv\" (UID: \"38f0ff13-08e1-408a-b4c9-3526ab67f705\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv" Jul 08 16:35:05.800385 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.800370 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74tmw\" (UniqueName: \"kubernetes.io/projected/d742f12e-0c93-4210-8ec1-88167c556ae5-kube-api-access-74tmw\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:05.860416 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.860385 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:05.874267 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.874243 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" Jul 08 16:35:05.890619 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.890592 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0b3c6c71-4820-4470-b23a-538a5422b776-config\") pod \"service-ca-operator-5d46d9ffd4-hgnz2\" (UID: \"0b3c6c71-4820-4470-b23a-538a5422b776\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hgnz2" Jul 08 16:35:05.890695 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.890627 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5v6n\" (UniqueName: \"kubernetes.io/projected/3f53b384-0ddb-4701-9b3d-0c4761b75d9d-kube-api-access-z5v6n\") pod \"cluster-samples-operator-56fcf86bf-ww2f6\" (UID: \"3f53b384-0ddb-4701-9b3d-0c4761b75d9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww2f6" Jul 08 16:35:05.890695 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.890650 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfjqp\" (UniqueName: \"kubernetes.io/projected/9c5e1f75-e9f6-46e0-91b0-3d362290a384-kube-api-access-kfjqp\") pod \"volume-data-source-validator-5d456fdbcd-h9ph9\" (UID: \"9c5e1f75-e9f6-46e0-91b0-3d362290a384\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h9ph9" Jul 08 16:35:05.890695 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.890682 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8-serving-cert\") pod \"console-operator-68b757fb67-vsdvp\" (UID: \"6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8\") " pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" Jul 08 16:35:05.890812 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.890716 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s72dc\" (UniqueName: \"kubernetes.io/projected/0b3c6c71-4820-4470-b23a-538a5422b776-kube-api-access-s72dc\") pod \"service-ca-operator-5d46d9ffd4-hgnz2\" (UID: \"0b3c6c71-4820-4470-b23a-538a5422b776\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hgnz2" Jul 08 16:35:05.890812 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.890735 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8-config\") pod \"console-operator-68b757fb67-vsdvp\" (UID: \"6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8\") " pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" Jul 08 16:35:05.890812 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.890753 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f53b384-0ddb-4701-9b3d-0c4761b75d9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ww2f6\" (UID: \"3f53b384-0ddb-4701-9b3d-0c4761b75d9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww2f6" Jul 08 16:35:05.890812 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.890775 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f22fd4ec-e3b0-4718-851d-629899796803-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-6rgk2\" (UID: \"f22fd4ec-e3b0-4718-851d-629899796803\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6rgk2" Jul 08 16:35:05.891010 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.890875 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n5fc\" (UniqueName: \"kubernetes.io/projected/f22fd4ec-e3b0-4718-851d-629899796803-kube-api-access-6n5fc\") pod \"kube-storage-version-migrator-operator-846bf668f7-6rgk2\" (UID: \"f22fd4ec-e3b0-4718-851d-629899796803\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6rgk2" Jul 08 16:35:05.891010 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.890953 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f22fd4ec-e3b0-4718-851d-629899796803-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-6rgk2\" (UID: \"f22fd4ec-e3b0-4718-851d-629899796803\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6rgk2" Jul 08 16:35:05.891106 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.891025 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8-trusted-ca\") pod \"console-operator-68b757fb67-vsdvp\" (UID: \"6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8\") " pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" Jul 08 16:35:05.891106 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.891070 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqxct\" (UniqueName: \"kubernetes.io/projected/6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8-kube-api-access-fqxct\") pod \"console-operator-68b757fb67-vsdvp\" (UID: \"6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8\") " pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" Jul 08 16:35:05.891106 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.891100 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0b3c6c71-4820-4470-b23a-538a5422b776-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-hgnz2\" (UID: \"0b3c6c71-4820-4470-b23a-538a5422b776\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hgnz2" Jul 08 16:35:05.891312 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.891291 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0b3c6c71-4820-4470-b23a-538a5422b776-config\") pod \"service-ca-operator-5d46d9ffd4-hgnz2\" (UID: \"0b3c6c71-4820-4470-b23a-538a5422b776\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hgnz2" Jul 08 16:35:05.891463 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.891438 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8-config\") pod \"console-operator-68b757fb67-vsdvp\" (UID: \"6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8\") " pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" Jul 08 16:35:05.891684 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.891665 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8-trusted-ca\") pod \"console-operator-68b757fb67-vsdvp\" (UID: \"6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8\") " pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" Jul 08 16:35:05.893053 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.893035 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0b3c6c71-4820-4470-b23a-538a5422b776-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-hgnz2\" (UID: \"0b3c6c71-4820-4470-b23a-538a5422b776\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hgnz2" Jul 08 16:35:05.893162 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.893143 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8-serving-cert\") pod \"console-operator-68b757fb67-vsdvp\" (UID: \"6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8\") " pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" Jul 08 16:35:05.899062 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.899042 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s72dc\" (UniqueName: \"kubernetes.io/projected/0b3c6c71-4820-4470-b23a-538a5422b776-kube-api-access-s72dc\") pod \"service-ca-operator-5d46d9ffd4-hgnz2\" (UID: \"0b3c6c71-4820-4470-b23a-538a5422b776\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hgnz2" Jul 08 16:35:05.899488 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.899473 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfjqp\" (UniqueName: \"kubernetes.io/projected/9c5e1f75-e9f6-46e0-91b0-3d362290a384-kube-api-access-kfjqp\") pod \"volume-data-source-validator-5d456fdbcd-h9ph9\" (UID: \"9c5e1f75-e9f6-46e0-91b0-3d362290a384\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h9ph9" Jul 08 16:35:05.902079 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.902063 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqxct\" (UniqueName: \"kubernetes.io/projected/6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8-kube-api-access-fqxct\") pod \"console-operator-68b757fb67-vsdvp\" (UID: \"6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8\") " pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" Jul 08 16:35:05.946364 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.946335 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h9ph9" Jul 08 16:35:05.966219 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.966194 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" Jul 08 16:35:05.990196 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.990168 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hgnz2" Jul 08 16:35:05.991638 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.991473 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5v6n\" (UniqueName: \"kubernetes.io/projected/3f53b384-0ddb-4701-9b3d-0c4761b75d9d-kube-api-access-z5v6n\") pod \"cluster-samples-operator-56fcf86bf-ww2f6\" (UID: \"3f53b384-0ddb-4701-9b3d-0c4761b75d9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww2f6" Jul 08 16:35:05.991638 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.991527 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f53b384-0ddb-4701-9b3d-0c4761b75d9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ww2f6\" (UID: \"3f53b384-0ddb-4701-9b3d-0c4761b75d9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww2f6" Jul 08 16:35:05.991638 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.991543 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f22fd4ec-e3b0-4718-851d-629899796803-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-6rgk2\" (UID: \"f22fd4ec-e3b0-4718-851d-629899796803\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6rgk2" Jul 08 16:35:05.993486 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.991564 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n5fc\" (UniqueName: \"kubernetes.io/projected/f22fd4ec-e3b0-4718-851d-629899796803-kube-api-access-6n5fc\") pod \"kube-storage-version-migrator-operator-846bf668f7-6rgk2\" (UID: \"f22fd4ec-e3b0-4718-851d-629899796803\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6rgk2" Jul 08 16:35:05.993486 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:05.992138 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 16:35:05.993486 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.992170 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f22fd4ec-e3b0-4718-851d-629899796803-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-6rgk2\" (UID: \"f22fd4ec-e3b0-4718-851d-629899796803\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6rgk2" Jul 08 16:35:05.993486 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:05.992776 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f53b384-0ddb-4701-9b3d-0c4761b75d9d-samples-operator-tls podName:3f53b384-0ddb-4701-9b3d-0c4761b75d9d nodeName:}" failed. No retries permitted until 2026-07-08 16:35:06.492747737 +0000 UTC m=+41.040771467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3f53b384-0ddb-4701-9b3d-0c4761b75d9d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ww2f6" (UID: "3f53b384-0ddb-4701-9b3d-0c4761b75d9d") : secret "samples-operator-tls" not found Jul 08 16:35:05.994947 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.994102 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f22fd4ec-e3b0-4718-851d-629899796803-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-6rgk2\" (UID: \"f22fd4ec-e3b0-4718-851d-629899796803\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6rgk2" Jul 08 16:35:05.997192 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:05.997091 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f22fd4ec-e3b0-4718-851d-629899796803-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-6rgk2\" (UID: \"f22fd4ec-e3b0-4718-851d-629899796803\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6rgk2" Jul 08 16:35:06.002872 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:06.002832 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n5fc\" (UniqueName: \"kubernetes.io/projected/f22fd4ec-e3b0-4718-851d-629899796803-kube-api-access-6n5fc\") pod \"kube-storage-version-migrator-operator-846bf668f7-6rgk2\" (UID: \"f22fd4ec-e3b0-4718-851d-629899796803\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6rgk2" Jul 08 16:35:06.003278 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:06.003261 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5v6n\" (UniqueName: \"kubernetes.io/projected/3f53b384-0ddb-4701-9b3d-0c4761b75d9d-kube-api-access-z5v6n\") pod \"cluster-samples-operator-56fcf86bf-ww2f6\" (UID: \"3f53b384-0ddb-4701-9b3d-0c4761b75d9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww2f6" Jul 08 16:35:06.011016 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:06.010992 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6rgk2" Jul 08 16:35:06.023759 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:06.023470 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-kbftc"] Jul 08 16:35:06.028390 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:35:06.028336 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1816c65a_cbd4_4aa1_a834_577c758bd2b8.slice/crio-6b8b3eb4e71413453018fbd3e73a55871e9d2220b668cef5fa0a03f201f79111 WatchSource:0}: Error finding container 6b8b3eb4e71413453018fbd3e73a55871e9d2220b668cef5fa0a03f201f79111: Status 404 returned error can't find the container with id 6b8b3eb4e71413453018fbd3e73a55871e9d2220b668cef5fa0a03f201f79111 Jul 08 16:35:06.121376 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:06.121344 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h9ph9"] Jul 08 16:35:06.124481 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:35:06.124417 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c5e1f75_e9f6_46e0_91b0_3d362290a384.slice/crio-760a319e829b2a4332ba9ad642145ac5c896be80834d04f501554e39e3a632f0 WatchSource:0}: Error finding container 760a319e829b2a4332ba9ad642145ac5c896be80834d04f501554e39e3a632f0: Status 404 returned error can't find the container with id 760a319e829b2a4332ba9ad642145ac5c896be80834d04f501554e39e3a632f0 Jul 08 16:35:06.146034 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:06.146006 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-vsdvp"] Jul 08 16:35:06.148801 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:35:06.148761 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ea3bd01_82b9_4ebf_8293_c2dfd33a61c8.slice/crio-92fb7f301cd75c0a52ed7849a69b4be7b0fccf9c53c35b841805c7ae03ee7cac WatchSource:0}: Error finding container 92fb7f301cd75c0a52ed7849a69b4be7b0fccf9c53c35b841805c7ae03ee7cac: Status 404 returned error can't find the container with id 92fb7f301cd75c0a52ed7849a69b4be7b0fccf9c53c35b841805c7ae03ee7cac Jul 08 16:35:06.175103 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:06.175074 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hgnz2"] Jul 08 16:35:06.177872 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:35:06.177847 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b3c6c71_4820_4470_b23a_538a5422b776.slice/crio-155f40dba1a44c074f7a6dd44fa6a6eec3ec0b2adb37085b5f74617ebe58d144 WatchSource:0}: Error finding container 155f40dba1a44c074f7a6dd44fa6a6eec3ec0b2adb37085b5f74617ebe58d144: Status 404 returned error can't find the container with id 155f40dba1a44c074f7a6dd44fa6a6eec3ec0b2adb37085b5f74617ebe58d144 Jul 08 16:35:06.198230 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:06.198201 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6rgk2"] Jul 08 16:35:06.200955 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:35:06.200934 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf22fd4ec_e3b0_4718_851d_629899796803.slice/crio-ad558b01627f4f7fac4d7c89b86d058b2d64e534b1d9a54534d2a94ebbea178a WatchSource:0}: Error finding container ad558b01627f4f7fac4d7c89b86d058b2d64e534b1d9a54534d2a94ebbea178a: Status 404 returned error can't find the container with id ad558b01627f4f7fac4d7c89b86d058b2d64e534b1d9a54534d2a94ebbea178a Jul 08 16:35:06.250940 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:06.250908 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6rgk2" event={"ID":"f22fd4ec-e3b0-4718-851d-629899796803","Type":"ContainerStarted","Data":"ad558b01627f4f7fac4d7c89b86d058b2d64e534b1d9a54534d2a94ebbea178a"} Jul 08 16:35:06.251959 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:06.251930 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hgnz2" event={"ID":"0b3c6c71-4820-4470-b23a-538a5422b776","Type":"ContainerStarted","Data":"155f40dba1a44c074f7a6dd44fa6a6eec3ec0b2adb37085b5f74617ebe58d144"} Jul 08 16:35:06.252839 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:06.252807 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" event={"ID":"1816c65a-cbd4-4aa1-a834-577c758bd2b8","Type":"ContainerStarted","Data":"6b8b3eb4e71413453018fbd3e73a55871e9d2220b668cef5fa0a03f201f79111"} Jul 08 16:35:06.253760 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:06.253739 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" event={"ID":"6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8","Type":"ContainerStarted","Data":"92fb7f301cd75c0a52ed7849a69b4be7b0fccf9c53c35b841805c7ae03ee7cac"} Jul 08 16:35:06.254580 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:06.254564 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h9ph9" event={"ID":"9c5e1f75-e9f6-46e0-91b0-3d362290a384","Type":"ContainerStarted","Data":"760a319e829b2a4332ba9ad642145ac5c896be80834d04f501554e39e3a632f0"} Jul 08 16:35:06.296128 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:06.296046 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d742f12e-0c93-4210-8ec1-88167c556ae5-service-ca-bundle\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:06.296128 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:06.296114 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-metrics-certs\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:06.296337 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:06.296156 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38f0ff13-08e1-408a-b4c9-3526ab67f705-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vzlfv\" (UID: \"38f0ff13-08e1-408a-b4c9-3526ab67f705\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv" Jul 08 16:35:06.296337 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:06.296212 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d742f12e-0c93-4210-8ec1-88167c556ae5-service-ca-bundle podName:d742f12e-0c93-4210-8ec1-88167c556ae5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:07.296195987 +0000 UTC m=+41.844219701 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d742f12e-0c93-4210-8ec1-88167c556ae5-service-ca-bundle") pod "router-default-55c8746687-c4jzc" (UID: "d742f12e-0c93-4210-8ec1-88167c556ae5") : configmap references non-existent config key: service-ca.crt Jul 08 16:35:06.296337 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:06.296216 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 16:35:06.296337 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:06.296251 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-metrics-certs podName:d742f12e-0c93-4210-8ec1-88167c556ae5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:07.296244854 +0000 UTC m=+41.844268568 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-metrics-certs") pod "router-default-55c8746687-c4jzc" (UID: "d742f12e-0c93-4210-8ec1-88167c556ae5") : secret "router-metrics-certs-default" not found Jul 08 16:35:06.296337 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:06.296265 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:06.296337 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:06.296305 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38f0ff13-08e1-408a-b4c9-3526ab67f705-cluster-monitoring-operator-tls podName:38f0ff13-08e1-408a-b4c9-3526ab67f705 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:07.296295261 +0000 UTC m=+41.844318975 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/38f0ff13-08e1-408a-b4c9-3526ab67f705-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vzlfv" (UID: "38f0ff13-08e1-408a-b4c9-3526ab67f705") : secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:06.498051 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:06.498018 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f53b384-0ddb-4701-9b3d-0c4761b75d9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ww2f6\" (UID: \"3f53b384-0ddb-4701-9b3d-0c4761b75d9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww2f6" Jul 08 16:35:06.498268 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:06.498202 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 16:35:06.498333 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:06.498293 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f53b384-0ddb-4701-9b3d-0c4761b75d9d-samples-operator-tls podName:3f53b384-0ddb-4701-9b3d-0c4761b75d9d nodeName:}" failed. No retries permitted until 2026-07-08 16:35:07.49826986 +0000 UTC m=+42.046293587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3f53b384-0ddb-4701-9b3d-0c4761b75d9d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ww2f6" (UID: "3f53b384-0ddb-4701-9b3d-0c4761b75d9d") : secret "samples-operator-tls" not found Jul 08 16:35:07.306177 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:07.306135 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-metrics-certs\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:07.306660 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:07.306228 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38f0ff13-08e1-408a-b4c9-3526ab67f705-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vzlfv\" (UID: \"38f0ff13-08e1-408a-b4c9-3526ab67f705\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv" Jul 08 16:35:07.306660 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:07.306300 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d742f12e-0c93-4210-8ec1-88167c556ae5-service-ca-bundle\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:07.306660 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:07.306428 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d742f12e-0c93-4210-8ec1-88167c556ae5-service-ca-bundle podName:d742f12e-0c93-4210-8ec1-88167c556ae5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:09.306412315 +0000 UTC m=+43.854436049 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d742f12e-0c93-4210-8ec1-88167c556ae5-service-ca-bundle") pod "router-default-55c8746687-c4jzc" (UID: "d742f12e-0c93-4210-8ec1-88167c556ae5") : configmap references non-existent config key: service-ca.crt Jul 08 16:35:07.306822 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:07.306743 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 16:35:07.306822 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:07.306780 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-metrics-certs podName:d742f12e-0c93-4210-8ec1-88167c556ae5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:09.306769775 +0000 UTC m=+43.854793489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-metrics-certs") pod "router-default-55c8746687-c4jzc" (UID: "d742f12e-0c93-4210-8ec1-88167c556ae5") : secret "router-metrics-certs-default" not found Jul 08 16:35:07.306822 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:07.306815 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:07.308314 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:07.306834 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38f0ff13-08e1-408a-b4c9-3526ab67f705-cluster-monitoring-operator-tls podName:38f0ff13-08e1-408a-b4c9-3526ab67f705 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:09.306828764 +0000 UTC m=+43.854852478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/38f0ff13-08e1-408a-b4c9-3526ab67f705-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vzlfv" (UID: "38f0ff13-08e1-408a-b4c9-3526ab67f705") : secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:07.508547 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:07.507874 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f53b384-0ddb-4701-9b3d-0c4761b75d9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ww2f6\" (UID: \"3f53b384-0ddb-4701-9b3d-0c4761b75d9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww2f6" Jul 08 16:35:07.508547 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:07.508153 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 16:35:07.508547 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:07.508212 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f53b384-0ddb-4701-9b3d-0c4761b75d9d-samples-operator-tls podName:3f53b384-0ddb-4701-9b3d-0c4761b75d9d nodeName:}" failed. No retries permitted until 2026-07-08 16:35:09.508195471 +0000 UTC m=+44.056219188 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3f53b384-0ddb-4701-9b3d-0c4761b75d9d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ww2f6" (UID: "3f53b384-0ddb-4701-9b3d-0c4761b75d9d") : secret "samples-operator-tls" not found Jul 08 16:35:08.866313 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:08.866276 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:08.936515 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:08.936475 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:09.122146 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:09.122044 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-metrics-tls\") pod \"dns-default-48pb8\" (UID: \"ab27cf16-00d0-4e83-a2a8-2fd78083cfe4\") " pod="openshift-dns/dns-default-48pb8" Jul 08 16:35:09.122146 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:09.122113 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:09.122344 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:09.122217 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 16:35:09.122344 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:09.122287 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-metrics-tls podName:ab27cf16-00d0-4e83-a2a8-2fd78083cfe4 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:17.122271019 +0000 UTC m=+51.670294733 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-metrics-tls") pod "dns-default-48pb8" (UID: "ab27cf16-00d0-4e83-a2a8-2fd78083cfe4") : secret "dns-default-metrics-tls" not found Jul 08 16:35:09.122344 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:09.122219 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 16:35:09.122344 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:09.122335 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-599d8ff9f8-djwp8: secret "image-registry-tls" not found Jul 08 16:35:09.122530 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:09.122386 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls podName:e82aa850-caf7-4a18-9901-2cf2c383a16e nodeName:}" failed. No retries permitted until 2026-07-08 16:35:17.122371433 +0000 UTC m=+51.670395149 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls") pod "image-registry-599d8ff9f8-djwp8" (UID: "e82aa850-caf7-4a18-9901-2cf2c383a16e") : secret "image-registry-tls" not found Jul 08 16:35:09.323877 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:09.323837 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-metrics-certs\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:09.324055 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:09.323928 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38f0ff13-08e1-408a-b4c9-3526ab67f705-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vzlfv\" (UID: \"38f0ff13-08e1-408a-b4c9-3526ab67f705\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv" Jul 08 16:35:09.324055 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:09.323978 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d742f12e-0c93-4210-8ec1-88167c556ae5-service-ca-bundle\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:09.324055 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:09.323981 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 16:35:09.324055 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:09.324046 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-metrics-certs podName:d742f12e-0c93-4210-8ec1-88167c556ae5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:13.324029433 +0000 UTC m=+47.872053147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-metrics-certs") pod "router-default-55c8746687-c4jzc" (UID: "d742f12e-0c93-4210-8ec1-88167c556ae5") : secret "router-metrics-certs-default" not found Jul 08 16:35:09.324181 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:09.324054 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:09.324181 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:09.324077 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d742f12e-0c93-4210-8ec1-88167c556ae5-service-ca-bundle podName:d742f12e-0c93-4210-8ec1-88167c556ae5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:13.324067247 +0000 UTC m=+47.872090962 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d742f12e-0c93-4210-8ec1-88167c556ae5-service-ca-bundle") pod "router-default-55c8746687-c4jzc" (UID: "d742f12e-0c93-4210-8ec1-88167c556ae5") : configmap references non-existent config key: service-ca.crt Jul 08 16:35:09.324181 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:09.324094 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38f0ff13-08e1-408a-b4c9-3526ab67f705-cluster-monitoring-operator-tls podName:38f0ff13-08e1-408a-b4c9-3526ab67f705 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:13.324083743 +0000 UTC m=+47.872107458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/38f0ff13-08e1-408a-b4c9-3526ab67f705-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vzlfv" (UID: "38f0ff13-08e1-408a-b4c9-3526ab67f705") : secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:09.526163 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:09.526094 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f53b384-0ddb-4701-9b3d-0c4761b75d9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ww2f6\" (UID: \"3f53b384-0ddb-4701-9b3d-0c4761b75d9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww2f6" Jul 08 16:35:09.526291 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:09.526215 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 16:35:09.526291 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:09.526264 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f53b384-0ddb-4701-9b3d-0c4761b75d9d-samples-operator-tls podName:3f53b384-0ddb-4701-9b3d-0c4761b75d9d nodeName:}" failed. No retries permitted until 2026-07-08 16:35:13.526251901 +0000 UTC m=+48.074275616 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3f53b384-0ddb-4701-9b3d-0c4761b75d9d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ww2f6" (UID: "3f53b384-0ddb-4701-9b3d-0c4761b75d9d") : secret "samples-operator-tls" not found Jul 08 16:35:11.270687 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:11.270660 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vsdvp_6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8/console-operator/0.log" Jul 08 16:35:11.271168 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:11.270703 2573 generic.go:356] "Generic (PLEG): container finished" podID="6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8" containerID="bf90ffffa1a13775d1620a36f806fa39a96279416dbe55f5a90de2290669f702" exitCode=255 Jul 08 16:35:11.271168 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:11.270782 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" event={"ID":"6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8","Type":"ContainerDied","Data":"bf90ffffa1a13775d1620a36f806fa39a96279416dbe55f5a90de2290669f702"} Jul 08 16:35:11.271168 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:11.271011 2573 scope.go:117] "RemoveContainer" containerID="bf90ffffa1a13775d1620a36f806fa39a96279416dbe55f5a90de2290669f702" Jul 08 16:35:11.272431 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:11.272407 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h9ph9" event={"ID":"9c5e1f75-e9f6-46e0-91b0-3d362290a384","Type":"ContainerStarted","Data":"188d9df52b8fb11c18504e56d307ba4d39d31f81b96cfc444009ce217d0c0221"} Jul 08 16:35:11.273974 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:11.273943 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6rgk2" event={"ID":"f22fd4ec-e3b0-4718-851d-629899796803","Type":"ContainerStarted","Data":"3c199562641076bfa3df492073f1214c6a88e930f76e8e6fc365a409b88627a8"} Jul 08 16:35:11.275583 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:11.275553 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hgnz2" event={"ID":"0b3c6c71-4820-4470-b23a-538a5422b776","Type":"ContainerStarted","Data":"fea9156bda72923e9017d5f0c1c9ab60dcfc0ca8f525acd902d997a59fa4219b"} Jul 08 16:35:11.277010 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:11.276990 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" event={"ID":"1816c65a-cbd4-4aa1-a834-577c758bd2b8","Type":"ContainerStarted","Data":"a4f8328998bc0d21b686a44c752c27d346fe251e1c01313b1573781480dac0e3"} Jul 08 16:35:11.306090 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:11.306042 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-h9ph9" podStartSLOduration=1.555748358 podStartE2EDuration="6.306028236s" totalImagesPullingTime="4.750279878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:11.305080253 +0000 UTC m=+45.853103990" watchObservedRunningTime="2026-07-08 16:35:11.306028236 +0000 UTC m=+45.854051971" Jul 08 16:35:11.325456 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:11.325189 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hgnz2" podStartSLOduration=1.622823387 podStartE2EDuration="6.325171097s" totalImagesPullingTime="4.70234771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:11.324299532 +0000 UTC m=+45.872323292" watchObservedRunningTime="2026-07-08 16:35:11.325171097 +0000 UTC m=+45.873194838" Jul 08 16:35:11.362033 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:11.361989 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" podStartSLOduration=1.517353315 podStartE2EDuration="6.361970104s" totalImagesPullingTime="4.844616789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:11.342236666 +0000 UTC m=+45.890260403" watchObservedRunningTime="2026-07-08 16:35:11.361970104 +0000 UTC m=+45.909993840" Jul 08 16:35:11.362180 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:11.362156 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6rgk2" podStartSLOduration=1.687867227 podStartE2EDuration="6.362149998s" totalImagesPullingTime="4.674282771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:11.361825695 +0000 UTC m=+45.909849431" watchObservedRunningTime="2026-07-08 16:35:11.362149998 +0000 UTC m=+45.910173734" Jul 08 16:35:11.399236 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:11.399183 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:11.472045 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:11.472015 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:11.925396 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:11.924007 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4wc4j"] Jul 08 16:35:11.955418 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:11.955379 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4wc4j"] Jul 08 16:35:11.955583 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:11.955493 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:11.958065 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:11.958040 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 16:35:11.959165 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:11.958908 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 16:35:11.959165 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:11.958981 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2m42c\"" Jul 08 16:35:11.977429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:11.977403 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:12.047814 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.047784 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/939df774-67a9-4217-9883-ee901b722a54-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:12.048046 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.047833 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/939df774-67a9-4217-9883-ee901b722a54-crio-socket\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:12.048046 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.047859 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/939df774-67a9-4217-9883-ee901b722a54-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:12.048046 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.047909 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/939df774-67a9-4217-9883-ee901b722a54-data-volume\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:12.048046 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.047932 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt85n\" (UniqueName: \"kubernetes.io/projected/939df774-67a9-4217-9883-ee901b722a54-kube-api-access-lt85n\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:12.048479 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.048453 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:12.148515 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.148484 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/939df774-67a9-4217-9883-ee901b722a54-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:12.148515 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.148521 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/939df774-67a9-4217-9883-ee901b722a54-crio-socket\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:12.148691 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.148548 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/939df774-67a9-4217-9883-ee901b722a54-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:12.148730 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.148705 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/939df774-67a9-4217-9883-ee901b722a54-crio-socket\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:12.148762 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:12.148707 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 16:35:12.148762 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.148737 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/939df774-67a9-4217-9883-ee901b722a54-data-volume\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:12.148832 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:12.148774 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/939df774-67a9-4217-9883-ee901b722a54-kube-rbac-proxy-cm podName:939df774-67a9-4217-9883-ee901b722a54 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:12.648759561 +0000 UTC m=+47.196783275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/939df774-67a9-4217-9883-ee901b722a54-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4wc4j" (UID: "939df774-67a9-4217-9883-ee901b722a54") : configmap "kube-rbac-proxy" not found Jul 08 16:35:12.148832 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.148789 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt85n\" (UniqueName: \"kubernetes.io/projected/939df774-67a9-4217-9883-ee901b722a54-kube-api-access-lt85n\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:12.148938 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:12.148882 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 16:35:12.148978 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:12.148951 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/939df774-67a9-4217-9883-ee901b722a54-insights-runtime-extractor-tls podName:939df774-67a9-4217-9883-ee901b722a54 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:12.648936084 +0000 UTC m=+47.196959817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/939df774-67a9-4217-9883-ee901b722a54-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4wc4j" (UID: "939df774-67a9-4217-9883-ee901b722a54") : secret "insights-runtime-extractor-tls" not found Jul 08 16:35:12.149153 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.149136 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/939df774-67a9-4217-9883-ee901b722a54-data-volume\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:12.167653 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.167624 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt85n\" (UniqueName: \"kubernetes.io/projected/939df774-67a9-4217-9883-ee901b722a54-kube-api-access-lt85n\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:12.250709 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.250628 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:12.281785 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.281759 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vsdvp_6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8/console-operator/1.log" Jul 08 16:35:12.282182 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.282168 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vsdvp_6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8/console-operator/0.log" Jul 08 16:35:12.282231 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.282203 2573 generic.go:356] "Generic (PLEG): container finished" podID="6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8" containerID="75a620b7f1a256bc00ca6cd8281807cdcc5be835ed61c7ee918ead18bd067bc7" exitCode=255 Jul 08 16:35:12.282277 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.282235 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" event={"ID":"6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8","Type":"ContainerDied","Data":"75a620b7f1a256bc00ca6cd8281807cdcc5be835ed61c7ee918ead18bd067bc7"} Jul 08 16:35:12.282344 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.282328 2573 scope.go:117] "RemoveContainer" containerID="bf90ffffa1a13775d1620a36f806fa39a96279416dbe55f5a90de2290669f702" Jul 08 16:35:12.282469 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.282448 2573 scope.go:117] "RemoveContainer" containerID="75a620b7f1a256bc00ca6cd8281807cdcc5be835ed61c7ee918ead18bd067bc7" Jul 08 16:35:12.282631 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:12.282611 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-vsdvp_openshift-console-operator(6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8)\"" pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" podUID="6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8" Jul 08 16:35:12.351432 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.351405 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:12.653360 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.653323 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/939df774-67a9-4217-9883-ee901b722a54-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:12.653561 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:12.653477 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 16:35:12.653561 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:12.653545 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/939df774-67a9-4217-9883-ee901b722a54-insights-runtime-extractor-tls podName:939df774-67a9-4217-9883-ee901b722a54 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:13.653527213 +0000 UTC m=+48.201550930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/939df774-67a9-4217-9883-ee901b722a54-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4wc4j" (UID: "939df774-67a9-4217-9883-ee901b722a54") : secret "insights-runtime-extractor-tls" not found Jul 08 16:35:12.653656 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.653593 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/939df774-67a9-4217-9883-ee901b722a54-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:12.653697 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:12.653664 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 16:35:12.653730 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:12.653700 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/939df774-67a9-4217-9883-ee901b722a54-kube-rbac-proxy-cm podName:939df774-67a9-4217-9883-ee901b722a54 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:13.653690031 +0000 UTC m=+48.201713749 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/939df774-67a9-4217-9883-ee901b722a54-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4wc4j" (UID: "939df774-67a9-4217-9883-ee901b722a54") : configmap "kube-rbac-proxy" not found Jul 08 16:35:12.838679 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.838649 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:12.940242 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:12.940166 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:13.007276 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:13.007248 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:13.254819 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:13.254751 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:13.286378 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:13.286357 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vsdvp_6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8/console-operator/1.log" Jul 08 16:35:13.286760 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:13.286661 2573 scope.go:117] "RemoveContainer" containerID="75a620b7f1a256bc00ca6cd8281807cdcc5be835ed61c7ee918ead18bd067bc7" Jul 08 16:35:13.286813 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:13.286798 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-vsdvp_openshift-console-operator(6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8)\"" pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" podUID="6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8" Jul 08 16:35:13.355148 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:13.355109 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:13.359180 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:13.359160 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-metrics-certs\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:13.359250 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:13.359228 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38f0ff13-08e1-408a-b4c9-3526ab67f705-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vzlfv\" (UID: \"38f0ff13-08e1-408a-b4c9-3526ab67f705\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv" Jul 08 16:35:13.359322 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:13.359303 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 16:35:13.359322 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:13.359317 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d742f12e-0c93-4210-8ec1-88167c556ae5-service-ca-bundle\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:13.359518 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:13.359361 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-metrics-certs podName:d742f12e-0c93-4210-8ec1-88167c556ae5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:21.359345674 +0000 UTC m=+55.907369403 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-metrics-certs") pod "router-default-55c8746687-c4jzc" (UID: "d742f12e-0c93-4210-8ec1-88167c556ae5") : secret "router-metrics-certs-default" not found Jul 08 16:35:13.359518 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:13.359368 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:13.359518 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:13.359426 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38f0ff13-08e1-408a-b4c9-3526ab67f705-cluster-monitoring-operator-tls podName:38f0ff13-08e1-408a-b4c9-3526ab67f705 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:21.35940981 +0000 UTC m=+55.907433529 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/38f0ff13-08e1-408a-b4c9-3526ab67f705-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vzlfv" (UID: "38f0ff13-08e1-408a-b4c9-3526ab67f705") : secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:13.359518 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:13.359519 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d742f12e-0c93-4210-8ec1-88167c556ae5-service-ca-bundle podName:d742f12e-0c93-4210-8ec1-88167c556ae5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:21.359507899 +0000 UTC m=+55.907531616 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d742f12e-0c93-4210-8ec1-88167c556ae5-service-ca-bundle") pod "router-default-55c8746687-c4jzc" (UID: "d742f12e-0c93-4210-8ec1-88167c556ae5") : configmap references non-existent config key: service-ca.crt Jul 08 16:35:13.456832 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:13.456795 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:13.560515 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:13.560440 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f53b384-0ddb-4701-9b3d-0c4761b75d9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ww2f6\" (UID: \"3f53b384-0ddb-4701-9b3d-0c4761b75d9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww2f6" Jul 08 16:35:13.560644 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:13.560594 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 16:35:13.560687 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:13.560655 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f53b384-0ddb-4701-9b3d-0c4761b75d9d-samples-operator-tls podName:3f53b384-0ddb-4701-9b3d-0c4761b75d9d nodeName:}" failed. No retries permitted until 2026-07-08 16:35:21.560640324 +0000 UTC m=+56.108664042 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3f53b384-0ddb-4701-9b3d-0c4761b75d9d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ww2f6" (UID: "3f53b384-0ddb-4701-9b3d-0c4761b75d9d") : secret "samples-operator-tls" not found Jul 08 16:35:13.643241 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:13.643209 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:13.661576 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:13.661547 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/939df774-67a9-4217-9883-ee901b722a54-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:13.661708 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:13.661588 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/939df774-67a9-4217-9883-ee901b722a54-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:13.661708 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:13.661665 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 16:35:13.661784 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:13.661726 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/939df774-67a9-4217-9883-ee901b722a54-kube-rbac-proxy-cm podName:939df774-67a9-4217-9883-ee901b722a54 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:15.661713197 +0000 UTC m=+50.209736929 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/939df774-67a9-4217-9883-ee901b722a54-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4wc4j" (UID: "939df774-67a9-4217-9883-ee901b722a54") : configmap "kube-rbac-proxy" not found Jul 08 16:35:13.661784 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:13.661738 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 16:35:13.661855 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:13.661788 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/939df774-67a9-4217-9883-ee901b722a54-insights-runtime-extractor-tls podName:939df774-67a9-4217-9883-ee901b722a54 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:15.66177453 +0000 UTC m=+50.209798245 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/939df774-67a9-4217-9883-ee901b722a54-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4wc4j" (UID: "939df774-67a9-4217-9883-ee901b722a54") : secret "insights-runtime-extractor-tls" not found Jul 08 16:35:13.702958 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:13.702933 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:13.732695 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:13.732650 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r88w9_2af41183-3d27-438a-a4b4-d1cea1df572a/dns-node-resolver/0.log" Jul 08 16:35:14.331918 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:14.331879 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6flz5_781fe4a6-3af0-440e-959e-5a1201135619/node-ca/0.log" Jul 08 16:35:15.131722 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:15.131697 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8xwcl_b165419b-99f2-46fc-944a-588f787fbda8/serve-healthcheck-canary/0.log" Jul 08 16:35:15.290456 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:15.290427 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:15.393936 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:15.393845 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:15.679045 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:15.678952 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/939df774-67a9-4217-9883-ee901b722a54-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:15.679045 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:15.679002 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/939df774-67a9-4217-9883-ee901b722a54-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:15.679276 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:15.679111 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 16:35:15.679276 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:15.679190 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/939df774-67a9-4217-9883-ee901b722a54-kube-rbac-proxy-cm podName:939df774-67a9-4217-9883-ee901b722a54 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:19.679168919 +0000 UTC m=+54.227192650 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/939df774-67a9-4217-9883-ee901b722a54-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4wc4j" (UID: "939df774-67a9-4217-9883-ee901b722a54") : configmap "kube-rbac-proxy" not found Jul 08 16:35:15.679276 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:15.679246 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 16:35:15.679396 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:15.679297 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/939df774-67a9-4217-9883-ee901b722a54-insights-runtime-extractor-tls podName:939df774-67a9-4217-9883-ee901b722a54 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:19.679284245 +0000 UTC m=+54.227307960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/939df774-67a9-4217-9883-ee901b722a54-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4wc4j" (UID: "939df774-67a9-4217-9883-ee901b722a54") : secret "insights-runtime-extractor-tls" not found Jul 08 16:35:15.818193 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:15.818156 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:15.924493 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:15.924456 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:15.966817 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:15.966738 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" Jul 08 16:35:15.966817 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:15.966813 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" Jul 08 16:35:15.967184 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:15.967171 2573 scope.go:117] "RemoveContainer" containerID="75a620b7f1a256bc00ca6cd8281807cdcc5be835ed61c7ee918ead18bd067bc7" Jul 08 16:35:15.967336 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:15.967319 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-vsdvp_openshift-console-operator(6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8)\"" pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" podUID="6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8" Jul 08 16:35:16.395330 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:16.395299 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:16.810073 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:16.809986 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:17.191833 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:17.191803 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-metrics-tls\") pod \"dns-default-48pb8\" (UID: \"ab27cf16-00d0-4e83-a2a8-2fd78083cfe4\") " pod="openshift-dns/dns-default-48pb8" Jul 08 16:35:17.192017 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:17.191844 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:17.192017 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:17.191988 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 16:35:17.192145 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:17.192055 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-metrics-tls podName:ab27cf16-00d0-4e83-a2a8-2fd78083cfe4 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:33.192038703 +0000 UTC m=+67.740062423 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-metrics-tls") pod "dns-default-48pb8" (UID: "ab27cf16-00d0-4e83-a2a8-2fd78083cfe4") : secret "dns-default-metrics-tls" not found Jul 08 16:35:17.192145 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:17.192064 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 16:35:17.192145 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:17.192087 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-599d8ff9f8-djwp8: secret "image-registry-tls" not found Jul 08 16:35:17.192252 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:17.192146 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls podName:e82aa850-caf7-4a18-9901-2cf2c383a16e nodeName:}" failed. No retries permitted until 2026-07-08 16:35:33.192127206 +0000 UTC m=+67.740150934 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls") pod "image-registry-599d8ff9f8-djwp8" (UID: "e82aa850-caf7-4a18-9901-2cf2c383a16e") : secret "image-registry-tls" not found Jul 08 16:35:19.411695 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:19.411656 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:19.517735 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:19.517696 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:19.637180 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:19.637148 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:19.708882 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:19.708801 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/939df774-67a9-4217-9883-ee901b722a54-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:19.708882 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:19.708863 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/939df774-67a9-4217-9883-ee901b722a54-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:19.709078 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:19.708973 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 16:35:19.709078 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:19.709042 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/939df774-67a9-4217-9883-ee901b722a54-insights-runtime-extractor-tls podName:939df774-67a9-4217-9883-ee901b722a54 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:27.709024109 +0000 UTC m=+62.257047837 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/939df774-67a9-4217-9883-ee901b722a54-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4wc4j" (UID: "939df774-67a9-4217-9883-ee901b722a54") : secret "insights-runtime-extractor-tls" not found Jul 08 16:35:19.709422 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:19.709404 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/939df774-67a9-4217-9883-ee901b722a54-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:19.728875 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:19.728851 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:19.794762 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:19.794732 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:19.868812 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:19.868781 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:19.968038 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:19.967938 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:20.127231 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:20.127178 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:21.218818 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:21.218761 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:21.317700 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:21.317651 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:21.424257 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:21.424226 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-metrics-certs\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:21.424409 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:21.424286 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38f0ff13-08e1-408a-b4c9-3526ab67f705-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vzlfv\" (UID: \"38f0ff13-08e1-408a-b4c9-3526ab67f705\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv" Jul 08 16:35:21.424409 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:21.424360 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d742f12e-0c93-4210-8ec1-88167c556ae5-service-ca-bundle\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:21.424409 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:21.424371 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 16:35:21.424522 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:21.424371 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:21.424522 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:21.424429 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-metrics-certs podName:d742f12e-0c93-4210-8ec1-88167c556ae5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:37.424411164 +0000 UTC m=+71.972434884 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-metrics-certs") pod "router-default-55c8746687-c4jzc" (UID: "d742f12e-0c93-4210-8ec1-88167c556ae5") : secret "router-metrics-certs-default" not found Jul 08 16:35:21.424522 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:21.424483 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38f0ff13-08e1-408a-b4c9-3526ab67f705-cluster-monitoring-operator-tls podName:38f0ff13-08e1-408a-b4c9-3526ab67f705 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:37.424463363 +0000 UTC m=+71.972487086 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/38f0ff13-08e1-408a-b4c9-3526ab67f705-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vzlfv" (UID: "38f0ff13-08e1-408a-b4c9-3526ab67f705") : secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:21.424522 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:35:21.424498 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d742f12e-0c93-4210-8ec1-88167c556ae5-service-ca-bundle podName:d742f12e-0c93-4210-8ec1-88167c556ae5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:37.424492039 +0000 UTC m=+71.972515753 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d742f12e-0c93-4210-8ec1-88167c556ae5-service-ca-bundle") pod "router-default-55c8746687-c4jzc" (UID: "d742f12e-0c93-4210-8ec1-88167c556ae5") : configmap references non-existent config key: service-ca.crt Jul 08 16:35:21.504638 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:21.504565 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:21.594876 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:21.594839 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:21.626078 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:21.626053 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f53b384-0ddb-4701-9b3d-0c4761b75d9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ww2f6\" (UID: \"3f53b384-0ddb-4701-9b3d-0c4761b75d9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww2f6" Jul 08 16:35:21.628435 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:21.628413 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f53b384-0ddb-4701-9b3d-0c4761b75d9d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ww2f6\" (UID: \"3f53b384-0ddb-4701-9b3d-0c4761b75d9d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww2f6" Jul 08 16:35:21.632198 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:21.632179 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww2f6" Jul 08 16:35:21.705571 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:21.705537 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:21.760961 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:21.760882 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww2f6"] Jul 08 16:35:21.904994 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:21.904958 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:22.210676 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:22.210640 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:22.312976 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:22.312944 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww2f6" event={"ID":"3f53b384-0ddb-4701-9b3d-0c4761b75d9d","Type":"ContainerStarted","Data":"2506b1a94f02211202b5839fca848db8f812021f0ed5415cc64063230a823731"} Jul 08 16:35:22.908916 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:22.908865 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:23.111129 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:23.111096 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:23.313849 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:23.313733 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:23.710007 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:23.709975 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:23.811605 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:23.811577 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:23.912736 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:23.912704 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:24.321179 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:24.321097 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww2f6" event={"ID":"3f53b384-0ddb-4701-9b3d-0c4761b75d9d","Type":"ContainerStarted","Data":"f66447511e9bc08551a16283154cbc8b93de0adced451c1d95efbe611b1ee1cb"} Jul 08 16:35:24.321179 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:24.321147 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww2f6" event={"ID":"3f53b384-0ddb-4701-9b3d-0c4761b75d9d","Type":"ContainerStarted","Data":"dd94496a826dc6d183e551c0b5cddb04c2d3267f99fdfd2de9e839acba18b068"} Jul 08 16:35:24.338942 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:24.338876 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ww2f6" podStartSLOduration=17.117727687 podStartE2EDuration="19.338860524s" totalImagesPullingTime="2.221132837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:24.338053522 +0000 UTC m=+58.886077258" watchObservedRunningTime="2026-07-08 16:35:24.338860524 +0000 UTC m=+58.886884260" Jul 08 16:35:24.508875 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:24.508831 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:24.571690 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:24.571623 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:24.900817 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:24.900783 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:25.149251 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:25.149217 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:25.509957 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:25.509928 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:25.901955 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:25.901919 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:26.228704 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:26.228640 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xmpkp" Jul 08 16:35:26.706839 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:26.706762 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:26.770227 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:26.770195 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:26.904870 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:26.904828 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:27.102019 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:27.101990 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:27.306916 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:27.306870 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:27.779717 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:27.779690 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/939df774-67a9-4217-9883-ee901b722a54-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:27.781839 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:27.781821 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/939df774-67a9-4217-9883-ee901b722a54-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4wc4j\" (UID: \"939df774-67a9-4217-9883-ee901b722a54\") " pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:27.870446 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:27.870423 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2m42c\"" Jul 08 16:35:27.875355 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:27.875342 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4wc4j" Jul 08 16:35:27.995415 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:27.995387 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4wc4j"] Jul 08 16:35:27.997992 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:35:27.997965 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod939df774_67a9_4217_9883_ee901b722a54.slice/crio-20a5994b185085738360bc298cb75cec9c66cf77955029dd87ad96cb626806c8 WatchSource:0}: Error finding container 20a5994b185085738360bc298cb75cec9c66cf77955029dd87ad96cb626806c8: Status 404 returned error can't find the container with id 20a5994b185085738360bc298cb75cec9c66cf77955029dd87ad96cb626806c8 Jul 08 16:35:28.118652 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:28.118618 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:28.333616 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:28.333587 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4wc4j" event={"ID":"939df774-67a9-4217-9883-ee901b722a54","Type":"ContainerStarted","Data":"20a5994b185085738360bc298cb75cec9c66cf77955029dd87ad96cb626806c8"} Jul 08 16:35:28.488303 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:28.488219 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:28.554387 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:28.554354 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:28.904994 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:28.904940 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:29.311446 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:29.311350 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:29.711131 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:29.711099 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:29.915456 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:29.915404 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:29.991966 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:29.991883 2573 scope.go:117] "RemoveContainer" containerID="75a620b7f1a256bc00ca6cd8281807cdcc5be835ed61c7ee918ead18bd067bc7" Jul 08 16:35:30.113115 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:30.113076 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:30.829608 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:30.829561 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:30.925420 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:30.925339 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:31.716884 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:31.716851 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs\") pod \"network-metrics-daemon-bgxr6\" (UID: \"ab6fc392-dce6-4bfc-aa9d-2f99fd378c53\") " pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:35:31.719693 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:31.719676 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 16:35:31.729767 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:31.729739 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab6fc392-dce6-4bfc-aa9d-2f99fd378c53-metrics-certs\") pod \"network-metrics-daemon-bgxr6\" (UID: \"ab6fc392-dce6-4bfc-aa9d-2f99fd378c53\") " pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:35:31.818353 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:31.818298 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret\") pod \"global-pull-secret-syncer-66hzl\" (UID: \"b7fb2341-8281-4190-896d-c994c69fbc08\") " pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:35:31.820774 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:31.820756 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 16:35:31.830829 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:31.830811 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7fb2341-8281-4190-896d-c994c69fbc08-original-pull-secret\") pod \"global-pull-secret-syncer-66hzl\" (UID: \"b7fb2341-8281-4190-896d-c994c69fbc08\") " pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:35:31.919007 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:31.918982 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8smz9\" (UniqueName: \"kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9\") pod \"network-check-target-68grn\" (UID: \"0cfa0994-c414-44f2-b02f-27b70e765bc0\") " pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:35:31.921313 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:31.921294 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 16:35:31.931379 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:31.931359 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 16:35:31.941381 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:31.941361 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8smz9\" (UniqueName: \"kubernetes.io/projected/0cfa0994-c414-44f2-b02f-27b70e765bc0-kube-api-access-8smz9\") pod \"network-check-target-68grn\" (UID: \"0cfa0994-c414-44f2-b02f-27b70e765bc0\") " pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:35:32.009210 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.009188 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kw94b\"" Jul 08 16:35:32.012920 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.012906 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-66hzl" Jul 08 16:35:32.017690 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.017677 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:35:32.019031 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.019017 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pp6cc\"" Jul 08 16:35:32.027043 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.026905 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxr6" Jul 08 16:35:32.189805 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.189777 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-68grn"] Jul 08 16:35:32.192596 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.192572 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-66hzl"] Jul 08 16:35:32.192977 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:35:32.192953 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cfa0994_c414_44f2_b02f_27b70e765bc0.slice/crio-4302223dab894649d12142c7c7a7a84cef340af6aa824765ee08ad5eab7f9b50 WatchSource:0}: Error finding container 4302223dab894649d12142c7c7a7a84cef340af6aa824765ee08ad5eab7f9b50: Status 404 returned error can't find the container with id 4302223dab894649d12142c7c7a7a84cef340af6aa824765ee08ad5eab7f9b50 Jul 08 16:35:32.195306 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:35:32.195285 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7fb2341_8281_4190_896d_c994c69fbc08.slice/crio-3e2dc4feb1dea067c8ccbcd95d4bde68babd896d70a5b7b8a89c29fe5e4e1585 WatchSource:0}: Error finding container 3e2dc4feb1dea067c8ccbcd95d4bde68babd896d70a5b7b8a89c29fe5e4e1585: Status 404 returned error can't find the container with id 3e2dc4feb1dea067c8ccbcd95d4bde68babd896d70a5b7b8a89c29fe5e4e1585 Jul 08 16:35:32.204514 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.204492 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bgxr6"] Jul 08 16:35:32.208242 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:35:32.208222 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab6fc392_dce6_4bfc_aa9d_2f99fd378c53.slice/crio-0851d488810a04e3046c25eb6f26194a501722bed7de99caef04dc96f72fa720 WatchSource:0}: Error finding container 0851d488810a04e3046c25eb6f26194a501722bed7de99caef04dc96f72fa720: Status 404 returned error can't find the container with id 0851d488810a04e3046c25eb6f26194a501722bed7de99caef04dc96f72fa720 Jul 08 16:35:32.349395 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.349369 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vsdvp_6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8/console-operator/1.log" Jul 08 16:35:32.349559 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.349458 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" event={"ID":"6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8","Type":"ContainerStarted","Data":"d4eacbfa520f40af924cdfba14d9416e2dda07a264f52fe1a16eebb11c87488d"} Jul 08 16:35:32.349784 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.349764 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" Jul 08 16:35:32.350780 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.350750 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bgxr6" event={"ID":"ab6fc392-dce6-4bfc-aa9d-2f99fd378c53","Type":"ContainerStarted","Data":"0851d488810a04e3046c25eb6f26194a501722bed7de99caef04dc96f72fa720"} Jul 08 16:35:32.352343 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.352322 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-68grn" event={"ID":"0cfa0994-c414-44f2-b02f-27b70e765bc0","Type":"ContainerStarted","Data":"4302223dab894649d12142c7c7a7a84cef340af6aa824765ee08ad5eab7f9b50"} Jul 08 16:35:32.353933 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.353903 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4wc4j" event={"ID":"939df774-67a9-4217-9883-ee901b722a54","Type":"ContainerStarted","Data":"b229d126d9ae2185712cf144a88d316f87a19385a3f33e7c2eb4877b57b64d1f"} Jul 08 16:35:32.355105 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.355084 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" Jul 08 16:35:32.355679 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.355660 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-66hzl" event={"ID":"b7fb2341-8281-4190-896d-c994c69fbc08","Type":"ContainerStarted","Data":"3e2dc4feb1dea067c8ccbcd95d4bde68babd896d70a5b7b8a89c29fe5e4e1585"} Jul 08 16:35:32.368933 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.368869 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-vsdvp" podStartSLOduration=22.645304702 podStartE2EDuration="27.368847314s" totalImagesPullingTime="4.723542612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:32.368844559 +0000 UTC m=+66.916868325" watchObservedRunningTime="2026-07-08 16:35:32.368847314 +0000 UTC m=+66.916871033" Jul 08 16:35:32.380367 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.380342 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:32.474748 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.474714 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:32.567297 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.567264 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:32.678072 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.677996 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:32.858666 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.858623 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:32.936410 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:32.936326 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:33.231927 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:33.231719 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-metrics-tls\") pod \"dns-default-48pb8\" (UID: \"ab27cf16-00d0-4e83-a2a8-2fd78083cfe4\") " pod="openshift-dns/dns-default-48pb8" Jul 08 16:35:33.231927 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:33.231775 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:33.234669 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:33.234629 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls\") pod \"image-registry-599d8ff9f8-djwp8\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:33.235686 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:33.235665 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab27cf16-00d0-4e83-a2a8-2fd78083cfe4-metrics-tls\") pod \"dns-default-48pb8\" (UID: \"ab27cf16-00d0-4e83-a2a8-2fd78083cfe4\") " pod="openshift-dns/dns-default-48pb8" Jul 08 16:35:33.269568 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:33.269509 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:33.367233 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:33.367194 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bgxr6" event={"ID":"ab6fc392-dce6-4bfc-aa9d-2f99fd378c53","Type":"ContainerStarted","Data":"769a3f38c21ad236ae5fdefa99490a3802c95f33d121a0a46358825d0162fd57"} Jul 08 16:35:33.368678 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:33.368648 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:33.371882 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:33.371853 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4wc4j" event={"ID":"939df774-67a9-4217-9883-ee901b722a54","Type":"ContainerStarted","Data":"5b6990c27147c93855d83130b0be420ce3679d1c02e6a5f826a7783489262ba1"} Jul 08 16:35:33.411636 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:33.411613 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c8q5q\"" Jul 08 16:35:33.418643 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:33.418622 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:33.434958 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:33.434936 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ztnq7\"" Jul 08 16:35:33.443012 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:33.442961 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-48pb8" Jul 08 16:35:33.471368 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:33.471310 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:33.572908 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:33.572748 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:33.630751 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:33.630500 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-599d8ff9f8-djwp8"] Jul 08 16:35:33.636097 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:35:33.635339 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode82aa850_caf7_4a18_9901_2cf2c383a16e.slice/crio-71a142bc771dc4eaa7b072522e631e5641ab0e655fc5169937705c6308ac974f WatchSource:0}: Error finding container 71a142bc771dc4eaa7b072522e631e5641ab0e655fc5169937705c6308ac974f: Status 404 returned error can't find the container with id 71a142bc771dc4eaa7b072522e631e5641ab0e655fc5169937705c6308ac974f Jul 08 16:35:33.649401 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:33.649317 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-48pb8"] Jul 08 16:35:33.655736 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:35:33.655712 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab27cf16_00d0_4e83_a2a8_2fd78083cfe4.slice/crio-22b2b31bdf011eb6acd64619f98731ae8ce48c068116ed56468992e4e70531ba WatchSource:0}: Error finding container 22b2b31bdf011eb6acd64619f98731ae8ce48c068116ed56468992e4e70531ba: Status 404 returned error can't find the container with id 22b2b31bdf011eb6acd64619f98731ae8ce48c068116ed56468992e4e70531ba Jul 08 16:35:34.076840 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:34.076180 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:34.266062 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:34.266025 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:34.366533 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:34.366438 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:34.380405 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:34.380365 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bgxr6" event={"ID":"ab6fc392-dce6-4bfc-aa9d-2f99fd378c53","Type":"ContainerStarted","Data":"1cce0bf45ffbc4e21d380a5235e72ac0cd04d42ae3e52f75667258ed4caa12b1"} Jul 08 16:35:34.382984 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:34.382952 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" event={"ID":"e82aa850-caf7-4a18-9901-2cf2c383a16e","Type":"ContainerStarted","Data":"2141b6b6f9f53bbece7ad1012431aeab6f761cfc5e54c03fd83707ead852c57f"} Jul 08 16:35:34.383113 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:34.383005 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" event={"ID":"e82aa850-caf7-4a18-9901-2cf2c383a16e","Type":"ContainerStarted","Data":"71a142bc771dc4eaa7b072522e631e5641ab0e655fc5169937705c6308ac974f"} Jul 08 16:35:34.383524 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:34.383504 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:34.385003 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:34.384957 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-48pb8" event={"ID":"ab27cf16-00d0-4e83-a2a8-2fd78083cfe4","Type":"ContainerStarted","Data":"22b2b31bdf011eb6acd64619f98731ae8ce48c068116ed56468992e4e70531ba"} Jul 08 16:35:34.398555 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:34.398502 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bgxr6" podStartSLOduration=67.421830742 podStartE2EDuration="1m8.398481842s" totalImagesPullingTime="976.6511ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:34.396292813 +0000 UTC m=+68.944316563" watchObservedRunningTime="2026-07-08 16:35:34.398481842 +0000 UTC m=+68.946505580" Jul 08 16:35:34.419061 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:34.418577 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" podStartSLOduration=68.418557722 podStartE2EDuration="1m8.418557722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:34.417816452 +0000 UTC m=+68.965840194" watchObservedRunningTime="2026-07-08 16:35:34.418557722 +0000 UTC m=+68.966581460" Jul 08 16:35:35.504092 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:35.504053 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:35.602907 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:35.602862 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:36.998168 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:36.998136 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cb8f657b8-lkpmn"] Jul 08 16:35:37.000462 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.000442 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cb8f657b8-lkpmn" Jul 08 16:35:37.002914 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.002786 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 08 16:35:37.002914 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.002869 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-m4m5t\"" Jul 08 16:35:37.005148 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.005110 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 08 16:35:37.005273 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.005110 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 08 16:35:37.005990 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.005970 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 08 16:35:37.026415 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.026390 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cb8f657b8-lkpmn"] Jul 08 16:35:37.087264 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.087235 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-fntb2"] Jul 08 16:35:37.090240 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.090220 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-fntb2" Jul 08 16:35:37.093663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.093592 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 16:35:37.094095 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.094071 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 16:35:37.094196 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.094154 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zbk5z\"" Jul 08 16:35:37.102746 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.102722 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-fntb2"] Jul 08 16:35:37.105872 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.105847 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:37.171795 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.171756 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bf39e7d3-9013-480c-9ea5-01dd56bc322d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5cb8f657b8-lkpmn\" (UID: \"bf39e7d3-9013-480c-9ea5-01dd56bc322d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cb8f657b8-lkpmn" Jul 08 16:35:37.171992 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.171859 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2bql\" (UniqueName: \"kubernetes.io/projected/bf39e7d3-9013-480c-9ea5-01dd56bc322d-kube-api-access-c2bql\") pod \"managed-serviceaccount-addon-agent-5cb8f657b8-lkpmn\" (UID: \"bf39e7d3-9013-480c-9ea5-01dd56bc322d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cb8f657b8-lkpmn" Jul 08 16:35:37.171992 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.171934 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz4f2\" (UniqueName: \"kubernetes.io/projected/e148bd1c-27d5-4651-9042-d7b72b1a95eb-kube-api-access-jz4f2\") pod \"downloads-685bfb5f64-fntb2\" (UID: \"e148bd1c-27d5-4651-9042-d7b72b1a95eb\") " pod="openshift-console/downloads-685bfb5f64-fntb2" Jul 08 16:35:37.204365 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.204328 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:37.272914 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.272797 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bf39e7d3-9013-480c-9ea5-01dd56bc322d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5cb8f657b8-lkpmn\" (UID: \"bf39e7d3-9013-480c-9ea5-01dd56bc322d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cb8f657b8-lkpmn" Jul 08 16:35:37.272914 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.272842 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2bql\" (UniqueName: \"kubernetes.io/projected/bf39e7d3-9013-480c-9ea5-01dd56bc322d-kube-api-access-c2bql\") pod \"managed-serviceaccount-addon-agent-5cb8f657b8-lkpmn\" (UID: \"bf39e7d3-9013-480c-9ea5-01dd56bc322d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cb8f657b8-lkpmn" Jul 08 16:35:37.273103 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.272991 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz4f2\" (UniqueName: \"kubernetes.io/projected/e148bd1c-27d5-4651-9042-d7b72b1a95eb-kube-api-access-jz4f2\") pod \"downloads-685bfb5f64-fntb2\" (UID: \"e148bd1c-27d5-4651-9042-d7b72b1a95eb\") " pod="openshift-console/downloads-685bfb5f64-fntb2" Jul 08 16:35:37.275703 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.275679 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bf39e7d3-9013-480c-9ea5-01dd56bc322d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5cb8f657b8-lkpmn\" (UID: \"bf39e7d3-9013-480c-9ea5-01dd56bc322d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cb8f657b8-lkpmn" Jul 08 16:35:37.294705 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.294674 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz4f2\" (UniqueName: \"kubernetes.io/projected/e148bd1c-27d5-4651-9042-d7b72b1a95eb-kube-api-access-jz4f2\") pod \"downloads-685bfb5f64-fntb2\" (UID: \"e148bd1c-27d5-4651-9042-d7b72b1a95eb\") " pod="openshift-console/downloads-685bfb5f64-fntb2" Jul 08 16:35:37.295486 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.295430 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2bql\" (UniqueName: \"kubernetes.io/projected/bf39e7d3-9013-480c-9ea5-01dd56bc322d-kube-api-access-c2bql\") pod \"managed-serviceaccount-addon-agent-5cb8f657b8-lkpmn\" (UID: \"bf39e7d3-9013-480c-9ea5-01dd56bc322d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cb8f657b8-lkpmn" Jul 08 16:35:37.317499 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.317476 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cb8f657b8-lkpmn" Jul 08 16:35:37.329116 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.329090 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:37.405125 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.405095 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-fntb2" Jul 08 16:35:37.458932 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.458880 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:37.474463 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.474436 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d742f12e-0c93-4210-8ec1-88167c556ae5-service-ca-bundle\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:37.474624 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.474498 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-metrics-certs\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:37.474624 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.474541 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38f0ff13-08e1-408a-b4c9-3526ab67f705-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vzlfv\" (UID: \"38f0ff13-08e1-408a-b4c9-3526ab67f705\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv" Jul 08 16:35:37.475235 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.475210 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d742f12e-0c93-4210-8ec1-88167c556ae5-service-ca-bundle\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:37.477020 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.476998 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/38f0ff13-08e1-408a-b4c9-3526ab67f705-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vzlfv\" (UID: \"38f0ff13-08e1-408a-b4c9-3526ab67f705\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv" Jul 08 16:35:37.477139 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.477059 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d742f12e-0c93-4210-8ec1-88167c556ae5-metrics-certs\") pod \"router-default-55c8746687-c4jzc\" (UID: \"d742f12e-0c93-4210-8ec1-88167c556ae5\") " pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:37.556612 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.556511 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:37.656976 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.656944 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-q8t47\"" Jul 08 16:35:37.665782 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.665761 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv" Jul 08 16:35:37.702374 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.702348 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-p8c92\"" Jul 08 16:35:37.710516 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:37.710493 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:38.916572 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:38.916547 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cb8f657b8-lkpmn"] Jul 08 16:35:39.153416 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.153385 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-fntb2"] Jul 08 16:35:39.154863 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.154722 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv"] Jul 08 16:35:39.155820 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.155796 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55c8746687-c4jzc"] Jul 08 16:35:39.156952 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:35:39.156926 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38f0ff13_08e1_408a_b4c9_3526ab67f705.slice/crio-b339dba73063866085ffaa2f9e4863ab7c9e3b611eed31b213958d6c9a9b7222 WatchSource:0}: Error finding container b339dba73063866085ffaa2f9e4863ab7c9e3b611eed31b213958d6c9a9b7222: Status 404 returned error can't find the container with id b339dba73063866085ffaa2f9e4863ab7c9e3b611eed31b213958d6c9a9b7222 Jul 08 16:35:39.157602 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:35:39.157565 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode148bd1c_27d5_4651_9042_d7b72b1a95eb.slice/crio-2252b08681bc6d42695f8e1474bc11530a2f94bec77b2fd8b80b212e5d194d8b WatchSource:0}: Error finding container 2252b08681bc6d42695f8e1474bc11530a2f94bec77b2fd8b80b212e5d194d8b: Status 404 returned error can't find the container with id 2252b08681bc6d42695f8e1474bc11530a2f94bec77b2fd8b80b212e5d194d8b Jul 08 16:35:39.158297 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:35:39.158277 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd742f12e_0c93_4210_8ec1_88167c556ae5.slice/crio-07564ac1297240279c08ec6ae2b4b97212fdf9a576dce5c627a710d25010dd4d WatchSource:0}: Error finding container 07564ac1297240279c08ec6ae2b4b97212fdf9a576dce5c627a710d25010dd4d: Status 404 returned error can't find the container with id 07564ac1297240279c08ec6ae2b4b97212fdf9a576dce5c627a710d25010dd4d Jul 08 16:35:39.404480 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.404441 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-68grn" event={"ID":"0cfa0994-c414-44f2-b02f-27b70e765bc0","Type":"ContainerStarted","Data":"29d3c665ff55dba0c6cb6668f7e1113182588a039396906a931266a7ec7af5d4"} Jul 08 16:35:39.404634 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.404525 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:35:39.406025 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.406000 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55c8746687-c4jzc" event={"ID":"d742f12e-0c93-4210-8ec1-88167c556ae5","Type":"ContainerStarted","Data":"15e2713535f460eaca7e016bbea929ecc640d4bbf4b49d3078fe37ded0af3eff"} Jul 08 16:35:39.406140 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.406037 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55c8746687-c4jzc" event={"ID":"d742f12e-0c93-4210-8ec1-88167c556ae5","Type":"ContainerStarted","Data":"07564ac1297240279c08ec6ae2b4b97212fdf9a576dce5c627a710d25010dd4d"} Jul 08 16:35:39.407039 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.407020 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv" event={"ID":"38f0ff13-08e1-408a-b4c9-3526ab67f705","Type":"ContainerStarted","Data":"b339dba73063866085ffaa2f9e4863ab7c9e3b611eed31b213958d6c9a9b7222"} Jul 08 16:35:39.408165 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.408145 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-fntb2" event={"ID":"e148bd1c-27d5-4651-9042-d7b72b1a95eb","Type":"ContainerStarted","Data":"2252b08681bc6d42695f8e1474bc11530a2f94bec77b2fd8b80b212e5d194d8b"} Jul 08 16:35:39.409204 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.409186 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cb8f657b8-lkpmn" event={"ID":"bf39e7d3-9013-480c-9ea5-01dd56bc322d","Type":"ContainerStarted","Data":"963cc65cf357ae578995c2ff4b2bace1ba50d7d945b4cc16056dddd7ba756655"} Jul 08 16:35:39.411061 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.411040 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4wc4j" event={"ID":"939df774-67a9-4217-9883-ee901b722a54","Type":"ContainerStarted","Data":"ed992a70b1f1e7be97ddcf1d50881f2c91932c77e6c4bf3f82b6053de3eba2c6"} Jul 08 16:35:39.412375 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.412351 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-66hzl" event={"ID":"b7fb2341-8281-4190-896d-c994c69fbc08","Type":"ContainerStarted","Data":"efc6176483fc9e4b30dbaf379b75d2ed10f074ec055881298ef0922d4fbfb53e"} Jul 08 16:35:39.413831 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.413812 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-48pb8" event={"ID":"ab27cf16-00d0-4e83-a2a8-2fd78083cfe4","Type":"ContainerStarted","Data":"c69dddd8ee14becf9feabfc59b93bab2f710c4d0aa6842c4383ebb783a8c425a"} Jul 08 16:35:39.413943 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.413845 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-48pb8" event={"ID":"ab27cf16-00d0-4e83-a2a8-2fd78083cfe4","Type":"ContainerStarted","Data":"0370c24baa75f56bf1d7ed272cf4165bf9ef50dbea0a6e568e2d044dd32e3fd0"} Jul 08 16:35:39.413943 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.413934 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-48pb8" Jul 08 16:35:39.421033 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.420986 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-68grn" podStartSLOduration=66.888561565 podStartE2EDuration="1m13.420969207s" totalImagesPullingTime="6.532407642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:39.420050747 +0000 UTC m=+73.968074483" watchObservedRunningTime="2026-07-08 16:35:39.420969207 +0000 UTC m=+73.968992944" Jul 08 16:35:39.441312 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.441270 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-55c8746687-c4jzc" podStartSLOduration=34.441250019 podStartE2EDuration="34.441250019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:39.440537725 +0000 UTC m=+73.988561461" watchObservedRunningTime="2026-07-08 16:35:39.441250019 +0000 UTC m=+73.989273753" Jul 08 16:35:39.458817 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.458739 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-48pb8" podStartSLOduration=33.385646708 podStartE2EDuration="38.458726216s" totalImagesPullingTime="5.073079508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:39.457612704 +0000 UTC m=+74.005636460" watchObservedRunningTime="2026-07-08 16:35:39.458726216 +0000 UTC m=+74.006749951" Jul 08 16:35:39.489307 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.489259 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-66hzl" podStartSLOduration=66.954615918 podStartE2EDuration="1m13.489242456s" totalImagesPullingTime="6.534626538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:39.471245533 +0000 UTC m=+74.019269270" watchObservedRunningTime="2026-07-08 16:35:39.489242456 +0000 UTC m=+74.037266190" Jul 08 16:35:39.489811 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.489778 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4wc4j" podStartSLOduration=17.862753474 podStartE2EDuration="28.489767738s" totalImagesPullingTime="10.627014264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:35:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:39.488678593 +0000 UTC m=+74.036702329" watchObservedRunningTime="2026-07-08 16:35:39.489767738 +0000 UTC m=+74.037791475" Jul 08 16:35:39.711792 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.711717 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:39.714725 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.714530 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:39.960236 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:39.960202 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:40.042318 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:40.042220 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:40.419714 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:40.419525 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:40.420805 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:40.420784 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-55c8746687-c4jzc" Jul 08 16:35:42.309539 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:42.309510 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:42.404258 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:42.404227 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:42.429504 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:42.429465 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv" event={"ID":"38f0ff13-08e1-408a-b4c9-3526ab67f705","Type":"ContainerStarted","Data":"593b77167ed640b7c18b1614672a8bcf634825b2aafa6e92ba2ee9141668e71c"} Jul 08 16:35:42.449625 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:42.449415 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vzlfv" podStartSLOduration=34.404424947 podStartE2EDuration="37.449397176s" totalImagesPullingTime="3.044972229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:42.448459238 +0000 UTC m=+76.996482988" watchObservedRunningTime="2026-07-08 16:35:42.449397176 +0000 UTC m=+76.997420913" Jul 08 16:35:42.951934 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:42.951828 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:43.052476 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:43.052433 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:43.435467 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:43.435420 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cb8f657b8-lkpmn" event={"ID":"bf39e7d3-9013-480c-9ea5-01dd56bc322d","Type":"ContainerStarted","Data":"486ed2547ec481468c91ceebf250226b8a924c24f1f62e57306bba7a969867b3"} Jul 08 16:35:43.451761 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:43.451692 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cb8f657b8-lkpmn" podStartSLOduration=3.75598156 podStartE2EDuration="7.451670507s" totalImagesPullingTime="3.695688947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:43.450646267 +0000 UTC m=+77.998670028" watchObservedRunningTime="2026-07-08 16:35:43.451670507 +0000 UTC m=+77.999694243" Jul 08 16:35:44.821250 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:44.821211 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:44.905631 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:44.905597 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:44.965003 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:44.964967 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:45.146821 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:45.146779 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:45.821025 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:45.820989 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:45.919228 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:45.919195 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:46.132451 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:46.132413 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:46.232206 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:46.232171 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:46.918297 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:46.918239 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:46.981069 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:46.980950 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:47.512124 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:47.512081 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:47.610669 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:47.610630 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:48.422318 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:48.422273 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:49.422612 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:49.422585 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-48pb8" Jul 08 16:35:49.791943 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:49.791848 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:50.768242 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:50.768204 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:50.909406 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:50.909306 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:51.084774 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.084737 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:51.330984 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.330948 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:51.411209 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.411124 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cxv9s"] Jul 08 16:35:51.416116 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.416095 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.424800 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.419993 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 16:35:51.424800 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.420587 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 16:35:51.424800 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.421668 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 16:35:51.424800 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.422272 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 16:35:51.424800 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.422571 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w5pbb\"" Jul 08 16:35:51.426949 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.426920 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:51.594650 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.594622 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2swtt\" (UniqueName: \"kubernetes.io/projected/f82a72a9-96c5-4586-8393-dd353ae1c120-kube-api-access-2swtt\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.594650 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.594659 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f82a72a9-96c5-4586-8393-dd353ae1c120-node-exporter-textfile\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.594883 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.594759 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f82a72a9-96c5-4586-8393-dd353ae1c120-node-exporter-tls\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.594883 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.594788 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f82a72a9-96c5-4586-8393-dd353ae1c120-node-exporter-wtmp\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.594883 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.594821 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f82a72a9-96c5-4586-8393-dd353ae1c120-root\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.594883 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.594863 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f82a72a9-96c5-4586-8393-dd353ae1c120-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.595080 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.594900 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f82a72a9-96c5-4586-8393-dd353ae1c120-node-exporter-accelerators-collector-config\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.595080 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.594981 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f82a72a9-96c5-4586-8393-dd353ae1c120-metrics-client-ca\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.595080 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.595009 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f82a72a9-96c5-4586-8393-dd353ae1c120-sys\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.665272 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.665199 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:51.695537 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.695501 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2swtt\" (UniqueName: \"kubernetes.io/projected/f82a72a9-96c5-4586-8393-dd353ae1c120-kube-api-access-2swtt\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.695713 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.695550 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f82a72a9-96c5-4586-8393-dd353ae1c120-node-exporter-textfile\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.695779 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.695735 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f82a72a9-96c5-4586-8393-dd353ae1c120-node-exporter-tls\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.695927 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.695840 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f82a72a9-96c5-4586-8393-dd353ae1c120-node-exporter-wtmp\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.695927 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.695917 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f82a72a9-96c5-4586-8393-dd353ae1c120-root\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.696086 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.695963 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f82a72a9-96c5-4586-8393-dd353ae1c120-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.696086 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.695975 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f82a72a9-96c5-4586-8393-dd353ae1c120-root\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.696086 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.695990 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f82a72a9-96c5-4586-8393-dd353ae1c120-node-exporter-accelerators-collector-config\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.696086 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.696078 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f82a72a9-96c5-4586-8393-dd353ae1c120-node-exporter-textfile\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.696287 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.696084 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f82a72a9-96c5-4586-8393-dd353ae1c120-metrics-client-ca\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.696287 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.696138 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f82a72a9-96c5-4586-8393-dd353ae1c120-sys\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.696287 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.695984 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f82a72a9-96c5-4586-8393-dd353ae1c120-node-exporter-wtmp\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.696287 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.696221 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f82a72a9-96c5-4586-8393-dd353ae1c120-sys\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.696594 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.696572 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f82a72a9-96c5-4586-8393-dd353ae1c120-node-exporter-accelerators-collector-config\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.696664 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.696621 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f82a72a9-96c5-4586-8393-dd353ae1c120-metrics-client-ca\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.698712 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.698691 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f82a72a9-96c5-4586-8393-dd353ae1c120-node-exporter-tls\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.698827 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.698714 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f82a72a9-96c5-4586-8393-dd353ae1c120-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.708800 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.708774 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2swtt\" (UniqueName: \"kubernetes.io/projected/f82a72a9-96c5-4586-8393-dd353ae1c120-kube-api-access-2swtt\") pod \"node-exporter-cxv9s\" (UID: \"f82a72a9-96c5-4586-8393-dd353ae1c120\") " pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.731184 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.731117 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cxv9s" Jul 08 16:35:51.762207 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.762176 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:51.878368 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.878326 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:51.991982 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:51.991879 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:52.144367 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:52.144330 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:52.337660 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:52.337629 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:52.480864 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:52.480826 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:52.738668 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:52.738570 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:54.330030 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:54.329994 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:54.517836 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:54.517799 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:54.781612 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:54.781519 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:55.259878 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:35:55.259850 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf82a72a9_96c5_4586_8393_dd353ae1c120.slice/crio-29540911ff5759522664361186d807e8173c22d0dd2b6b8df389ade6aa5bd9c1 WatchSource:0}: Error finding container 29540911ff5759522664361186d807e8173c22d0dd2b6b8df389ade6aa5bd9c1: Status 404 returned error can't find the container with id 29540911ff5759522664361186d807e8173c22d0dd2b6b8df389ade6aa5bd9c1 Jul 08 16:35:55.301212 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:55.301188 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:55.401866 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:55.401838 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:55.483328 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:55.483303 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cxv9s" event={"ID":"f82a72a9-96c5-4586-8393-dd353ae1c120","Type":"ContainerStarted","Data":"29540911ff5759522664361186d807e8173c22d0dd2b6b8df389ade6aa5bd9c1"} Jul 08 16:35:56.101677 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:56.101621 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:56.202333 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:56.202294 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:56.294052 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:56.293995 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:56.399241 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:56.399098 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:35:56.490667 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:56.490624 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-fntb2" event={"ID":"e148bd1c-27d5-4651-9042-d7b72b1a95eb","Type":"ContainerStarted","Data":"48bae24c252f1db247fd0122eed04effa1a733b7a30650aa8f4ad2193df02014"} Jul 08 16:35:56.491682 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:56.491655 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-fntb2" Jul 08 16:35:56.505141 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:56.505112 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-fntb2" Jul 08 16:35:56.508473 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:56.508403 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-fntb2" podStartSLOduration=3.029517055 podStartE2EDuration="19.5083863s" totalImagesPullingTime="16.478869245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:56.507373743 +0000 UTC m=+91.055397504" watchObservedRunningTime="2026-07-08 16:35:56.5083863 +0000 UTC m=+91.056410038" Jul 08 16:35:56.510989 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:56.510966 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:56.608681 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:56.608620 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:57.497193 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:57.497100 2573 generic.go:356] "Generic (PLEG): container finished" podID="f82a72a9-96c5-4586-8393-dd353ae1c120" containerID="def9fc6bb25d07bb126e8145334a1fb7baf98fe4915fb18c0a7e35a02e2426e5" exitCode=0 Jul 08 16:35:57.497617 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:57.497192 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cxv9s" event={"ID":"f82a72a9-96c5-4586-8393-dd353ae1c120","Type":"ContainerDied","Data":"def9fc6bb25d07bb126e8145334a1fb7baf98fe4915fb18c0a7e35a02e2426e5"} Jul 08 16:35:57.688827 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:57.688801 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:58.503875 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:58.503835 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cxv9s" event={"ID":"f82a72a9-96c5-4586-8393-dd353ae1c120","Type":"ContainerStarted","Data":"a9111c58c5c07ce8cbaea8c372a76bf3ab5a990dd61766890245a2e0a47f86f7"} Jul 08 16:35:58.504335 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:58.503924 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cxv9s" event={"ID":"f82a72a9-96c5-4586-8393-dd353ae1c120","Type":"ContainerStarted","Data":"637b7b708a6aac493fc5ff4cf38cbd74fc7437c5af5ecafe3aacb5ae2543f02b"} Jul 08 16:35:58.529507 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:58.529461 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cxv9s" podStartSLOduration=5.74899427 podStartE2EDuration="7.529445031s" totalImagesPullingTime="1.671309014s" totalInitContainerRuntime="109.141747ms" isStatefulPod=true podCreationTimestamp="2026-07-08 16:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:58.52768118 +0000 UTC m=+93.075704936" watchObservedRunningTime="2026-07-08 16:35:58.529445031 +0000 UTC m=+93.077468779" Jul 08 16:35:58.584950 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:58.584911 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:58.851838 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:58.851807 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-599d8ff9f8-djwp8"] Jul 08 16:35:58.944631 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:58.944588 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:59.006867 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:35:59.006830 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:00.817347 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:00.817311 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:00.884216 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:00.884168 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:05.297758 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.297722 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8478cf8d45-fm2h2"] Jul 08 16:36:05.312346 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.312314 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:05.347468 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.347440 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8478cf8d45-fm2h2"] Jul 08 16:36:05.347604 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.347544 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.350533 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.350510 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 16:36:05.350672 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.350624 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 16:36:05.350672 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.350647 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 16:36:05.351347 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.351331 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 16:36:05.351465 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.351403 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 16:36:05.351465 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.351430 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lmmwj\"" Jul 08 16:36:05.354926 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.354908 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 08 16:36:05.372250 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.372223 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:05.412425 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.412400 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h48r\" (UniqueName: \"kubernetes.io/projected/15bf2caf-572d-4442-b05b-54345756c0ba-kube-api-access-9h48r\") pod \"console-8478cf8d45-fm2h2\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.412559 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.412428 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-trusted-ca-bundle\") pod \"console-8478cf8d45-fm2h2\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.412559 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.412460 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-oauth-serving-cert\") pod \"console-8478cf8d45-fm2h2\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.412559 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.412517 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15bf2caf-572d-4442-b05b-54345756c0ba-console-serving-cert\") pod \"console-8478cf8d45-fm2h2\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.412559 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.412538 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15bf2caf-572d-4442-b05b-54345756c0ba-console-oauth-config\") pod \"console-8478cf8d45-fm2h2\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.412705 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.412604 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-service-ca\") pod \"console-8478cf8d45-fm2h2\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.412705 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.412643 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-console-config\") pod \"console-8478cf8d45-fm2h2\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.513799 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.513769 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15bf2caf-572d-4442-b05b-54345756c0ba-console-serving-cert\") pod \"console-8478cf8d45-fm2h2\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.513799 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.513804 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15bf2caf-572d-4442-b05b-54345756c0ba-console-oauth-config\") pod \"console-8478cf8d45-fm2h2\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.514011 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.513841 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-service-ca\") pod \"console-8478cf8d45-fm2h2\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.514011 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.513873 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-console-config\") pod \"console-8478cf8d45-fm2h2\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.514011 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.513926 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h48r\" (UniqueName: \"kubernetes.io/projected/15bf2caf-572d-4442-b05b-54345756c0ba-kube-api-access-9h48r\") pod \"console-8478cf8d45-fm2h2\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.514159 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.514061 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-trusted-ca-bundle\") pod \"console-8478cf8d45-fm2h2\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.514159 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.514137 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-oauth-serving-cert\") pod \"console-8478cf8d45-fm2h2\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.514725 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.514696 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-service-ca\") pod \"console-8478cf8d45-fm2h2\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.514858 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.514771 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-console-config\") pod \"console-8478cf8d45-fm2h2\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.514858 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.514786 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-oauth-serving-cert\") pod \"console-8478cf8d45-fm2h2\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.514858 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.514853 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-trusted-ca-bundle\") pod \"console-8478cf8d45-fm2h2\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.516283 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.516264 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15bf2caf-572d-4442-b05b-54345756c0ba-console-serving-cert\") pod \"console-8478cf8d45-fm2h2\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.516370 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.516296 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15bf2caf-572d-4442-b05b-54345756c0ba-console-oauth-config\") pod \"console-8478cf8d45-fm2h2\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.522603 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.522581 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h48r\" (UniqueName: \"kubernetes.io/projected/15bf2caf-572d-4442-b05b-54345756c0ba-kube-api-access-9h48r\") pod \"console-8478cf8d45-fm2h2\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.657232 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.657199 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:05.830614 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:05.830584 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8478cf8d45-fm2h2"] Jul 08 16:36:05.834130 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:36:05.834103 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15bf2caf_572d_4442_b05b_54345756c0ba.slice/crio-4377a4673e5b8bdc950f76a6afea22aad24ba8a1d995ff5eefa50f64bfc56dee WatchSource:0}: Error finding container 4377a4673e5b8bdc950f76a6afea22aad24ba8a1d995ff5eefa50f64bfc56dee: Status 404 returned error can't find the container with id 4377a4673e5b8bdc950f76a6afea22aad24ba8a1d995ff5eefa50f64bfc56dee Jul 08 16:36:06.535807 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:06.535769 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8478cf8d45-fm2h2" event={"ID":"15bf2caf-572d-4442-b05b-54345756c0ba","Type":"ContainerStarted","Data":"4377a4673e5b8bdc950f76a6afea22aad24ba8a1d995ff5eefa50f64bfc56dee"} Jul 08 16:36:07.085378 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:07.085318 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:07.187667 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:07.187623 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:07.675218 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:07.675185 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:07.773590 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:07.773552 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:09.558588 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:09.558497 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8478cf8d45-fm2h2" event={"ID":"15bf2caf-572d-4442-b05b-54345756c0ba","Type":"ContainerStarted","Data":"16402d3932b46e8db4c705ed6be0f0b8dc0444fab25377eb767b62aa260ce076"} Jul 08 16:36:09.577286 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:09.577240 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8478cf8d45-fm2h2" podStartSLOduration=1.332161491 podStartE2EDuration="4.577223477s" totalImagesPullingTime="3.245061986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:36:09.576273208 +0000 UTC m=+104.124296964" watchObservedRunningTime="2026-07-08 16:36:09.577223477 +0000 UTC m=+104.125247214" Jul 08 16:36:10.140411 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:10.140360 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:10.212511 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:10.212476 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:10.422346 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:10.422270 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-68grn" Jul 08 16:36:10.433813 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:10.433783 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:10.535224 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:10.535185 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:15.657827 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:15.657791 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:15.658325 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:15.658011 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:15.663709 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:15.663688 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:15.812118 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:15.812083 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:15.876183 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:15.876149 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:16.586689 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:16.586661 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:36:16.748590 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:16.748548 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:17.543731 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:17.543695 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:17.600160 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:17.600111 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:23.880095 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:23.880053 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" podUID="e82aa850-caf7-4a18-9901-2cf2c383a16e" containerName="registry" containerID="cri-o://2141b6b6f9f53bbece7ad1012431aeab6f761cfc5e54c03fd83707ead852c57f" gracePeriod=30 Jul 08 16:36:24.149469 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.149397 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:36:24.278690 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.278656 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9wl4\" (UniqueName: \"kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-kube-api-access-f9wl4\") pod \"e82aa850-caf7-4a18-9901-2cf2c383a16e\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " Jul 08 16:36:24.278918 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.278709 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e82aa850-caf7-4a18-9901-2cf2c383a16e-image-registry-private-configuration\") pod \"e82aa850-caf7-4a18-9901-2cf2c383a16e\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " Jul 08 16:36:24.278918 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.278752 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e82aa850-caf7-4a18-9901-2cf2c383a16e-trusted-ca\") pod \"e82aa850-caf7-4a18-9901-2cf2c383a16e\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " Jul 08 16:36:24.278918 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.278781 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e82aa850-caf7-4a18-9901-2cf2c383a16e-installation-pull-secrets\") pod \"e82aa850-caf7-4a18-9901-2cf2c383a16e\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " Jul 08 16:36:24.278918 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.278809 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls\") pod \"e82aa850-caf7-4a18-9901-2cf2c383a16e\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " Jul 08 16:36:24.278918 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.278838 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-certificates\") pod \"e82aa850-caf7-4a18-9901-2cf2c383a16e\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " Jul 08 16:36:24.278918 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.278866 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e82aa850-caf7-4a18-9901-2cf2c383a16e-ca-trust-extracted\") pod \"e82aa850-caf7-4a18-9901-2cf2c383a16e\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " Jul 08 16:36:24.279212 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.278927 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-bound-sa-token\") pod \"e82aa850-caf7-4a18-9901-2cf2c383a16e\" (UID: \"e82aa850-caf7-4a18-9901-2cf2c383a16e\") " Jul 08 16:36:24.279290 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.279262 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e82aa850-caf7-4a18-9901-2cf2c383a16e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e82aa850-caf7-4a18-9901-2cf2c383a16e" (UID: "e82aa850-caf7-4a18-9901-2cf2c383a16e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:36:24.279410 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.279375 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e82aa850-caf7-4a18-9901-2cf2c383a16e" (UID: "e82aa850-caf7-4a18-9901-2cf2c383a16e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:36:24.281295 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.281249 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-kube-api-access-f9wl4" (OuterVolumeSpecName: "kube-api-access-f9wl4") pod "e82aa850-caf7-4a18-9901-2cf2c383a16e" (UID: "e82aa850-caf7-4a18-9901-2cf2c383a16e"). InnerVolumeSpecName "kube-api-access-f9wl4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:36:24.281405 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.281330 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e82aa850-caf7-4a18-9901-2cf2c383a16e" (UID: "e82aa850-caf7-4a18-9901-2cf2c383a16e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:36:24.281457 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.281394 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e82aa850-caf7-4a18-9901-2cf2c383a16e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e82aa850-caf7-4a18-9901-2cf2c383a16e" (UID: "e82aa850-caf7-4a18-9901-2cf2c383a16e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:36:24.281645 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.281616 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e82aa850-caf7-4a18-9901-2cf2c383a16e" (UID: "e82aa850-caf7-4a18-9901-2cf2c383a16e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:36:24.281777 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.281753 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e82aa850-caf7-4a18-9901-2cf2c383a16e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e82aa850-caf7-4a18-9901-2cf2c383a16e" (UID: "e82aa850-caf7-4a18-9901-2cf2c383a16e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:36:24.287931 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.287868 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e82aa850-caf7-4a18-9901-2cf2c383a16e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e82aa850-caf7-4a18-9901-2cf2c383a16e" (UID: "e82aa850-caf7-4a18-9901-2cf2c383a16e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:36:24.380552 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.380514 2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-certificates\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:36:24.380552 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.380543 2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e82aa850-caf7-4a18-9901-2cf2c383a16e-ca-trust-extracted\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:36:24.380552 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.380553 2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-bound-sa-token\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:36:24.380552 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.380561 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9wl4\" (UniqueName: \"kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-kube-api-access-f9wl4\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:36:24.380791 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.380572 2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e82aa850-caf7-4a18-9901-2cf2c383a16e-image-registry-private-configuration\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:36:24.380791 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.380582 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e82aa850-caf7-4a18-9901-2cf2c383a16e-trusted-ca\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:36:24.380791 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.380590 2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e82aa850-caf7-4a18-9901-2cf2c383a16e-installation-pull-secrets\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:36:24.380791 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.380597 2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e82aa850-caf7-4a18-9901-2cf2c383a16e-registry-tls\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:36:24.613487 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.613450 2573 generic.go:356] "Generic (PLEG): container finished" podID="e82aa850-caf7-4a18-9901-2cf2c383a16e" containerID="2141b6b6f9f53bbece7ad1012431aeab6f761cfc5e54c03fd83707ead852c57f" exitCode=0 Jul 08 16:36:24.613681 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.613498 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" Jul 08 16:36:24.613681 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.613540 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" event={"ID":"e82aa850-caf7-4a18-9901-2cf2c383a16e","Type":"ContainerDied","Data":"2141b6b6f9f53bbece7ad1012431aeab6f761cfc5e54c03fd83707ead852c57f"} Jul 08 16:36:24.613681 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.613586 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-599d8ff9f8-djwp8" event={"ID":"e82aa850-caf7-4a18-9901-2cf2c383a16e","Type":"ContainerDied","Data":"71a142bc771dc4eaa7b072522e631e5641ab0e655fc5169937705c6308ac974f"} Jul 08 16:36:24.613681 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.613608 2573 scope.go:117] "RemoveContainer" containerID="2141b6b6f9f53bbece7ad1012431aeab6f761cfc5e54c03fd83707ead852c57f" Jul 08 16:36:24.621991 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.621974 2573 scope.go:117] "RemoveContainer" containerID="2141b6b6f9f53bbece7ad1012431aeab6f761cfc5e54c03fd83707ead852c57f" Jul 08 16:36:24.622268 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:36:24.622248 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2141b6b6f9f53bbece7ad1012431aeab6f761cfc5e54c03fd83707ead852c57f\": container with ID starting with 2141b6b6f9f53bbece7ad1012431aeab6f761cfc5e54c03fd83707ead852c57f not found: ID does not exist" containerID="2141b6b6f9f53bbece7ad1012431aeab6f761cfc5e54c03fd83707ead852c57f" Jul 08 16:36:24.622338 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.622281 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2141b6b6f9f53bbece7ad1012431aeab6f761cfc5e54c03fd83707ead852c57f"} err="failed to get container status \"2141b6b6f9f53bbece7ad1012431aeab6f761cfc5e54c03fd83707ead852c57f\": rpc error: code = NotFound desc = could not find container \"2141b6b6f9f53bbece7ad1012431aeab6f761cfc5e54c03fd83707ead852c57f\": container with ID starting with 2141b6b6f9f53bbece7ad1012431aeab6f761cfc5e54c03fd83707ead852c57f not found: ID does not exist" Jul 08 16:36:24.641300 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.641268 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-599d8ff9f8-djwp8"] Jul 08 16:36:24.652709 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:24.652684 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-599d8ff9f8-djwp8"] Jul 08 16:36:25.996122 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:25.996091 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e82aa850-caf7-4a18-9901-2cf2c383a16e" path="/var/lib/kubelet/pods/e82aa850-caf7-4a18-9901-2cf2c383a16e/volumes" Jul 08 16:36:30.824388 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:30.824350 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:30.935504 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:30.935466 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:31.642254 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:31.642217 2573 generic.go:356] "Generic (PLEG): container finished" podID="1816c65a-cbd4-4aa1-a834-577c758bd2b8" containerID="a4f8328998bc0d21b686a44c752c27d346fe251e1c01313b1573781480dac0e3" exitCode=0 Jul 08 16:36:31.642421 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:31.642296 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" event={"ID":"1816c65a-cbd4-4aa1-a834-577c758bd2b8","Type":"ContainerDied","Data":"a4f8328998bc0d21b686a44c752c27d346fe251e1c01313b1573781480dac0e3"} Jul 08 16:36:31.642689 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:31.642672 2573 scope.go:117] "RemoveContainer" containerID="a4f8328998bc0d21b686a44c752c27d346fe251e1c01313b1573781480dac0e3" Jul 08 16:36:32.647391 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:32.647353 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-kbftc" event={"ID":"1816c65a-cbd4-4aa1-a834-577c758bd2b8","Type":"ContainerStarted","Data":"b0f16e5e4b1d64738dd345e47cf42a81e618e3c188c6209c5fb17bc331e7653f"} Jul 08 16:36:36.663399 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:36.663364 2573 generic.go:356] "Generic (PLEG): container finished" podID="f22fd4ec-e3b0-4718-851d-629899796803" containerID="3c199562641076bfa3df492073f1214c6a88e930f76e8e6fc365a409b88627a8" exitCode=0 Jul 08 16:36:36.663867 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:36.663441 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6rgk2" event={"ID":"f22fd4ec-e3b0-4718-851d-629899796803","Type":"ContainerDied","Data":"3c199562641076bfa3df492073f1214c6a88e930f76e8e6fc365a409b88627a8"} Jul 08 16:36:36.663965 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:36.663940 2573 scope.go:117] "RemoveContainer" containerID="3c199562641076bfa3df492073f1214c6a88e930f76e8e6fc365a409b88627a8" Jul 08 16:36:37.669589 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:37.669555 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6rgk2" event={"ID":"f22fd4ec-e3b0-4718-851d-629899796803","Type":"ContainerStarted","Data":"6d0e6a3d32a2510bd1f050d951084210c128626904e6c6100b0ce0e1d6217578"} Jul 08 16:36:47.714838 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:47.714800 2573 generic.go:356] "Generic (PLEG): container finished" podID="0b3c6c71-4820-4470-b23a-538a5422b776" containerID="fea9156bda72923e9017d5f0c1c9ab60dcfc0ca8f525acd902d997a59fa4219b" exitCode=0 Jul 08 16:36:47.715233 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:47.714870 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hgnz2" event={"ID":"0b3c6c71-4820-4470-b23a-538a5422b776","Type":"ContainerDied","Data":"fea9156bda72923e9017d5f0c1c9ab60dcfc0ca8f525acd902d997a59fa4219b"} Jul 08 16:36:47.715233 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:47.715226 2573 scope.go:117] "RemoveContainer" containerID="fea9156bda72923e9017d5f0c1c9ab60dcfc0ca8f525acd902d997a59fa4219b" Jul 08 16:36:48.720349 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:36:48.720311 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hgnz2" event={"ID":"0b3c6c71-4820-4470-b23a-538a5422b776","Type":"ContainerStarted","Data":"24dc7492e50aaca7d1640582f3c62614a12c8864ac7996ad4451ba3da63b4a5b"} Jul 08 16:37:00.980745 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:00.980707 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:01.039443 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:01.039412 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:10.637164 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:10.637129 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:11.219263 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:11.219219 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:19.190557 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.190478 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b8ccc486d-2bjfr"] Jul 08 16:37:19.191021 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.190753 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e82aa850-caf7-4a18-9901-2cf2c383a16e" containerName="registry" Jul 08 16:37:19.191021 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.190765 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e82aa850-caf7-4a18-9901-2cf2c383a16e" containerName="registry" Jul 08 16:37:19.191021 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.190813 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e82aa850-caf7-4a18-9901-2cf2c383a16e" containerName="registry" Jul 08 16:37:19.192544 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.192517 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.205558 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.205535 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b8ccc486d-2bjfr"] Jul 08 16:37:19.313262 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.313223 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-trusted-ca-bundle\") pod \"console-5b8ccc486d-2bjfr\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.313450 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.313273 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-console-config\") pod \"console-5b8ccc486d-2bjfr\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.313450 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.313301 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffb8271a-9778-4e68-94c5-5a45bee8644c-console-serving-cert\") pod \"console-5b8ccc486d-2bjfr\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.313450 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.313349 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffb8271a-9778-4e68-94c5-5a45bee8644c-console-oauth-config\") pod \"console-5b8ccc486d-2bjfr\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.313450 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.313385 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfmkz\" (UniqueName: \"kubernetes.io/projected/ffb8271a-9778-4e68-94c5-5a45bee8644c-kube-api-access-lfmkz\") pod \"console-5b8ccc486d-2bjfr\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.313450 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.313411 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-service-ca\") pod \"console-5b8ccc486d-2bjfr\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.313450 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.313445 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-oauth-serving-cert\") pod \"console-5b8ccc486d-2bjfr\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.414345 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.414304 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-trusted-ca-bundle\") pod \"console-5b8ccc486d-2bjfr\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.414345 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.414348 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-console-config\") pod \"console-5b8ccc486d-2bjfr\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.414572 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.414370 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffb8271a-9778-4e68-94c5-5a45bee8644c-console-serving-cert\") pod \"console-5b8ccc486d-2bjfr\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.414572 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.414389 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffb8271a-9778-4e68-94c5-5a45bee8644c-console-oauth-config\") pod \"console-5b8ccc486d-2bjfr\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.414572 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.414423 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfmkz\" (UniqueName: \"kubernetes.io/projected/ffb8271a-9778-4e68-94c5-5a45bee8644c-kube-api-access-lfmkz\") pod \"console-5b8ccc486d-2bjfr\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.414572 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.414458 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-service-ca\") pod \"console-5b8ccc486d-2bjfr\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.414755 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.414570 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-oauth-serving-cert\") pod \"console-5b8ccc486d-2bjfr\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.415250 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.415202 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-service-ca\") pod \"console-5b8ccc486d-2bjfr\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.415385 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.415253 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-console-config\") pod \"console-5b8ccc486d-2bjfr\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.415385 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.415281 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-trusted-ca-bundle\") pod \"console-5b8ccc486d-2bjfr\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.415385 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.415338 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-oauth-serving-cert\") pod \"console-5b8ccc486d-2bjfr\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.416985 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.416958 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffb8271a-9778-4e68-94c5-5a45bee8644c-console-oauth-config\") pod \"console-5b8ccc486d-2bjfr\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.417095 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.417077 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffb8271a-9778-4e68-94c5-5a45bee8644c-console-serving-cert\") pod \"console-5b8ccc486d-2bjfr\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.423340 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.423315 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfmkz\" (UniqueName: \"kubernetes.io/projected/ffb8271a-9778-4e68-94c5-5a45bee8644c-kube-api-access-lfmkz\") pod \"console-5b8ccc486d-2bjfr\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.503582 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.503486 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:19.604779 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.604741 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:19.638114 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.638081 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b8ccc486d-2bjfr"] Jul 08 16:37:19.641391 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:37:19.641364 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffb8271a_9778_4e68_94c5_5a45bee8644c.slice/crio-6544a97a08fe24d5af83bdc1ba469f125b796ef2f71a6a2e8bb6442b915ae442 WatchSource:0}: Error finding container 6544a97a08fe24d5af83bdc1ba469f125b796ef2f71a6a2e8bb6442b915ae442: Status 404 returned error can't find the container with id 6544a97a08fe24d5af83bdc1ba469f125b796ef2f71a6a2e8bb6442b915ae442 Jul 08 16:37:19.718197 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.718153 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:19.838339 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.838304 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8ccc486d-2bjfr" event={"ID":"ffb8271a-9778-4e68-94c5-5a45bee8644c","Type":"ContainerStarted","Data":"06400bb6e2ff27763a6bfae711fb9b28891d0ada88d995ee0931af7cb8993345"} Jul 08 16:37:19.838504 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.838386 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8ccc486d-2bjfr" event={"ID":"ffb8271a-9778-4e68-94c5-5a45bee8644c","Type":"ContainerStarted","Data":"6544a97a08fe24d5af83bdc1ba469f125b796ef2f71a6a2e8bb6442b915ae442"} Jul 08 16:37:19.858407 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:19.858354 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b8ccc486d-2bjfr" podStartSLOduration=0.858336737 podStartE2EDuration="858.336737ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:37:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:37:19.857971839 +0000 UTC m=+174.405995577" watchObservedRunningTime="2026-07-08 16:37:19.858336737 +0000 UTC m=+174.406360475" Jul 08 16:37:25.906214 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:25.906177 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:26.030335 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:26.030299 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:29.504425 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:29.504369 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:29.504949 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:29.504450 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:29.509422 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:29.509396 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:29.878587 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:29.878557 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:37:29.967606 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:29.967565 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8478cf8d45-fm2h2"] Jul 08 16:37:30.122007 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.121968 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c4c48f454-kpvhz"] Jul 08 16:37:30.124907 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.124872 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.127743 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.127713 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:30.136462 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.136437 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c4c48f454-kpvhz"] Jul 08 16:37:30.207742 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.207714 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-service-ca\") pod \"console-6c4c48f454-kpvhz\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.207742 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.207753 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-console-config\") pod \"console-6c4c48f454-kpvhz\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.207993 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.207772 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-oauth-serving-cert\") pod \"console-6c4c48f454-kpvhz\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.207993 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.207831 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lxp8\" (UniqueName: \"kubernetes.io/projected/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-kube-api-access-5lxp8\") pod \"console-6c4c48f454-kpvhz\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.207993 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.207870 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-console-oauth-config\") pod \"console-6c4c48f454-kpvhz\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.207993 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.207939 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-console-serving-cert\") pod \"console-6c4c48f454-kpvhz\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.207993 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.207969 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-trusted-ca-bundle\") pod \"console-6c4c48f454-kpvhz\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.219684 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.219650 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:30.309158 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.309124 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-service-ca\") pod \"console-6c4c48f454-kpvhz\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.309334 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.309166 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-console-config\") pod \"console-6c4c48f454-kpvhz\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.309334 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.309195 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-oauth-serving-cert\") pod \"console-6c4c48f454-kpvhz\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.309334 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.309222 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lxp8\" (UniqueName: \"kubernetes.io/projected/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-kube-api-access-5lxp8\") pod \"console-6c4c48f454-kpvhz\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.309334 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.309241 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-console-oauth-config\") pod \"console-6c4c48f454-kpvhz\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.309334 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.309260 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-console-serving-cert\") pod \"console-6c4c48f454-kpvhz\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.309334 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.309285 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-trusted-ca-bundle\") pod \"console-6c4c48f454-kpvhz\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.309954 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.309928 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-console-config\") pod \"console-6c4c48f454-kpvhz\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.310077 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.310000 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-oauth-serving-cert\") pod \"console-6c4c48f454-kpvhz\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.310294 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.310269 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-service-ca\") pod \"console-6c4c48f454-kpvhz\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.310359 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.310303 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-trusted-ca-bundle\") pod \"console-6c4c48f454-kpvhz\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.311826 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.311797 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-console-serving-cert\") pod \"console-6c4c48f454-kpvhz\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.311945 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.311801 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-console-oauth-config\") pod \"console-6c4c48f454-kpvhz\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.317917 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.317882 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lxp8\" (UniqueName: \"kubernetes.io/projected/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-kube-api-access-5lxp8\") pod \"console-6c4c48f454-kpvhz\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.426288 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.426212 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:30.435247 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.435219 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:30.564523 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.564500 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c4c48f454-kpvhz"] Jul 08 16:37:30.566949 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:37:30.566921 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc054bf38_be5c_40e2_8a1e_9c02a2e3c64d.slice/crio-bb2afeb268d4861a939aa35ecae4ab448e46e90ad3acd153524a1f08350eaa90 WatchSource:0}: Error finding container bb2afeb268d4861a939aa35ecae4ab448e46e90ad3acd153524a1f08350eaa90: Status 404 returned error can't find the container with id bb2afeb268d4861a939aa35ecae4ab448e46e90ad3acd153524a1f08350eaa90 Jul 08 16:37:30.879271 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.879234 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c4c48f454-kpvhz" event={"ID":"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d","Type":"ContainerStarted","Data":"faf2ca09bc75453a444ae74ac97d59483ccc5b354b6404b9066bb695d7e748a8"} Jul 08 16:37:30.879435 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.879294 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c4c48f454-kpvhz" event={"ID":"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d","Type":"ContainerStarted","Data":"bb2afeb268d4861a939aa35ecae4ab448e46e90ad3acd153524a1f08350eaa90"} Jul 08 16:37:30.897661 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:30.897604 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c4c48f454-kpvhz" podStartSLOduration=0.897582106 podStartE2EDuration="897.582106ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:37:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:37:30.897201879 +0000 UTC m=+185.445225650" watchObservedRunningTime="2026-07-08 16:37:30.897582106 +0000 UTC m=+185.445605868" Jul 08 16:37:31.028358 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:31.028326 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:31.088182 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:31.088118 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:31.824825 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:31.824788 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:31.883449 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:31.883412 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:37.771248 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:37.771208 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:37.828603 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:37.828567 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:40.436153 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:40.436112 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:40.436555 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:40.436178 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:40.440899 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:40.440867 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:40.924222 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:40.924198 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:37:40.970053 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:40.969880 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b8ccc486d-2bjfr"] Jul 08 16:37:41.086794 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:41.086746 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:41.186687 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:41.186573 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:41.249866 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:41.249833 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:45.825460 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:45.825424 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:45.926815 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:45.926778 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:54.990307 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:54.990251 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8478cf8d45-fm2h2" podUID="15bf2caf-572d-4442-b05b-54345756c0ba" containerName="console" containerID="cri-o://16402d3932b46e8db4c705ed6be0f0b8dc0444fab25377eb767b62aa260ce076" gracePeriod=15 Jul 08 16:37:55.234492 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.234467 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:37:55.310867 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.310793 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9h48r\" (UniqueName: \"kubernetes.io/projected/15bf2caf-572d-4442-b05b-54345756c0ba-kube-api-access-9h48r\") pod \"15bf2caf-572d-4442-b05b-54345756c0ba\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " Jul 08 16:37:55.310867 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.310825 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15bf2caf-572d-4442-b05b-54345756c0ba-console-serving-cert\") pod \"15bf2caf-572d-4442-b05b-54345756c0ba\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " Jul 08 16:37:55.310867 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.310858 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15bf2caf-572d-4442-b05b-54345756c0ba-console-oauth-config\") pod \"15bf2caf-572d-4442-b05b-54345756c0ba\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " Jul 08 16:37:55.311126 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.310880 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-oauth-serving-cert\") pod \"15bf2caf-572d-4442-b05b-54345756c0ba\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " Jul 08 16:37:55.311126 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.310930 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-service-ca\") pod \"15bf2caf-572d-4442-b05b-54345756c0ba\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " Jul 08 16:37:55.311126 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.310997 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-trusted-ca-bundle\") pod \"15bf2caf-572d-4442-b05b-54345756c0ba\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " Jul 08 16:37:55.311257 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.311130 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-console-config\") pod \"15bf2caf-572d-4442-b05b-54345756c0ba\" (UID: \"15bf2caf-572d-4442-b05b-54345756c0ba\") " Jul 08 16:37:55.311468 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.311420 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "15bf2caf-572d-4442-b05b-54345756c0ba" (UID: "15bf2caf-572d-4442-b05b-54345756c0ba"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:37:55.311591 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.311465 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "15bf2caf-572d-4442-b05b-54345756c0ba" (UID: "15bf2caf-572d-4442-b05b-54345756c0ba"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:37:55.311591 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.311488 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-service-ca" (OuterVolumeSpecName: "service-ca") pod "15bf2caf-572d-4442-b05b-54345756c0ba" (UID: "15bf2caf-572d-4442-b05b-54345756c0ba"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:37:55.311591 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.311557 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-console-config" (OuterVolumeSpecName: "console-config") pod "15bf2caf-572d-4442-b05b-54345756c0ba" (UID: "15bf2caf-572d-4442-b05b-54345756c0ba"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:37:55.313131 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.313113 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15bf2caf-572d-4442-b05b-54345756c0ba-kube-api-access-9h48r" (OuterVolumeSpecName: "kube-api-access-9h48r") pod "15bf2caf-572d-4442-b05b-54345756c0ba" (UID: "15bf2caf-572d-4442-b05b-54345756c0ba"). InnerVolumeSpecName "kube-api-access-9h48r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:37:55.313205 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.313135 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15bf2caf-572d-4442-b05b-54345756c0ba-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "15bf2caf-572d-4442-b05b-54345756c0ba" (UID: "15bf2caf-572d-4442-b05b-54345756c0ba"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:37:55.313205 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.313151 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15bf2caf-572d-4442-b05b-54345756c0ba-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "15bf2caf-572d-4442-b05b-54345756c0ba" (UID: "15bf2caf-572d-4442-b05b-54345756c0ba"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:37:55.412058 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.412024 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-console-config\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:37:55.412058 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.412051 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9h48r\" (UniqueName: \"kubernetes.io/projected/15bf2caf-572d-4442-b05b-54345756c0ba-kube-api-access-9h48r\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:37:55.412058 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.412062 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15bf2caf-572d-4442-b05b-54345756c0ba-console-serving-cert\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:37:55.412285 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.412073 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15bf2caf-572d-4442-b05b-54345756c0ba-console-oauth-config\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:37:55.412285 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.412081 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-oauth-serving-cert\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:37:55.412285 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.412089 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-service-ca\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:37:55.412285 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.412097 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15bf2caf-572d-4442-b05b-54345756c0ba-trusted-ca-bundle\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:37:55.976243 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.976212 2573 generic.go:356] "Generic (PLEG): container finished" podID="15bf2caf-572d-4442-b05b-54345756c0ba" containerID="16402d3932b46e8db4c705ed6be0f0b8dc0444fab25377eb767b62aa260ce076" exitCode=0 Jul 08 16:37:55.976405 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.976252 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8478cf8d45-fm2h2" Jul 08 16:37:55.976405 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.976275 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8478cf8d45-fm2h2" event={"ID":"15bf2caf-572d-4442-b05b-54345756c0ba","Type":"ContainerDied","Data":"16402d3932b46e8db4c705ed6be0f0b8dc0444fab25377eb767b62aa260ce076"} Jul 08 16:37:55.976405 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.976336 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8478cf8d45-fm2h2" event={"ID":"15bf2caf-572d-4442-b05b-54345756c0ba","Type":"ContainerDied","Data":"4377a4673e5b8bdc950f76a6afea22aad24ba8a1d995ff5eefa50f64bfc56dee"} Jul 08 16:37:55.976405 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.976355 2573 scope.go:117] "RemoveContainer" containerID="16402d3932b46e8db4c705ed6be0f0b8dc0444fab25377eb767b62aa260ce076" Jul 08 16:37:55.985157 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.985135 2573 scope.go:117] "RemoveContainer" containerID="16402d3932b46e8db4c705ed6be0f0b8dc0444fab25377eb767b62aa260ce076" Jul 08 16:37:55.985393 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:37:55.985376 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16402d3932b46e8db4c705ed6be0f0b8dc0444fab25377eb767b62aa260ce076\": container with ID starting with 16402d3932b46e8db4c705ed6be0f0b8dc0444fab25377eb767b62aa260ce076 not found: ID does not exist" containerID="16402d3932b46e8db4c705ed6be0f0b8dc0444fab25377eb767b62aa260ce076" Jul 08 16:37:55.985438 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.985402 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16402d3932b46e8db4c705ed6be0f0b8dc0444fab25377eb767b62aa260ce076"} err="failed to get container status \"16402d3932b46e8db4c705ed6be0f0b8dc0444fab25377eb767b62aa260ce076\": rpc error: code = NotFound desc = could not find container \"16402d3932b46e8db4c705ed6be0f0b8dc0444fab25377eb767b62aa260ce076\": container with ID starting with 16402d3932b46e8db4c705ed6be0f0b8dc0444fab25377eb767b62aa260ce076 not found: ID does not exist" Jul 08 16:37:55.999370 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:55.999344 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8478cf8d45-fm2h2"] Jul 08 16:37:56.005050 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:56.005023 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8478cf8d45-fm2h2"] Jul 08 16:37:57.995073 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:57.995045 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15bf2caf-572d-4442-b05b-54345756c0ba" path="/var/lib/kubelet/pods/15bf2caf-572d-4442-b05b-54345756c0ba/volumes" Jul 08 16:37:59.599994 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:59.599964 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:59.719478 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:37:59.719448 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:38:02.591656 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:02.591624 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:38:02.652315 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:02.652283 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:38:05.998126 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:05.998066 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5b8ccc486d-2bjfr" podUID="ffb8271a-9778-4e68-94c5-5a45bee8644c" containerName="console" containerID="cri-o://06400bb6e2ff27763a6bfae711fb9b28891d0ada88d995ee0931af7cb8993345" gracePeriod=15 Jul 08 16:38:06.233336 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:06.233313 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:38:06.291921 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:06.291833 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-oauth-serving-cert\") pod \"ffb8271a-9778-4e68-94c5-5a45bee8644c\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " Jul 08 16:38:06.291921 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:06.291906 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-console-config\") pod \"ffb8271a-9778-4e68-94c5-5a45bee8644c\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " Jul 08 16:38:06.292120 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:06.291931 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffb8271a-9778-4e68-94c5-5a45bee8644c-console-serving-cert\") pod \"ffb8271a-9778-4e68-94c5-5a45bee8644c\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " Jul 08 16:38:06.292120 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:06.291960 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-service-ca\") pod \"ffb8271a-9778-4e68-94c5-5a45bee8644c\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " Jul 08 16:38:06.292120 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:06.291978 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-trusted-ca-bundle\") pod \"ffb8271a-9778-4e68-94c5-5a45bee8644c\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " Jul 08 16:38:06.292120 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:06.291994 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffb8271a-9778-4e68-94c5-5a45bee8644c-console-oauth-config\") pod \"ffb8271a-9778-4e68-94c5-5a45bee8644c\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " Jul 08 16:38:06.292120 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:06.292015 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfmkz\" (UniqueName: \"kubernetes.io/projected/ffb8271a-9778-4e68-94c5-5a45bee8644c-kube-api-access-lfmkz\") pod \"ffb8271a-9778-4e68-94c5-5a45bee8644c\" (UID: \"ffb8271a-9778-4e68-94c5-5a45bee8644c\") " Jul 08 16:38:06.292363 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:06.292283 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ffb8271a-9778-4e68-94c5-5a45bee8644c" (UID: "ffb8271a-9778-4e68-94c5-5a45bee8644c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:38:06.292464 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:06.292438 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-service-ca" (OuterVolumeSpecName: "service-ca") pod "ffb8271a-9778-4e68-94c5-5a45bee8644c" (UID: "ffb8271a-9778-4e68-94c5-5a45bee8644c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:38:06.292539 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:06.292442 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-console-config" (OuterVolumeSpecName: "console-config") pod "ffb8271a-9778-4e68-94c5-5a45bee8644c" (UID: "ffb8271a-9778-4e68-94c5-5a45bee8644c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:38:06.292595 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:06.292528 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ffb8271a-9778-4e68-94c5-5a45bee8644c" (UID: "ffb8271a-9778-4e68-94c5-5a45bee8644c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:38:06.294157 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:06.294135 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffb8271a-9778-4e68-94c5-5a45bee8644c-kube-api-access-lfmkz" (OuterVolumeSpecName: "kube-api-access-lfmkz") pod "ffb8271a-9778-4e68-94c5-5a45bee8644c" (UID: "ffb8271a-9778-4e68-94c5-5a45bee8644c"). InnerVolumeSpecName "kube-api-access-lfmkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:38:06.294231 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:06.294201 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffb8271a-9778-4e68-94c5-5a45bee8644c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ffb8271a-9778-4e68-94c5-5a45bee8644c" (UID: "ffb8271a-9778-4e68-94c5-5a45bee8644c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:38:06.294231 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:06.294214 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffb8271a-9778-4e68-94c5-5a45bee8644c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ffb8271a-9778-4e68-94c5-5a45bee8644c" (UID: "ffb8271a-9778-4e68-94c5-5a45bee8644c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:38:06.392521 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:06.392492 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-service-ca\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:38:06.392521 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:06.392516 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-trusted-ca-bundle\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:38:06.392521 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:06.392526 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffb8271a-9778-4e68-94c5-5a45bee8644c-console-oauth-config\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:38:06.392768 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:06.392535 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfmkz\" (UniqueName: \"kubernetes.io/projected/ffb8271a-9778-4e68-94c5-5a45bee8644c-kube-api-access-lfmkz\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:38:06.392768 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:06.392545 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-oauth-serving-cert\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:38:06.392768 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:06.392552 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffb8271a-9778-4e68-94c5-5a45bee8644c-console-config\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:38:06.392768 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:06.392561 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffb8271a-9778-4e68-94c5-5a45bee8644c-console-serving-cert\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:38:07.016367 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:07.016330 2573 generic.go:356] "Generic (PLEG): container finished" podID="ffb8271a-9778-4e68-94c5-5a45bee8644c" containerID="06400bb6e2ff27763a6bfae711fb9b28891d0ada88d995ee0931af7cb8993345" exitCode=0 Jul 08 16:38:07.016766 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:07.016380 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8ccc486d-2bjfr" Jul 08 16:38:07.016766 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:07.016425 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8ccc486d-2bjfr" event={"ID":"ffb8271a-9778-4e68-94c5-5a45bee8644c","Type":"ContainerDied","Data":"06400bb6e2ff27763a6bfae711fb9b28891d0ada88d995ee0931af7cb8993345"} Jul 08 16:38:07.016766 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:07.016473 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8ccc486d-2bjfr" event={"ID":"ffb8271a-9778-4e68-94c5-5a45bee8644c","Type":"ContainerDied","Data":"6544a97a08fe24d5af83bdc1ba469f125b796ef2f71a6a2e8bb6442b915ae442"} Jul 08 16:38:07.016766 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:07.016493 2573 scope.go:117] "RemoveContainer" containerID="06400bb6e2ff27763a6bfae711fb9b28891d0ada88d995ee0931af7cb8993345" Jul 08 16:38:07.024676 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:07.024654 2573 scope.go:117] "RemoveContainer" containerID="06400bb6e2ff27763a6bfae711fb9b28891d0ada88d995ee0931af7cb8993345" Jul 08 16:38:07.024909 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:38:07.024876 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06400bb6e2ff27763a6bfae711fb9b28891d0ada88d995ee0931af7cb8993345\": container with ID starting with 06400bb6e2ff27763a6bfae711fb9b28891d0ada88d995ee0931af7cb8993345 not found: ID does not exist" containerID="06400bb6e2ff27763a6bfae711fb9b28891d0ada88d995ee0931af7cb8993345" Jul 08 16:38:07.025018 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:07.024918 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06400bb6e2ff27763a6bfae711fb9b28891d0ada88d995ee0931af7cb8993345"} err="failed to get container status \"06400bb6e2ff27763a6bfae711fb9b28891d0ada88d995ee0931af7cb8993345\": rpc error: code = NotFound desc = could not find container \"06400bb6e2ff27763a6bfae711fb9b28891d0ada88d995ee0931af7cb8993345\": container with ID starting with 06400bb6e2ff27763a6bfae711fb9b28891d0ada88d995ee0931af7cb8993345 not found: ID does not exist" Jul 08 16:38:07.036353 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:07.036329 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b8ccc486d-2bjfr"] Jul 08 16:38:07.042159 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:07.042137 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b8ccc486d-2bjfr"] Jul 08 16:38:07.996056 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:07.996021 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffb8271a-9778-4e68-94c5-5a45bee8644c" path="/var/lib/kubelet/pods/ffb8271a-9778-4e68-94c5-5a45bee8644c/volumes" Jul 08 16:38:51.793668 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:38:51.793588 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:39:16.065413 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:16.065375 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:39:16.175071 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:16.175036 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:39:16.414696 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:16.414665 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:39:16.533127 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:16.533095 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:39:16.643479 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:16.643444 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:39:18.499088 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:18.499049 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:39:18.774732 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:18.774642 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g"] Jul 08 16:39:18.775043 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:18.775027 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffb8271a-9778-4e68-94c5-5a45bee8644c" containerName="console" Jul 08 16:39:18.775106 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:18.775046 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffb8271a-9778-4e68-94c5-5a45bee8644c" containerName="console" Jul 08 16:39:18.775106 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:18.775058 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15bf2caf-572d-4442-b05b-54345756c0ba" containerName="console" Jul 08 16:39:18.775106 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:18.775063 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="15bf2caf-572d-4442-b05b-54345756c0ba" containerName="console" Jul 08 16:39:18.775197 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:18.775116 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="15bf2caf-572d-4442-b05b-54345756c0ba" containerName="console" Jul 08 16:39:18.775197 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:18.775123 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffb8271a-9778-4e68-94c5-5a45bee8644c" containerName="console" Jul 08 16:39:18.778103 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:18.778089 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g" Jul 08 16:39:18.780543 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:18.780522 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4xlfj\"" Jul 08 16:39:18.780654 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:18.780585 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 16:39:18.781050 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:18.781035 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 16:39:18.786825 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:18.786805 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g"] Jul 08 16:39:18.822089 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:18.822063 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8lbn\" (UniqueName: \"kubernetes.io/projected/37c0fa62-7024-48fd-9f8f-92baf5f3dd66-kube-api-access-m8lbn\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g\" (UID: \"37c0fa62-7024-48fd-9f8f-92baf5f3dd66\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g" Jul 08 16:39:18.822198 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:18.822100 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37c0fa62-7024-48fd-9f8f-92baf5f3dd66-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g\" (UID: \"37c0fa62-7024-48fd-9f8f-92baf5f3dd66\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g" Jul 08 16:39:18.822198 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:18.822119 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37c0fa62-7024-48fd-9f8f-92baf5f3dd66-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g\" (UID: \"37c0fa62-7024-48fd-9f8f-92baf5f3dd66\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g" Jul 08 16:39:18.922997 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:18.922969 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37c0fa62-7024-48fd-9f8f-92baf5f3dd66-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g\" (UID: \"37c0fa62-7024-48fd-9f8f-92baf5f3dd66\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g" Jul 08 16:39:18.923112 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:18.923001 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37c0fa62-7024-48fd-9f8f-92baf5f3dd66-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g\" (UID: \"37c0fa62-7024-48fd-9f8f-92baf5f3dd66\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g" Jul 08 16:39:18.923112 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:18.923065 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8lbn\" (UniqueName: \"kubernetes.io/projected/37c0fa62-7024-48fd-9f8f-92baf5f3dd66-kube-api-access-m8lbn\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g\" (UID: \"37c0fa62-7024-48fd-9f8f-92baf5f3dd66\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g" Jul 08 16:39:18.923316 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:18.923299 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37c0fa62-7024-48fd-9f8f-92baf5f3dd66-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g\" (UID: \"37c0fa62-7024-48fd-9f8f-92baf5f3dd66\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g" Jul 08 16:39:18.923406 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:18.923390 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37c0fa62-7024-48fd-9f8f-92baf5f3dd66-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g\" (UID: \"37c0fa62-7024-48fd-9f8f-92baf5f3dd66\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g" Jul 08 16:39:18.931499 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:18.931477 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8lbn\" (UniqueName: \"kubernetes.io/projected/37c0fa62-7024-48fd-9f8f-92baf5f3dd66-kube-api-access-m8lbn\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g\" (UID: \"37c0fa62-7024-48fd-9f8f-92baf5f3dd66\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g" Jul 08 16:39:19.087422 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:19.087390 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g" Jul 08 16:39:19.212105 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:19.212013 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g"] Jul 08 16:39:19.214662 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:39:19.214633 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c0fa62_7024_48fd_9f8f_92baf5f3dd66.slice/crio-2ebc869fa6f8d565113275614fc20b7ed61168f2c4d607fcb5e48adc41744abf WatchSource:0}: Error finding container 2ebc869fa6f8d565113275614fc20b7ed61168f2c4d607fcb5e48adc41744abf: Status 404 returned error can't find the container with id 2ebc869fa6f8d565113275614fc20b7ed61168f2c4d607fcb5e48adc41744abf Jul 08 16:39:19.269666 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:19.269634 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g" event={"ID":"37c0fa62-7024-48fd-9f8f-92baf5f3dd66","Type":"ContainerStarted","Data":"2ebc869fa6f8d565113275614fc20b7ed61168f2c4d607fcb5e48adc41744abf"} Jul 08 16:39:25.862447 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:25.862416 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vsdvp_6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8/console-operator/1.log" Jul 08 16:39:25.865204 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:25.865173 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vsdvp_6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8/console-operator/1.log" Jul 08 16:39:25.872631 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:25.872610 2573 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 16:39:26.297925 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:26.297814 2573 generic.go:356] "Generic (PLEG): container finished" podID="37c0fa62-7024-48fd-9f8f-92baf5f3dd66" containerID="845c2797156b5af9c6e02b2ebfd6d53da1bc35983b0e81d20ff3fba37a6d2f81" exitCode=0 Jul 08 16:39:26.299970 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:26.297925 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g" event={"ID":"37c0fa62-7024-48fd-9f8f-92baf5f3dd66","Type":"ContainerDied","Data":"845c2797156b5af9c6e02b2ebfd6d53da1bc35983b0e81d20ff3fba37a6d2f81"} Jul 08 16:39:28.307790 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:28.307709 2573 generic.go:356] "Generic (PLEG): container finished" podID="37c0fa62-7024-48fd-9f8f-92baf5f3dd66" containerID="c7c092e5f696fc536363c03521eaf789c315d045180e561a9eb334e11d3a1507" exitCode=0 Jul 08 16:39:28.307790 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:28.307774 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g" event={"ID":"37c0fa62-7024-48fd-9f8f-92baf5f3dd66","Type":"ContainerDied","Data":"c7c092e5f696fc536363c03521eaf789c315d045180e561a9eb334e11d3a1507"} Jul 08 16:39:28.308808 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:28.308787 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 16:39:33.111249 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:33.111205 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:39:34.335592 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:34.335559 2573 generic.go:356] "Generic (PLEG): container finished" podID="37c0fa62-7024-48fd-9f8f-92baf5f3dd66" containerID="dad282149131acfb94bb12603b227935f714092c7f415fa7212f2ee04d23129a" exitCode=0 Jul 08 16:39:34.335969 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:34.335598 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g" event={"ID":"37c0fa62-7024-48fd-9f8f-92baf5f3dd66","Type":"ContainerDied","Data":"dad282149131acfb94bb12603b227935f714092c7f415fa7212f2ee04d23129a"} Jul 08 16:39:35.458410 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:35.458384 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g" Jul 08 16:39:35.547216 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:35.547181 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8lbn\" (UniqueName: \"kubernetes.io/projected/37c0fa62-7024-48fd-9f8f-92baf5f3dd66-kube-api-access-m8lbn\") pod \"37c0fa62-7024-48fd-9f8f-92baf5f3dd66\" (UID: \"37c0fa62-7024-48fd-9f8f-92baf5f3dd66\") " Jul 08 16:39:35.547386 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:35.547238 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37c0fa62-7024-48fd-9f8f-92baf5f3dd66-util\") pod \"37c0fa62-7024-48fd-9f8f-92baf5f3dd66\" (UID: \"37c0fa62-7024-48fd-9f8f-92baf5f3dd66\") " Jul 08 16:39:35.547386 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:35.547286 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37c0fa62-7024-48fd-9f8f-92baf5f3dd66-bundle\") pod \"37c0fa62-7024-48fd-9f8f-92baf5f3dd66\" (UID: \"37c0fa62-7024-48fd-9f8f-92baf5f3dd66\") " Jul 08 16:39:35.547934 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:35.547881 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37c0fa62-7024-48fd-9f8f-92baf5f3dd66-bundle" (OuterVolumeSpecName: "bundle") pod "37c0fa62-7024-48fd-9f8f-92baf5f3dd66" (UID: "37c0fa62-7024-48fd-9f8f-92baf5f3dd66"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:39:35.549433 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:35.549409 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37c0fa62-7024-48fd-9f8f-92baf5f3dd66-kube-api-access-m8lbn" (OuterVolumeSpecName: "kube-api-access-m8lbn") pod "37c0fa62-7024-48fd-9f8f-92baf5f3dd66" (UID: "37c0fa62-7024-48fd-9f8f-92baf5f3dd66"). InnerVolumeSpecName "kube-api-access-m8lbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:39:35.551317 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:35.551293 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37c0fa62-7024-48fd-9f8f-92baf5f3dd66-util" (OuterVolumeSpecName: "util") pod "37c0fa62-7024-48fd-9f8f-92baf5f3dd66" (UID: "37c0fa62-7024-48fd-9f8f-92baf5f3dd66"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:39:35.648414 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:35.648319 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8lbn\" (UniqueName: \"kubernetes.io/projected/37c0fa62-7024-48fd-9f8f-92baf5f3dd66-kube-api-access-m8lbn\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:39:35.648414 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:35.648361 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37c0fa62-7024-48fd-9f8f-92baf5f3dd66-util\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:39:35.648414 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:35.648371 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37c0fa62-7024-48fd-9f8f-92baf5f3dd66-bundle\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:39:36.345424 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:36.345391 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g" event={"ID":"37c0fa62-7024-48fd-9f8f-92baf5f3dd66","Type":"ContainerDied","Data":"2ebc869fa6f8d565113275614fc20b7ed61168f2c4d607fcb5e48adc41744abf"} Jul 08 16:39:36.345620 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:36.345437 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ebc869fa6f8d565113275614fc20b7ed61168f2c4d607fcb5e48adc41744abf" Jul 08 16:39:36.345620 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:36.345403 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vv75g" Jul 08 16:39:40.491709 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:40.491671 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:39:40.615074 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:40.615044 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:39:42.378152 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:42.378117 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l69pt"] Jul 08 16:39:42.378513 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:42.378418 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37c0fa62-7024-48fd-9f8f-92baf5f3dd66" containerName="util" Jul 08 16:39:42.378513 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:42.378429 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="37c0fa62-7024-48fd-9f8f-92baf5f3dd66" containerName="util" Jul 08 16:39:42.378513 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:42.378446 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37c0fa62-7024-48fd-9f8f-92baf5f3dd66" containerName="extract" Jul 08 16:39:42.378513 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:42.378455 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="37c0fa62-7024-48fd-9f8f-92baf5f3dd66" containerName="extract" Jul 08 16:39:42.378513 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:42.378464 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37c0fa62-7024-48fd-9f8f-92baf5f3dd66" containerName="pull" Jul 08 16:39:42.378513 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:42.378469 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="37c0fa62-7024-48fd-9f8f-92baf5f3dd66" containerName="pull" Jul 08 16:39:42.378513 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:42.378510 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="37c0fa62-7024-48fd-9f8f-92baf5f3dd66" containerName="extract" Jul 08 16:39:42.426965 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:42.426927 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l69pt"] Jul 08 16:39:42.427143 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:42.427024 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l69pt" Jul 08 16:39:42.430077 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:42.430050 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 08 16:39:42.430077 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:42.430065 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-9jvlw\"" Jul 08 16:39:42.430256 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:42.430063 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 08 16:39:42.430256 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:42.430052 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 08 16:39:42.498876 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:42.498832 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95xkg\" (UniqueName: \"kubernetes.io/projected/c07e6656-dfd9-4b77-8c91-f9c293514c58-kube-api-access-95xkg\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-l69pt\" (UID: \"c07e6656-dfd9-4b77-8c91-f9c293514c58\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l69pt" Jul 08 16:39:42.499075 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:42.498903 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/c07e6656-dfd9-4b77-8c91-f9c293514c58-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-l69pt\" (UID: \"c07e6656-dfd9-4b77-8c91-f9c293514c58\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l69pt" Jul 08 16:39:42.599786 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:42.599748 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95xkg\" (UniqueName: \"kubernetes.io/projected/c07e6656-dfd9-4b77-8c91-f9c293514c58-kube-api-access-95xkg\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-l69pt\" (UID: \"c07e6656-dfd9-4b77-8c91-f9c293514c58\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l69pt" Jul 08 16:39:42.600002 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:42.599801 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/c07e6656-dfd9-4b77-8c91-f9c293514c58-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-l69pt\" (UID: \"c07e6656-dfd9-4b77-8c91-f9c293514c58\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l69pt" Jul 08 16:39:42.602033 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:42.602014 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/c07e6656-dfd9-4b77-8c91-f9c293514c58-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-l69pt\" (UID: \"c07e6656-dfd9-4b77-8c91-f9c293514c58\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l69pt" Jul 08 16:39:42.627448 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:42.627417 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95xkg\" (UniqueName: \"kubernetes.io/projected/c07e6656-dfd9-4b77-8c91-f9c293514c58-kube-api-access-95xkg\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-l69pt\" (UID: \"c07e6656-dfd9-4b77-8c91-f9c293514c58\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l69pt" Jul 08 16:39:42.736926 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:42.736791 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l69pt" Jul 08 16:39:42.920614 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:42.920585 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l69pt"] Jul 08 16:39:42.924196 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:39:42.924174 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc07e6656_dfd9_4b77_8c91_f9c293514c58.slice/crio-653d8609f2c52a2708b5e51409dd1f45d268699ed2b348e03be877c5e09a1c53 WatchSource:0}: Error finding container 653d8609f2c52a2708b5e51409dd1f45d268699ed2b348e03be877c5e09a1c53: Status 404 returned error can't find the container with id 653d8609f2c52a2708b5e51409dd1f45d268699ed2b348e03be877c5e09a1c53 Jul 08 16:39:43.373861 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:43.373828 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l69pt" event={"ID":"c07e6656-dfd9-4b77-8c91-f9c293514c58","Type":"ContainerStarted","Data":"653d8609f2c52a2708b5e51409dd1f45d268699ed2b348e03be877c5e09a1c53"} Jul 08 16:39:57.470157 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:57.470124 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:39:57.569800 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:39:57.569765 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:40:03.213712 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.213671 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:40:03.454586 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.454539 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l69pt" event={"ID":"c07e6656-dfd9-4b77-8c91-f9c293514c58","Type":"ContainerStarted","Data":"d6b8bb2bd96b3e3445039532cabdbb94d1a3099008d3f731b1db95f577b2b610"} Jul 08 16:40:03.454759 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.454617 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l69pt" Jul 08 16:40:03.518820 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.518707 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l69pt" podStartSLOduration=1.7933168080000002 podStartE2EDuration="21.518691006s" totalImagesPullingTime="19.725374198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:39:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:40:03.517688358 +0000 UTC m=+338.065712112" watchObservedRunningTime="2026-07-08 16:40:03.518691006 +0000 UTC m=+338.066714741" Jul 08 16:40:03.627186 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.627150 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:40:03.643876 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.643844 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-qxjsm"] Jul 08 16:40:03.645873 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.645857 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-qxjsm" Jul 08 16:40:03.649476 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.649439 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 08 16:40:03.649804 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.649787 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-nq656\"" Jul 08 16:40:03.649940 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.649923 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 08 16:40:03.664233 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.664207 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-qxjsm"] Jul 08 16:40:03.710561 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.710534 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:40:03.761601 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.761564 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/3e35ab09-3ea0-4f2f-acc2-615886c8ec52-certificates\") pod \"keda-operator-68bff59c-qxjsm\" (UID: \"3e35ab09-3ea0-4f2f-acc2-615886c8ec52\") " pod="openshift-keda/keda-operator-68bff59c-qxjsm" Jul 08 16:40:03.761601 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.761607 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/3e35ab09-3ea0-4f2f-acc2-615886c8ec52-cabundle0\") pod \"keda-operator-68bff59c-qxjsm\" (UID: \"3e35ab09-3ea0-4f2f-acc2-615886c8ec52\") " pod="openshift-keda/keda-operator-68bff59c-qxjsm" Jul 08 16:40:03.761802 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.761653 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzvtc\" (UniqueName: \"kubernetes.io/projected/3e35ab09-3ea0-4f2f-acc2-615886c8ec52-kube-api-access-xzvtc\") pod \"keda-operator-68bff59c-qxjsm\" (UID: \"3e35ab09-3ea0-4f2f-acc2-615886c8ec52\") " pod="openshift-keda/keda-operator-68bff59c-qxjsm" Jul 08 16:40:03.862292 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.862259 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/3e35ab09-3ea0-4f2f-acc2-615886c8ec52-certificates\") pod \"keda-operator-68bff59c-qxjsm\" (UID: \"3e35ab09-3ea0-4f2f-acc2-615886c8ec52\") " pod="openshift-keda/keda-operator-68bff59c-qxjsm" Jul 08 16:40:03.862292 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.862292 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/3e35ab09-3ea0-4f2f-acc2-615886c8ec52-cabundle0\") pod \"keda-operator-68bff59c-qxjsm\" (UID: \"3e35ab09-3ea0-4f2f-acc2-615886c8ec52\") " pod="openshift-keda/keda-operator-68bff59c-qxjsm" Jul 08 16:40:03.862534 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.862324 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzvtc\" (UniqueName: \"kubernetes.io/projected/3e35ab09-3ea0-4f2f-acc2-615886c8ec52-kube-api-access-xzvtc\") pod \"keda-operator-68bff59c-qxjsm\" (UID: \"3e35ab09-3ea0-4f2f-acc2-615886c8ec52\") " pod="openshift-keda/keda-operator-68bff59c-qxjsm" Jul 08 16:40:03.862984 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.862961 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/3e35ab09-3ea0-4f2f-acc2-615886c8ec52-cabundle0\") pod \"keda-operator-68bff59c-qxjsm\" (UID: \"3e35ab09-3ea0-4f2f-acc2-615886c8ec52\") " pod="openshift-keda/keda-operator-68bff59c-qxjsm" Jul 08 16:40:03.864932 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.864885 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/3e35ab09-3ea0-4f2f-acc2-615886c8ec52-certificates\") pod \"keda-operator-68bff59c-qxjsm\" (UID: \"3e35ab09-3ea0-4f2f-acc2-615886c8ec52\") " pod="openshift-keda/keda-operator-68bff59c-qxjsm" Jul 08 16:40:03.872173 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.872151 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzvtc\" (UniqueName: \"kubernetes.io/projected/3e35ab09-3ea0-4f2f-acc2-615886c8ec52-kube-api-access-xzvtc\") pod \"keda-operator-68bff59c-qxjsm\" (UID: \"3e35ab09-3ea0-4f2f-acc2-615886c8ec52\") " pod="openshift-keda/keda-operator-68bff59c-qxjsm" Jul 08 16:40:03.889215 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.889186 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:40:03.922319 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.922294 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-8lgqc"] Jul 08 16:40:03.924588 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.924574 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-8lgqc" Jul 08 16:40:03.929050 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.929030 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 08 16:40:03.938295 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.938277 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-8lgqc"] Jul 08 16:40:03.955636 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:03.955605 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-qxjsm" Jul 08 16:40:04.063721 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.063686 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8216ac20-0644-4f0b-95bd-6443ba99200c-certificates\") pod \"keda-metrics-apiserver-559f75f947-8lgqc\" (UID: \"8216ac20-0644-4f0b-95bd-6443ba99200c\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-8lgqc" Jul 08 16:40:04.063721 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.063724 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9mn2\" (UniqueName: \"kubernetes.io/projected/8216ac20-0644-4f0b-95bd-6443ba99200c-kube-api-access-s9mn2\") pod \"keda-metrics-apiserver-559f75f947-8lgqc\" (UID: \"8216ac20-0644-4f0b-95bd-6443ba99200c\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-8lgqc" Jul 08 16:40:04.063980 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.063853 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/8216ac20-0644-4f0b-95bd-6443ba99200c-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-8lgqc\" (UID: \"8216ac20-0644-4f0b-95bd-6443ba99200c\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-8lgqc" Jul 08 16:40:04.098123 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.098092 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-qxjsm"] Jul 08 16:40:04.100989 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:40:04.100953 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e35ab09_3ea0_4f2f_acc2_615886c8ec52.slice/crio-dfb594042ee3b59c83aaf21005ec8c7a20443e4b1a2e7670fddcce926b851578 WatchSource:0}: Error finding container dfb594042ee3b59c83aaf21005ec8c7a20443e4b1a2e7670fddcce926b851578: Status 404 returned error can't find the container with id dfb594042ee3b59c83aaf21005ec8c7a20443e4b1a2e7670fddcce926b851578 Jul 08 16:40:04.116777 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.116715 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:40:04.122734 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.122708 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-2ksww"] Jul 08 16:40:04.125476 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.125462 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-2ksww" Jul 08 16:40:04.127951 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.127933 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 08 16:40:04.141931 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.141909 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-2ksww"] Jul 08 16:40:04.165004 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.164977 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/8216ac20-0644-4f0b-95bd-6443ba99200c-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-8lgqc\" (UID: \"8216ac20-0644-4f0b-95bd-6443ba99200c\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-8lgqc" Jul 08 16:40:04.165146 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.165013 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8216ac20-0644-4f0b-95bd-6443ba99200c-certificates\") pod \"keda-metrics-apiserver-559f75f947-8lgqc\" (UID: \"8216ac20-0644-4f0b-95bd-6443ba99200c\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-8lgqc" Jul 08 16:40:04.165146 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.165039 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9mn2\" (UniqueName: \"kubernetes.io/projected/8216ac20-0644-4f0b-95bd-6443ba99200c-kube-api-access-s9mn2\") pod \"keda-metrics-apiserver-559f75f947-8lgqc\" (UID: \"8216ac20-0644-4f0b-95bd-6443ba99200c\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-8lgqc" Jul 08 16:40:04.165354 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.165338 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/8216ac20-0644-4f0b-95bd-6443ba99200c-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-8lgqc\" (UID: \"8216ac20-0644-4f0b-95bd-6443ba99200c\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-8lgqc" Jul 08 16:40:04.167413 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.167396 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8216ac20-0644-4f0b-95bd-6443ba99200c-certificates\") pod \"keda-metrics-apiserver-559f75f947-8lgqc\" (UID: \"8216ac20-0644-4f0b-95bd-6443ba99200c\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-8lgqc" Jul 08 16:40:04.172607 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.172589 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9mn2\" (UniqueName: \"kubernetes.io/projected/8216ac20-0644-4f0b-95bd-6443ba99200c-kube-api-access-s9mn2\") pod \"keda-metrics-apiserver-559f75f947-8lgqc\" (UID: \"8216ac20-0644-4f0b-95bd-6443ba99200c\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-8lgqc" Jul 08 16:40:04.186480 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.186434 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:40:04.236001 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.235979 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-8lgqc" Jul 08 16:40:04.256947 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.256916 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:40:04.266429 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.266405 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt8v4\" (UniqueName: \"kubernetes.io/projected/2896f090-d9ff-4d0b-a4c2-47b0fdf0e569-kube-api-access-mt8v4\") pod \"keda-admission-5fbd5c4644-2ksww\" (UID: \"2896f090-d9ff-4d0b-a4c2-47b0fdf0e569\") " pod="openshift-keda/keda-admission-5fbd5c4644-2ksww" Jul 08 16:40:04.266518 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.266448 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2896f090-d9ff-4d0b-a4c2-47b0fdf0e569-certificates\") pod \"keda-admission-5fbd5c4644-2ksww\" (UID: \"2896f090-d9ff-4d0b-a4c2-47b0fdf0e569\") " pod="openshift-keda/keda-admission-5fbd5c4644-2ksww" Jul 08 16:40:04.367264 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.367189 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-8lgqc"] Jul 08 16:40:04.367487 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.367466 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2896f090-d9ff-4d0b-a4c2-47b0fdf0e569-certificates\") pod \"keda-admission-5fbd5c4644-2ksww\" (UID: \"2896f090-d9ff-4d0b-a4c2-47b0fdf0e569\") " pod="openshift-keda/keda-admission-5fbd5c4644-2ksww" Jul 08 16:40:04.367575 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.367560 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt8v4\" (UniqueName: \"kubernetes.io/projected/2896f090-d9ff-4d0b-a4c2-47b0fdf0e569-kube-api-access-mt8v4\") pod \"keda-admission-5fbd5c4644-2ksww\" (UID: \"2896f090-d9ff-4d0b-a4c2-47b0fdf0e569\") " pod="openshift-keda/keda-admission-5fbd5c4644-2ksww" Jul 08 16:40:04.369952 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.369930 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2896f090-d9ff-4d0b-a4c2-47b0fdf0e569-certificates\") pod \"keda-admission-5fbd5c4644-2ksww\" (UID: \"2896f090-d9ff-4d0b-a4c2-47b0fdf0e569\") " pod="openshift-keda/keda-admission-5fbd5c4644-2ksww" Jul 08 16:40:04.370196 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:40:04.370176 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8216ac20_0644_4f0b_95bd_6443ba99200c.slice/crio-c2f0d7faff595c71adf1bf800ed24d211164497e32950fa236d9ef656913c6d8 WatchSource:0}: Error finding container c2f0d7faff595c71adf1bf800ed24d211164497e32950fa236d9ef656913c6d8: Status 404 returned error can't find the container with id c2f0d7faff595c71adf1bf800ed24d211164497e32950fa236d9ef656913c6d8 Jul 08 16:40:04.375689 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.375671 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt8v4\" (UniqueName: \"kubernetes.io/projected/2896f090-d9ff-4d0b-a4c2-47b0fdf0e569-kube-api-access-mt8v4\") pod \"keda-admission-5fbd5c4644-2ksww\" (UID: \"2896f090-d9ff-4d0b-a4c2-47b0fdf0e569\") " pod="openshift-keda/keda-admission-5fbd5c4644-2ksww" Jul 08 16:40:04.435663 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.435629 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-2ksww" Jul 08 16:40:04.461535 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.461507 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-qxjsm" event={"ID":"3e35ab09-3ea0-4f2f-acc2-615886c8ec52","Type":"ContainerStarted","Data":"dfb594042ee3b59c83aaf21005ec8c7a20443e4b1a2e7670fddcce926b851578"} Jul 08 16:40:04.462547 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.462522 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-8lgqc" event={"ID":"8216ac20-0644-4f0b-95bd-6443ba99200c","Type":"ContainerStarted","Data":"c2f0d7faff595c71adf1bf800ed24d211164497e32950fa236d9ef656913c6d8"} Jul 08 16:40:04.560358 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.560332 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-2ksww"] Jul 08 16:40:04.562903 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:40:04.562865 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2896f090_d9ff_4d0b_a4c2_47b0fdf0e569.slice/crio-be1def8a986cadc3f05b12a78b936ffb767a6e823be331764a05aa006e30cd06 WatchSource:0}: Error finding container be1def8a986cadc3f05b12a78b936ffb767a6e823be331764a05aa006e30cd06: Status 404 returned error can't find the container with id be1def8a986cadc3f05b12a78b936ffb767a6e823be331764a05aa006e30cd06 Jul 08 16:40:04.607306 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.607258 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:40:04.851966 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.851929 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:40:04.952304 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:04.952271 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:40:05.469373 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:05.469325 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-2ksww" event={"ID":"2896f090-d9ff-4d0b-a4c2-47b0fdf0e569","Type":"ContainerStarted","Data":"be1def8a986cadc3f05b12a78b936ffb767a6e823be331764a05aa006e30cd06"} Jul 08 16:40:09.488834 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:09.488797 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-2ksww" event={"ID":"2896f090-d9ff-4d0b-a4c2-47b0fdf0e569","Type":"ContainerStarted","Data":"12fe29464cc1749069ab40bab4eb0d44d05a5315744b86a68efdfd73eec1fee1"} Jul 08 16:40:09.489350 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:09.488855 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-2ksww" Jul 08 16:40:09.490204 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:09.490175 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-qxjsm" event={"ID":"3e35ab09-3ea0-4f2f-acc2-615886c8ec52","Type":"ContainerStarted","Data":"5fdc2ca4dc136a7441e65ac0e05c8a0c79b7aed7506b201c2dfcfaea2ac21161"} Jul 08 16:40:09.490324 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:09.490233 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-qxjsm" Jul 08 16:40:09.491476 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:09.491457 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-8lgqc" event={"ID":"8216ac20-0644-4f0b-95bd-6443ba99200c","Type":"ContainerStarted","Data":"4fb967590c292296e105427480b708a8002412e27a6cb2301b1897ad6be96ae3"} Jul 08 16:40:09.491578 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:09.491503 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-8lgqc" Jul 08 16:40:09.505810 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:09.505744 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-2ksww" podStartSLOduration=1.570997347 podStartE2EDuration="5.505726528s" totalImagesPullingTime="3.934729181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:40:09.505249808 +0000 UTC m=+344.053273562" watchObservedRunningTime="2026-07-08 16:40:09.505726528 +0000 UTC m=+344.053750265" Jul 08 16:40:09.525491 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:09.525438 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-8lgqc" podStartSLOduration=2.402666115 podStartE2EDuration="6.525423343s" totalImagesPullingTime="4.122757228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:40:09.525070891 +0000 UTC m=+344.073094628" watchObservedRunningTime="2026-07-08 16:40:09.525423343 +0000 UTC m=+344.073447077" Jul 08 16:40:09.550844 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:09.550790 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-qxjsm" podStartSLOduration=2.14521474 podStartE2EDuration="6.550774786s" totalImagesPullingTime="4.405560046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:40:09.549870897 +0000 UTC m=+344.097894655" watchObservedRunningTime="2026-07-08 16:40:09.550774786 +0000 UTC m=+344.098798522" Jul 08 16:40:20.500241 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:20.500157 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-8lgqc" Jul 08 16:40:24.465541 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:24.465509 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l69pt" Jul 08 16:40:27.547544 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:27.547509 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:40:27.615084 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:27.615049 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:40:30.498635 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:30.498608 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-qxjsm" Jul 08 16:40:30.499044 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:40:30.498784 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-2ksww" Jul 08 16:41:14.193512 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.193481 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:14.265043 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.265008 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:14.265860 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.265842 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-687b7449bc-8b87h"] Jul 08 16:41:14.267968 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.267955 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-687b7449bc-8b87h" Jul 08 16:41:14.270300 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.270285 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 08 16:41:14.270452 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.270434 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-q94tj\"" Jul 08 16:41:14.271061 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.271026 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 08 16:41:14.271264 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.271250 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 08 16:41:14.278692 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.278671 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-687b7449bc-8b87h"] Jul 08 16:41:14.372647 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.372615 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:14.397760 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.397738 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkzqr\" (UniqueName: \"kubernetes.io/projected/2789acfa-9f5a-4358-9f6a-e1d201201e1b-kube-api-access-qkzqr\") pod \"kserve-controller-manager-687b7449bc-8b87h\" (UID: \"2789acfa-9f5a-4358-9f6a-e1d201201e1b\") " pod="kserve/kserve-controller-manager-687b7449bc-8b87h" Jul 08 16:41:14.397847 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.397781 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2789acfa-9f5a-4358-9f6a-e1d201201e1b-cert\") pod \"kserve-controller-manager-687b7449bc-8b87h\" (UID: \"2789acfa-9f5a-4358-9f6a-e1d201201e1b\") " pod="kserve/kserve-controller-manager-687b7449bc-8b87h" Jul 08 16:41:14.473709 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.473645 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:14.498080 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.498046 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkzqr\" (UniqueName: \"kubernetes.io/projected/2789acfa-9f5a-4358-9f6a-e1d201201e1b-kube-api-access-qkzqr\") pod \"kserve-controller-manager-687b7449bc-8b87h\" (UID: \"2789acfa-9f5a-4358-9f6a-e1d201201e1b\") " pod="kserve/kserve-controller-manager-687b7449bc-8b87h" Jul 08 16:41:14.498191 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.498123 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2789acfa-9f5a-4358-9f6a-e1d201201e1b-cert\") pod \"kserve-controller-manager-687b7449bc-8b87h\" (UID: \"2789acfa-9f5a-4358-9f6a-e1d201201e1b\") " pod="kserve/kserve-controller-manager-687b7449bc-8b87h" Jul 08 16:41:14.500411 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.500392 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2789acfa-9f5a-4358-9f6a-e1d201201e1b-cert\") pod \"kserve-controller-manager-687b7449bc-8b87h\" (UID: \"2789acfa-9f5a-4358-9f6a-e1d201201e1b\") " pod="kserve/kserve-controller-manager-687b7449bc-8b87h" Jul 08 16:41:14.509447 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.509419 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkzqr\" (UniqueName: \"kubernetes.io/projected/2789acfa-9f5a-4358-9f6a-e1d201201e1b-kube-api-access-qkzqr\") pod \"kserve-controller-manager-687b7449bc-8b87h\" (UID: \"2789acfa-9f5a-4358-9f6a-e1d201201e1b\") " pod="kserve/kserve-controller-manager-687b7449bc-8b87h" Jul 08 16:41:14.572198 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.572175 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:14.578036 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.578019 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-687b7449bc-8b87h" Jul 08 16:41:14.698523 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.698503 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-687b7449bc-8b87h"] Jul 08 16:41:14.701029 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:41:14.700999 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2789acfa_9f5a_4358_9f6a_e1d201201e1b.slice/crio-44f4487a63ac64f2a05912154bf69d8cd8df7b351fccb24985dc6ea474bff7b3 WatchSource:0}: Error finding container 44f4487a63ac64f2a05912154bf69d8cd8df7b351fccb24985dc6ea474bff7b3: Status 404 returned error can't find the container with id 44f4487a63ac64f2a05912154bf69d8cd8df7b351fccb24985dc6ea474bff7b3 Jul 08 16:41:14.760787 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.760717 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-687b7449bc-8b87h" event={"ID":"2789acfa-9f5a-4358-9f6a-e1d201201e1b","Type":"ContainerStarted","Data":"44f4487a63ac64f2a05912154bf69d8cd8df7b351fccb24985dc6ea474bff7b3"} Jul 08 16:41:14.827170 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.827136 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:14.929351 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:14.929315 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:17.777153 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:17.777118 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-687b7449bc-8b87h" event={"ID":"2789acfa-9f5a-4358-9f6a-e1d201201e1b","Type":"ContainerStarted","Data":"a5a87b0aeb99888e736d330828581d07af80b2c5dbecc4cf94cbd7dfee586652"} Jul 08 16:41:17.777508 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:17.777201 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-687b7449bc-8b87h" Jul 08 16:41:17.796720 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:17.796632 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-687b7449bc-8b87h" podStartSLOduration=1.254896096 podStartE2EDuration="3.796614313s" totalImagesPullingTime="2.541718217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:41:17.795207861 +0000 UTC m=+412.343231615" watchObservedRunningTime="2026-07-08 16:41:17.796614313 +0000 UTC m=+412.344638051" Jul 08 16:41:48.786290 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:48.786214 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-687b7449bc-8b87h" Jul 08 16:41:49.553632 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.553602 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-687b7449bc-8b87h"] Jul 08 16:41:49.553790 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.553757 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/kserve-controller-manager-687b7449bc-8b87h" podUID="2789acfa-9f5a-4358-9f6a-e1d201201e1b" containerName="manager" containerID="cri-o://a5a87b0aeb99888e736d330828581d07af80b2c5dbecc4cf94cbd7dfee586652" gracePeriod=10 Jul 08 16:41:49.580241 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.580217 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-687b7449bc-vhcrl"] Jul 08 16:41:49.583214 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.583200 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-687b7449bc-vhcrl" Jul 08 16:41:49.593465 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.593440 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-687b7449bc-vhcrl"] Jul 08 16:41:49.738833 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.738808 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/baf10fe6-0bbb-468c-8afa-52ea9438aa6a-cert\") pod \"kserve-controller-manager-687b7449bc-vhcrl\" (UID: \"baf10fe6-0bbb-468c-8afa-52ea9438aa6a\") " pod="kserve/kserve-controller-manager-687b7449bc-vhcrl" Jul 08 16:41:49.738969 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.738909 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4shk5\" (UniqueName: \"kubernetes.io/projected/baf10fe6-0bbb-468c-8afa-52ea9438aa6a-kube-api-access-4shk5\") pod \"kserve-controller-manager-687b7449bc-vhcrl\" (UID: \"baf10fe6-0bbb-468c-8afa-52ea9438aa6a\") " pod="kserve/kserve-controller-manager-687b7449bc-vhcrl" Jul 08 16:41:49.790453 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.790435 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-687b7449bc-8b87h" Jul 08 16:41:49.840197 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.840175 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4shk5\" (UniqueName: \"kubernetes.io/projected/baf10fe6-0bbb-468c-8afa-52ea9438aa6a-kube-api-access-4shk5\") pod \"kserve-controller-manager-687b7449bc-vhcrl\" (UID: \"baf10fe6-0bbb-468c-8afa-52ea9438aa6a\") " pod="kserve/kserve-controller-manager-687b7449bc-vhcrl" Jul 08 16:41:49.840309 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.840218 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/baf10fe6-0bbb-468c-8afa-52ea9438aa6a-cert\") pod \"kserve-controller-manager-687b7449bc-vhcrl\" (UID: \"baf10fe6-0bbb-468c-8afa-52ea9438aa6a\") " pod="kserve/kserve-controller-manager-687b7449bc-vhcrl" Jul 08 16:41:49.842291 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.842272 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/baf10fe6-0bbb-468c-8afa-52ea9438aa6a-cert\") pod \"kserve-controller-manager-687b7449bc-vhcrl\" (UID: \"baf10fe6-0bbb-468c-8afa-52ea9438aa6a\") " pod="kserve/kserve-controller-manager-687b7449bc-vhcrl" Jul 08 16:41:49.849157 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.849133 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4shk5\" (UniqueName: \"kubernetes.io/projected/baf10fe6-0bbb-468c-8afa-52ea9438aa6a-kube-api-access-4shk5\") pod \"kserve-controller-manager-687b7449bc-vhcrl\" (UID: \"baf10fe6-0bbb-468c-8afa-52ea9438aa6a\") " pod="kserve/kserve-controller-manager-687b7449bc-vhcrl" Jul 08 16:41:49.905670 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.905643 2573 generic.go:356] "Generic (PLEG): container finished" podID="2789acfa-9f5a-4358-9f6a-e1d201201e1b" containerID="a5a87b0aeb99888e736d330828581d07af80b2c5dbecc4cf94cbd7dfee586652" exitCode=0 Jul 08 16:41:49.905754 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.905685 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-687b7449bc-8b87h" Jul 08 16:41:49.905754 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.905729 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-687b7449bc-8b87h" event={"ID":"2789acfa-9f5a-4358-9f6a-e1d201201e1b","Type":"ContainerDied","Data":"a5a87b0aeb99888e736d330828581d07af80b2c5dbecc4cf94cbd7dfee586652"} Jul 08 16:41:49.905823 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.905780 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-687b7449bc-8b87h" event={"ID":"2789acfa-9f5a-4358-9f6a-e1d201201e1b","Type":"ContainerDied","Data":"44f4487a63ac64f2a05912154bf69d8cd8df7b351fccb24985dc6ea474bff7b3"} Jul 08 16:41:49.905823 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.905803 2573 scope.go:117] "RemoveContainer" containerID="a5a87b0aeb99888e736d330828581d07af80b2c5dbecc4cf94cbd7dfee586652" Jul 08 16:41:49.913067 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.913045 2573 scope.go:117] "RemoveContainer" containerID="a5a87b0aeb99888e736d330828581d07af80b2c5dbecc4cf94cbd7dfee586652" Jul 08 16:41:49.913313 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:41:49.913295 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5a87b0aeb99888e736d330828581d07af80b2c5dbecc4cf94cbd7dfee586652\": container with ID starting with a5a87b0aeb99888e736d330828581d07af80b2c5dbecc4cf94cbd7dfee586652 not found: ID does not exist" containerID="a5a87b0aeb99888e736d330828581d07af80b2c5dbecc4cf94cbd7dfee586652" Jul 08 16:41:49.913374 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.913325 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5a87b0aeb99888e736d330828581d07af80b2c5dbecc4cf94cbd7dfee586652"} err="failed to get container status \"a5a87b0aeb99888e736d330828581d07af80b2c5dbecc4cf94cbd7dfee586652\": rpc error: code = NotFound desc = could not find container \"a5a87b0aeb99888e736d330828581d07af80b2c5dbecc4cf94cbd7dfee586652\": container with ID starting with a5a87b0aeb99888e736d330828581d07af80b2c5dbecc4cf94cbd7dfee586652 not found: ID does not exist" Jul 08 16:41:49.940539 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.940524 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2789acfa-9f5a-4358-9f6a-e1d201201e1b-cert\") pod \"2789acfa-9f5a-4358-9f6a-e1d201201e1b\" (UID: \"2789acfa-9f5a-4358-9f6a-e1d201201e1b\") " Jul 08 16:41:49.940604 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.940573 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkzqr\" (UniqueName: \"kubernetes.io/projected/2789acfa-9f5a-4358-9f6a-e1d201201e1b-kube-api-access-qkzqr\") pod \"2789acfa-9f5a-4358-9f6a-e1d201201e1b\" (UID: \"2789acfa-9f5a-4358-9f6a-e1d201201e1b\") " Jul 08 16:41:49.942380 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.942355 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2789acfa-9f5a-4358-9f6a-e1d201201e1b-kube-api-access-qkzqr" (OuterVolumeSpecName: "kube-api-access-qkzqr") pod "2789acfa-9f5a-4358-9f6a-e1d201201e1b" (UID: "2789acfa-9f5a-4358-9f6a-e1d201201e1b"). InnerVolumeSpecName "kube-api-access-qkzqr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:41:49.942451 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.942397 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2789acfa-9f5a-4358-9f6a-e1d201201e1b-cert" (OuterVolumeSpecName: "cert") pod "2789acfa-9f5a-4358-9f6a-e1d201201e1b" (UID: "2789acfa-9f5a-4358-9f6a-e1d201201e1b"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:41:49.943488 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:49.943475 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-687b7449bc-vhcrl" Jul 08 16:41:50.041392 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:50.041369 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkzqr\" (UniqueName: \"kubernetes.io/projected/2789acfa-9f5a-4358-9f6a-e1d201201e1b-kube-api-access-qkzqr\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:41:50.041392 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:50.041395 2573 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2789acfa-9f5a-4358-9f6a-e1d201201e1b-cert\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:41:50.066125 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:50.066105 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-687b7449bc-vhcrl"] Jul 08 16:41:50.068522 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:41:50.068493 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaf10fe6_0bbb_468c_8afa_52ea9438aa6a.slice/crio-e3729f503b3bef434c4f5060ef10e911cf0d2580cefb3fbd925f88842aef2f18 WatchSource:0}: Error finding container e3729f503b3bef434c4f5060ef10e911cf0d2580cefb3fbd925f88842aef2f18: Status 404 returned error can't find the container with id e3729f503b3bef434c4f5060ef10e911cf0d2580cefb3fbd925f88842aef2f18 Jul 08 16:41:50.221747 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:50.221694 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-687b7449bc-8b87h"] Jul 08 16:41:50.227478 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:50.227454 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-687b7449bc-8b87h"] Jul 08 16:41:50.912585 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:50.912546 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-687b7449bc-vhcrl" event={"ID":"baf10fe6-0bbb-468c-8afa-52ea9438aa6a","Type":"ContainerStarted","Data":"26edd25d0d04a0143eeab3f78815bec50a32a387b15a57437690bb403bd8451a"} Jul 08 16:41:50.913327 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:50.912653 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-687b7449bc-vhcrl" event={"ID":"baf10fe6-0bbb-468c-8afa-52ea9438aa6a","Type":"ContainerStarted","Data":"e3729f503b3bef434c4f5060ef10e911cf0d2580cefb3fbd925f88842aef2f18"} Jul 08 16:41:50.913398 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:50.913369 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-687b7449bc-vhcrl" Jul 08 16:41:50.932369 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:50.932332 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-687b7449bc-vhcrl" podStartSLOduration=1.513525911 podStartE2EDuration="1.932320337s" totalImagesPullingTime="418.794426ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:41:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:41:50.932022131 +0000 UTC m=+445.480045872" watchObservedRunningTime="2026-07-08 16:41:50.932320337 +0000 UTC m=+445.480344072" Jul 08 16:41:51.996725 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:41:51.996692 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2789acfa-9f5a-4358-9f6a-e1d201201e1b" path="/var/lib/kubelet/pods/2789acfa-9f5a-4358-9f6a-e1d201201e1b/volumes" Jul 08 16:42:22.929654 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:22.929626 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-687b7449bc-vhcrl" Jul 08 16:42:23.936259 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:23.936225 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:42:23.964537 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:23.964511 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-8l7vd"] Jul 08 16:42:23.964806 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:23.964794 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2789acfa-9f5a-4358-9f6a-e1d201201e1b" containerName="manager" Jul 08 16:42:23.964845 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:23.964807 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2789acfa-9f5a-4358-9f6a-e1d201201e1b" containerName="manager" Jul 08 16:42:23.964878 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:23.964870 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2789acfa-9f5a-4358-9f6a-e1d201201e1b" containerName="manager" Jul 08 16:42:23.967858 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:23.967842 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-8l7vd" Jul 08 16:42:23.969988 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:23.969969 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 08 16:42:23.970096 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:23.970049 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-p4jjz\"" Jul 08 16:42:23.981101 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:23.981078 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-8l7vd"] Jul 08 16:42:24.036639 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:24.036609 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:42:24.087474 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:24.087452 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2df8139e-47ad-4228-a379-ae911a621245-tls-certs\") pod \"model-serving-api-fd65d7d6-8l7vd\" (UID: \"2df8139e-47ad-4228-a379-ae911a621245\") " pod="kserve/model-serving-api-fd65d7d6-8l7vd" Jul 08 16:42:24.087587 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:24.087479 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6v7j\" (UniqueName: \"kubernetes.io/projected/2df8139e-47ad-4228-a379-ae911a621245-kube-api-access-w6v7j\") pod \"model-serving-api-fd65d7d6-8l7vd\" (UID: \"2df8139e-47ad-4228-a379-ae911a621245\") " pod="kserve/model-serving-api-fd65d7d6-8l7vd" Jul 08 16:42:24.188615 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:24.188553 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2df8139e-47ad-4228-a379-ae911a621245-tls-certs\") pod \"model-serving-api-fd65d7d6-8l7vd\" (UID: \"2df8139e-47ad-4228-a379-ae911a621245\") " pod="kserve/model-serving-api-fd65d7d6-8l7vd" Jul 08 16:42:24.188615 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:24.188581 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6v7j\" (UniqueName: \"kubernetes.io/projected/2df8139e-47ad-4228-a379-ae911a621245-kube-api-access-w6v7j\") pod \"model-serving-api-fd65d7d6-8l7vd\" (UID: \"2df8139e-47ad-4228-a379-ae911a621245\") " pod="kserve/model-serving-api-fd65d7d6-8l7vd" Jul 08 16:42:24.190946 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:24.190925 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2df8139e-47ad-4228-a379-ae911a621245-tls-certs\") pod \"model-serving-api-fd65d7d6-8l7vd\" (UID: \"2df8139e-47ad-4228-a379-ae911a621245\") " pod="kserve/model-serving-api-fd65d7d6-8l7vd" Jul 08 16:42:24.196078 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:24.196055 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6v7j\" (UniqueName: \"kubernetes.io/projected/2df8139e-47ad-4228-a379-ae911a621245-kube-api-access-w6v7j\") pod \"model-serving-api-fd65d7d6-8l7vd\" (UID: \"2df8139e-47ad-4228-a379-ae911a621245\") " pod="kserve/model-serving-api-fd65d7d6-8l7vd" Jul 08 16:42:24.206228 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:24.206206 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:42:24.277790 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:24.277763 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-8l7vd" Jul 08 16:42:24.348548 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:24.348516 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:42:24.401573 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:24.401549 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-8l7vd"] Jul 08 16:42:24.404100 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:42:24.404076 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df8139e_47ad_4228_a379_ae911a621245.slice/crio-592574389f82a54b644b8bfda80046d33a5b4898279674ebc9146f9e30b213ce WatchSource:0}: Error finding container 592574389f82a54b644b8bfda80046d33a5b4898279674ebc9146f9e30b213ce: Status 404 returned error can't find the container with id 592574389f82a54b644b8bfda80046d33a5b4898279674ebc9146f9e30b213ce Jul 08 16:42:24.707291 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:24.707258 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:42:24.801714 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:24.801684 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:42:25.051825 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:25.051747 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-8l7vd" event={"ID":"2df8139e-47ad-4228-a379-ae911a621245","Type":"ContainerStarted","Data":"592574389f82a54b644b8bfda80046d33a5b4898279674ebc9146f9e30b213ce"} Jul 08 16:42:26.057215 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.057185 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-8l7vd" event={"ID":"2df8139e-47ad-4228-a379-ae911a621245","Type":"ContainerStarted","Data":"7dfe18117882720bacc16d7bf9bd96a5c31ec2666a9d0862ea334cd9b70d7357"} Jul 08 16:42:26.057607 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.057310 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-8l7vd" Jul 08 16:42:26.075318 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.075277 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-8l7vd" podStartSLOduration=1.514973553 podStartE2EDuration="3.075262133s" totalImagesPullingTime="1.56028858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:42:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:42:26.074920871 +0000 UTC m=+480.622944625" watchObservedRunningTime="2026-07-08 16:42:26.075262133 +0000 UTC m=+480.623285871" Jul 08 16:42:26.568752 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.568718 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67f4548486-td9kf"] Jul 08 16:42:26.572312 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.572288 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:26.582603 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.582550 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f4548486-td9kf"] Jul 08 16:42:26.608094 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.608067 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f23b7e8b-da74-4c84-ab65-59014b0c0461-console-serving-cert\") pod \"console-67f4548486-td9kf\" (UID: \"f23b7e8b-da74-4c84-ab65-59014b0c0461\") " pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:26.608291 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.608105 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f23b7e8b-da74-4c84-ab65-59014b0c0461-console-oauth-config\") pod \"console-67f4548486-td9kf\" (UID: \"f23b7e8b-da74-4c84-ab65-59014b0c0461\") " pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:26.608291 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.608155 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f23b7e8b-da74-4c84-ab65-59014b0c0461-trusted-ca-bundle\") pod \"console-67f4548486-td9kf\" (UID: \"f23b7e8b-da74-4c84-ab65-59014b0c0461\") " pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:26.608291 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.608178 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f23b7e8b-da74-4c84-ab65-59014b0c0461-console-config\") pod \"console-67f4548486-td9kf\" (UID: \"f23b7e8b-da74-4c84-ab65-59014b0c0461\") " pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:26.608291 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.608254 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f23b7e8b-da74-4c84-ab65-59014b0c0461-service-ca\") pod \"console-67f4548486-td9kf\" (UID: \"f23b7e8b-da74-4c84-ab65-59014b0c0461\") " pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:26.608472 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.608291 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbxwl\" (UniqueName: \"kubernetes.io/projected/f23b7e8b-da74-4c84-ab65-59014b0c0461-kube-api-access-lbxwl\") pod \"console-67f4548486-td9kf\" (UID: \"f23b7e8b-da74-4c84-ab65-59014b0c0461\") " pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:26.608472 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.608328 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f23b7e8b-da74-4c84-ab65-59014b0c0461-oauth-serving-cert\") pod \"console-67f4548486-td9kf\" (UID: \"f23b7e8b-da74-4c84-ab65-59014b0c0461\") " pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:26.620154 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.620121 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:42:26.706586 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.706560 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:42:26.709304 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.709282 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f23b7e8b-da74-4c84-ab65-59014b0c0461-trusted-ca-bundle\") pod \"console-67f4548486-td9kf\" (UID: \"f23b7e8b-da74-4c84-ab65-59014b0c0461\") " pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:26.709415 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.709314 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f23b7e8b-da74-4c84-ab65-59014b0c0461-console-config\") pod \"console-67f4548486-td9kf\" (UID: \"f23b7e8b-da74-4c84-ab65-59014b0c0461\") " pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:26.709415 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.709355 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f23b7e8b-da74-4c84-ab65-59014b0c0461-service-ca\") pod \"console-67f4548486-td9kf\" (UID: \"f23b7e8b-da74-4c84-ab65-59014b0c0461\") " pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:26.709415 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.709393 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbxwl\" (UniqueName: \"kubernetes.io/projected/f23b7e8b-da74-4c84-ab65-59014b0c0461-kube-api-access-lbxwl\") pod \"console-67f4548486-td9kf\" (UID: \"f23b7e8b-da74-4c84-ab65-59014b0c0461\") " pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:26.709576 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.709434 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f23b7e8b-da74-4c84-ab65-59014b0c0461-oauth-serving-cert\") pod \"console-67f4548486-td9kf\" (UID: \"f23b7e8b-da74-4c84-ab65-59014b0c0461\") " pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:26.709576 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.709483 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f23b7e8b-da74-4c84-ab65-59014b0c0461-console-serving-cert\") pod \"console-67f4548486-td9kf\" (UID: \"f23b7e8b-da74-4c84-ab65-59014b0c0461\") " pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:26.709745 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.709711 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f23b7e8b-da74-4c84-ab65-59014b0c0461-console-oauth-config\") pod \"console-67f4548486-td9kf\" (UID: \"f23b7e8b-da74-4c84-ab65-59014b0c0461\") " pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:26.710102 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.710080 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f23b7e8b-da74-4c84-ab65-59014b0c0461-console-config\") pod \"console-67f4548486-td9kf\" (UID: \"f23b7e8b-da74-4c84-ab65-59014b0c0461\") " pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:26.710217 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.710158 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f23b7e8b-da74-4c84-ab65-59014b0c0461-trusted-ca-bundle\") pod \"console-67f4548486-td9kf\" (UID: \"f23b7e8b-da74-4c84-ab65-59014b0c0461\") " pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:26.710298 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.710263 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f23b7e8b-da74-4c84-ab65-59014b0c0461-service-ca\") pod \"console-67f4548486-td9kf\" (UID: \"f23b7e8b-da74-4c84-ab65-59014b0c0461\") " pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:26.710569 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.710541 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f23b7e8b-da74-4c84-ab65-59014b0c0461-oauth-serving-cert\") pod \"console-67f4548486-td9kf\" (UID: \"f23b7e8b-da74-4c84-ab65-59014b0c0461\") " pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:26.711968 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.711943 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f23b7e8b-da74-4c84-ab65-59014b0c0461-console-serving-cert\") pod \"console-67f4548486-td9kf\" (UID: \"f23b7e8b-da74-4c84-ab65-59014b0c0461\") " pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:26.712116 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.712085 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f23b7e8b-da74-4c84-ab65-59014b0c0461-console-oauth-config\") pod \"console-67f4548486-td9kf\" (UID: \"f23b7e8b-da74-4c84-ab65-59014b0c0461\") " pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:26.718455 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.718427 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbxwl\" (UniqueName: \"kubernetes.io/projected/f23b7e8b-da74-4c84-ab65-59014b0c0461-kube-api-access-lbxwl\") pod \"console-67f4548486-td9kf\" (UID: \"f23b7e8b-da74-4c84-ab65-59014b0c0461\") " pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:26.770206 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.770179 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:42:26.871987 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.871959 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:42:26.883279 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:26.883255 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:27.011861 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:27.011835 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f4548486-td9kf"] Jul 08 16:42:27.013998 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:42:27.013971 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf23b7e8b_da74_4c84_ab65_59014b0c0461.slice/crio-d3f9878dcf1ca205a0213ff2df47589865d28d7f2ee5e84e277429e3eced3e77 WatchSource:0}: Error finding container d3f9878dcf1ca205a0213ff2df47589865d28d7f2ee5e84e277429e3eced3e77: Status 404 returned error can't find the container with id d3f9878dcf1ca205a0213ff2df47589865d28d7f2ee5e84e277429e3eced3e77 Jul 08 16:42:27.063368 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:27.063342 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f4548486-td9kf" event={"ID":"f23b7e8b-da74-4c84-ab65-59014b0c0461","Type":"ContainerStarted","Data":"d3f9878dcf1ca205a0213ff2df47589865d28d7f2ee5e84e277429e3eced3e77"} Jul 08 16:42:27.376171 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:27.376135 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:42:28.068805 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:28.068766 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f4548486-td9kf" event={"ID":"f23b7e8b-da74-4c84-ab65-59014b0c0461","Type":"ContainerStarted","Data":"a1fae9ee1d90a422c1177664b85ccea55f3853b5cc94262e551f5f5a6b292cbc"} Jul 08 16:42:28.088016 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:28.087966 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67f4548486-td9kf" podStartSLOduration=2.087950124 podStartE2EDuration="2.087950124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:42:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:42:28.086541703 +0000 UTC m=+482.634565439" watchObservedRunningTime="2026-07-08 16:42:28.087950124 +0000 UTC m=+482.635973860" Jul 08 16:42:36.883464 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:36.883433 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:36.883798 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:36.883508 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:36.888319 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:36.888297 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:37.067587 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:37.067562 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-8l7vd" Jul 08 16:42:37.109514 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:37.109486 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67f4548486-td9kf" Jul 08 16:42:37.161040 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:37.160938 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c4c48f454-kpvhz"] Jul 08 16:42:37.279504 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:37.279469 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:42:37.378732 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:37.378698 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:42:37.443264 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:37.443178 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:42:58.693204 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:42:58.693168 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:43:02.184008 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.183973 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6c4c48f454-kpvhz" podUID="c054bf38-be5c-40e2-8a1e-9c02a2e3c64d" containerName="console" containerID="cri-o://faf2ca09bc75453a444ae74ac97d59483ccc5b354b6404b9066bb695d7e748a8" gracePeriod=15 Jul 08 16:43:02.420205 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.420183 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:43:02.489637 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.489575 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-console-serving-cert\") pod \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " Jul 08 16:43:02.489637 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.489612 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lxp8\" (UniqueName: \"kubernetes.io/projected/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-kube-api-access-5lxp8\") pod \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " Jul 08 16:43:02.489811 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.489653 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-service-ca\") pod \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " Jul 08 16:43:02.489811 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.489766 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-trusted-ca-bundle\") pod \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " Jul 08 16:43:02.489930 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.489858 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-oauth-serving-cert\") pod \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " Jul 08 16:43:02.489930 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.489905 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-console-oauth-config\") pod \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " Jul 08 16:43:02.490029 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.489938 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-console-config\") pod \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\" (UID: \"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d\") " Jul 08 16:43:02.490029 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.489967 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-service-ca" (OuterVolumeSpecName: "service-ca") pod "c054bf38-be5c-40e2-8a1e-9c02a2e3c64d" (UID: "c054bf38-be5c-40e2-8a1e-9c02a2e3c64d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:43:02.490172 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.490134 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c054bf38-be5c-40e2-8a1e-9c02a2e3c64d" (UID: "c054bf38-be5c-40e2-8a1e-9c02a2e3c64d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:43:02.490172 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.490165 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-service-ca\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:43:02.490432 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.490204 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c054bf38-be5c-40e2-8a1e-9c02a2e3c64d" (UID: "c054bf38-be5c-40e2-8a1e-9c02a2e3c64d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:43:02.490432 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.490369 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-console-config" (OuterVolumeSpecName: "console-config") pod "c054bf38-be5c-40e2-8a1e-9c02a2e3c64d" (UID: "c054bf38-be5c-40e2-8a1e-9c02a2e3c64d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:43:02.491744 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.491722 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c054bf38-be5c-40e2-8a1e-9c02a2e3c64d" (UID: "c054bf38-be5c-40e2-8a1e-9c02a2e3c64d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:43:02.491840 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.491775 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-kube-api-access-5lxp8" (OuterVolumeSpecName: "kube-api-access-5lxp8") pod "c054bf38-be5c-40e2-8a1e-9c02a2e3c64d" (UID: "c054bf38-be5c-40e2-8a1e-9c02a2e3c64d"). InnerVolumeSpecName "kube-api-access-5lxp8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:43:02.491922 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.491901 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c054bf38-be5c-40e2-8a1e-9c02a2e3c64d" (UID: "c054bf38-be5c-40e2-8a1e-9c02a2e3c64d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:43:02.590989 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.590966 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-oauth-serving-cert\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:43:02.590989 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.590984 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-console-oauth-config\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:43:02.590989 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.590995 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-console-config\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:43:02.591171 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.591003 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-console-serving-cert\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:43:02.591171 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.591012 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lxp8\" (UniqueName: \"kubernetes.io/projected/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-kube-api-access-5lxp8\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:43:02.591171 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:02.591020 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d-trusted-ca-bundle\") on node \"ip-10-0-141-103.ec2.internal\" DevicePath \"\"" Jul 08 16:43:03.220469 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:03.220437 2573 generic.go:356] "Generic (PLEG): container finished" podID="c054bf38-be5c-40e2-8a1e-9c02a2e3c64d" containerID="faf2ca09bc75453a444ae74ac97d59483ccc5b354b6404b9066bb695d7e748a8" exitCode=0 Jul 08 16:43:03.220830 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:03.220481 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c4c48f454-kpvhz" Jul 08 16:43:03.220830 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:03.220516 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c4c48f454-kpvhz" event={"ID":"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d","Type":"ContainerDied","Data":"faf2ca09bc75453a444ae74ac97d59483ccc5b354b6404b9066bb695d7e748a8"} Jul 08 16:43:03.220830 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:03.220567 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c4c48f454-kpvhz" event={"ID":"c054bf38-be5c-40e2-8a1e-9c02a2e3c64d","Type":"ContainerDied","Data":"bb2afeb268d4861a939aa35ecae4ab448e46e90ad3acd153524a1f08350eaa90"} Jul 08 16:43:03.220830 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:03.220586 2573 scope.go:117] "RemoveContainer" containerID="faf2ca09bc75453a444ae74ac97d59483ccc5b354b6404b9066bb695d7e748a8" Jul 08 16:43:03.228696 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:03.228672 2573 scope.go:117] "RemoveContainer" containerID="faf2ca09bc75453a444ae74ac97d59483ccc5b354b6404b9066bb695d7e748a8" Jul 08 16:43:03.228978 ip-10-0-141-103 kubenswrapper[2573]: E0708 16:43:03.228942 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"faf2ca09bc75453a444ae74ac97d59483ccc5b354b6404b9066bb695d7e748a8\": container with ID starting with faf2ca09bc75453a444ae74ac97d59483ccc5b354b6404b9066bb695d7e748a8 not found: ID does not exist" containerID="faf2ca09bc75453a444ae74ac97d59483ccc5b354b6404b9066bb695d7e748a8" Jul 08 16:43:03.229037 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:03.228986 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faf2ca09bc75453a444ae74ac97d59483ccc5b354b6404b9066bb695d7e748a8"} err="failed to get container status \"faf2ca09bc75453a444ae74ac97d59483ccc5b354b6404b9066bb695d7e748a8\": rpc error: code = NotFound desc = could not find container \"faf2ca09bc75453a444ae74ac97d59483ccc5b354b6404b9066bb695d7e748a8\": container with ID starting with faf2ca09bc75453a444ae74ac97d59483ccc5b354b6404b9066bb695d7e748a8 not found: ID does not exist" Jul 08 16:43:03.240983 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:03.240960 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c4c48f454-kpvhz"] Jul 08 16:43:03.247468 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:03.247449 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c4c48f454-kpvhz"] Jul 08 16:43:03.996050 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:03.996015 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c054bf38-be5c-40e2-8a1e-9c02a2e3c64d" path="/var/lib/kubelet/pods/c054bf38-be5c-40e2-8a1e-9c02a2e3c64d/volumes" Jul 08 16:43:22.637449 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:22.637360 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:43:52.785630 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:43:52.785595 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:44:02.493324 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:02.493283 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:44:07.845115 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:07.845083 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-zv2mn"] Jul 08 16:44:07.845525 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:07.845371 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c054bf38-be5c-40e2-8a1e-9c02a2e3c64d" containerName="console" Jul 08 16:44:07.845525 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:07.845381 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c054bf38-be5c-40e2-8a1e-9c02a2e3c64d" containerName="console" Jul 08 16:44:07.845525 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:07.845431 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c054bf38-be5c-40e2-8a1e-9c02a2e3c64d" containerName="console" Jul 08 16:44:07.848169 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:07.848152 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-zv2mn" Jul 08 16:44:07.850584 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:07.850561 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 08 16:44:07.850584 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:07.850577 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom\"" Jul 08 16:44:07.851319 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:07.851305 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-jm8n7\"" Jul 08 16:44:07.857804 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:07.857785 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-zv2mn"] Jul 08 16:44:07.872509 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:07.872489 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9e0177c5-d243-4c80-807f-58f20d00e2e7-data\") pod \"seaweedfs-tls-custom-8b44d767d-zv2mn\" (UID: \"9e0177c5-d243-4c80-807f-58f20d00e2e7\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-zv2mn" Jul 08 16:44:07.872615 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:07.872528 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/9e0177c5-d243-4c80-807f-58f20d00e2e7-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-zv2mn\" (UID: \"9e0177c5-d243-4c80-807f-58f20d00e2e7\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-zv2mn" Jul 08 16:44:07.872615 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:07.872549 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq4xc\" (UniqueName: \"kubernetes.io/projected/9e0177c5-d243-4c80-807f-58f20d00e2e7-kube-api-access-xq4xc\") pod \"seaweedfs-tls-custom-8b44d767d-zv2mn\" (UID: \"9e0177c5-d243-4c80-807f-58f20d00e2e7\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-zv2mn" Jul 08 16:44:07.973576 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:07.973549 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9e0177c5-d243-4c80-807f-58f20d00e2e7-data\") pod \"seaweedfs-tls-custom-8b44d767d-zv2mn\" (UID: \"9e0177c5-d243-4c80-807f-58f20d00e2e7\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-zv2mn" Jul 08 16:44:07.973749 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:07.973605 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/9e0177c5-d243-4c80-807f-58f20d00e2e7-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-zv2mn\" (UID: \"9e0177c5-d243-4c80-807f-58f20d00e2e7\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-zv2mn" Jul 08 16:44:07.973749 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:07.973630 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq4xc\" (UniqueName: \"kubernetes.io/projected/9e0177c5-d243-4c80-807f-58f20d00e2e7-kube-api-access-xq4xc\") pod \"seaweedfs-tls-custom-8b44d767d-zv2mn\" (UID: \"9e0177c5-d243-4c80-807f-58f20d00e2e7\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-zv2mn" Jul 08 16:44:07.973927 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:07.973882 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9e0177c5-d243-4c80-807f-58f20d00e2e7-data\") pod \"seaweedfs-tls-custom-8b44d767d-zv2mn\" (UID: \"9e0177c5-d243-4c80-807f-58f20d00e2e7\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-zv2mn" Jul 08 16:44:07.975997 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:07.975975 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/9e0177c5-d243-4c80-807f-58f20d00e2e7-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-zv2mn\" (UID: \"9e0177c5-d243-4c80-807f-58f20d00e2e7\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-zv2mn" Jul 08 16:44:07.983572 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:07.983554 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq4xc\" (UniqueName: \"kubernetes.io/projected/9e0177c5-d243-4c80-807f-58f20d00e2e7-kube-api-access-xq4xc\") pod \"seaweedfs-tls-custom-8b44d767d-zv2mn\" (UID: \"9e0177c5-d243-4c80-807f-58f20d00e2e7\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-zv2mn" Jul 08 16:44:08.157974 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:08.157919 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-zv2mn" Jul 08 16:44:08.285158 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:08.285040 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-zv2mn"] Jul 08 16:44:08.287394 ip-10-0-141-103 kubenswrapper[2573]: W0708 16:44:08.287369 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e0177c5_d243_4c80_807f_58f20d00e2e7.slice/crio-da7fb7d0845f748f9f0944f9271b8a887331d2f803d5e67ffb5ac91dc05a67ce WatchSource:0}: Error finding container da7fb7d0845f748f9f0944f9271b8a887331d2f803d5e67ffb5ac91dc05a67ce: Status 404 returned error can't find the container with id da7fb7d0845f748f9f0944f9271b8a887331d2f803d5e67ffb5ac91dc05a67ce Jul 08 16:44:08.486026 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:08.485949 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-zv2mn" event={"ID":"9e0177c5-d243-4c80-807f-58f20d00e2e7","Type":"ContainerStarted","Data":"da7fb7d0845f748f9f0944f9271b8a887331d2f803d5e67ffb5ac91dc05a67ce"} Jul 08 16:44:12.503325 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:12.503287 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-zv2mn" event={"ID":"9e0177c5-d243-4c80-807f-58f20d00e2e7","Type":"ContainerStarted","Data":"fde38e0e8ee1f21e172f88a21f029b4af76420137441be373b2f37717568d59e"} Jul 08 16:44:12.519229 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:12.519180 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-8b44d767d-zv2mn" podStartSLOduration=1.9137213690000001 podStartE2EDuration="5.519166859s" totalImagesPullingTime="3.60544549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:44:12.518663741 +0000 UTC m=+587.066687495" watchObservedRunningTime="2026-07-08 16:44:12.519166859 +0000 UTC m=+587.067190594" Jul 08 16:44:25.514649 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:25.514610 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:44:25.702026 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:25.701988 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:44:25.891908 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:25.891875 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vsdvp_6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8/console-operator/1.log" Jul 08 16:44:25.892140 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:25.892123 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vsdvp_6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8/console-operator/1.log" Jul 08 16:44:41.058088 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:41.058037 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:44:42.492064 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:42.492029 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:44:52.919691 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:52.919616 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:44:53.022078 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:44:53.022028 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:46:37.498224 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:46:37.498153 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:46:37.578852 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:46:37.578822 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:46:37.679947 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:46:37.679914 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:47:32.492946 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:47:32.492847 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:48:12.676041 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:48:12.675964 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:48:12.758565 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:48:12.758535 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:48:12.822238 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:48:12.822208 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:48:32.758594 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:48:32.758549 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:48:32.973683 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:48:32.973654 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:48:44.799992 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:48:44.799956 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:48:44.899223 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:48:44.899180 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:49:25.915927 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:49:25.915829 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vsdvp_6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8/console-operator/1.log" Jul 08 16:49:25.917026 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:49:25.917000 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vsdvp_6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8/console-operator/1.log" Jul 08 16:50:08.089737 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:50:08.089695 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:50:11.852455 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:50:11.852422 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:51:22.286022 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:51:22.285979 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:51:29.231941 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:51:29.231881 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:51:35.524985 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:51:35.524947 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:51:46.943446 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:51:46.943411 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:52:48.332048 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:52:48.332016 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:52:53.667885 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:52:53.667832 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:52:53.803789 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:52:53.803761 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:54:25.939909 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:54:25.939866 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vsdvp_6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8/console-operator/1.log" Jul 08 16:54:25.945043 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:54:25.945018 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vsdvp_6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8/console-operator/1.log" Jul 08 16:54:53.963625 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:54:53.963590 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:54:59.001090 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:54:59.001056 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:54:59.128076 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:54:59.128036 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:56:39.241258 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:56:39.241224 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:56:44.325093 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:56:44.325063 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:56:44.747572 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:56:44.747540 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:57:04.373456 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:57:04.373377 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:58:54.634325 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:58:54.634291 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:58:59.697908 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:58:59.697866 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:58:59.887793 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:58:59.887760 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:59:25.972381 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:59:25.972354 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vsdvp_6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8/console-operator/1.log" Jul 08 16:59:25.973836 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:59:25.973814 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vsdvp_6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8/console-operator/1.log" Jul 08 16:59:30.751359 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:59:30.751297 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:59:36.128692 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:59:36.128658 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 16:59:36.227688 ip-10-0-141-103 kubenswrapper[2573]: I0708 16:59:36.227652 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 17:00:10.174328 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:10.174249 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 17:00:10.718871 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:10.718834 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 17:00:10.820098 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:10.820060 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 17:00:13.316906 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:13.316853 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-66hzl_b7fb2341-8281-4190-896d-c994c69fbc08/global-pull-secret-syncer/0.log" Jul 08 17:00:13.419032 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:13.419006 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" Jul 08 17:00:13.549242 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:13.549214 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-103.ec2.internal_b852df87ea15bc3486a84b15999fcc65/haproxy/0.log" Jul 08 17:00:16.408818 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:16.408788 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 17:00:16.472185 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:16.472154 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 17:00:16.867172 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:16.867144 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dbwk_52e67dfa-9497-4bd7-aadd-aa91672c561c/konnectivity-agent/0.log" limit=1024 Jul 08 17:00:17.717042 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:17.717010 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-vzlfv_38f0ff13-08e1-408a-b4c9-3526ab67f705/cluster-monitoring-operator/0.log" Jul 08 17:00:18.013370 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:18.013346 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cxv9s_f82a72a9-96c5-4586-8393-dd353ae1c120/node-exporter/0.log" Jul 08 17:00:18.046834 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:18.046812 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cxv9s_f82a72a9-96c5-4586-8393-dd353ae1c120/kube-rbac-proxy/0.log" Jul 08 17:00:18.084464 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:18.084439 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cxv9s_f82a72a9-96c5-4586-8393-dd353ae1c120/init-textfile/0.log" Jul 08 17:00:20.837468 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:20.837436 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vsdvp_6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8/console-operator/1.log" Jul 08 17:00:20.842863 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:20.842842 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vsdvp_6ea3bd01-82b9-4ebf-8293-c2dfd33a61c8/console-operator/2.log" Jul 08 17:00:21.417714 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:21.417687 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67f4548486-td9kf_f23b7e8b-da74-4c84-ab65-59014b0c0461/console/0.log" Jul 08 17:00:21.447334 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:21.447312 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-fntb2_e148bd1c-27d5-4651-9042-d7b72b1a95eb/download-server/0.log" Jul 08 17:00:21.954563 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:21.954540 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-h9ph9_9c5e1f75-e9f6-46e0-91b0-3d362290a384/volume-data-source-validator/0.log" Jul 08 17:00:22.406349 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.406315 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2"] Jul 08 17:00:22.415423 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.415398 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2" Jul 08 17:00:22.417614 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.417594 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-72rhc\"/\"kube-root-ca.crt\"" Jul 08 17:00:22.418289 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.418269 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-72rhc\"/\"openshift-service-ca.crt\"" Jul 08 17:00:22.418796 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.418776 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-72rhc\"/\"default-dockercfg-rrf2d\"" Jul 08 17:00:22.420627 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.420575 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2"] Jul 08 17:00:22.496640 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.496606 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rpz8\" (UniqueName: \"kubernetes.io/projected/538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6-kube-api-access-7rpz8\") pod \"perf-node-gather-daemonset-wdxr2\" (UID: \"538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6\") " pod="openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2" Jul 08 17:00:22.496797 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.496647 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6-sys\") pod \"perf-node-gather-daemonset-wdxr2\" (UID: \"538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6\") " pod="openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2" Jul 08 17:00:22.496797 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.496669 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6-proc\") pod \"perf-node-gather-daemonset-wdxr2\" (UID: \"538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6\") " pod="openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2" Jul 08 17:00:22.496797 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.496687 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6-lib-modules\") pod \"perf-node-gather-daemonset-wdxr2\" (UID: \"538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6\") " pod="openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2" Jul 08 17:00:22.496797 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.496773 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6-podres\") pod \"perf-node-gather-daemonset-wdxr2\" (UID: \"538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6\") " pod="openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2" Jul 08 17:00:22.597143 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.597112 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6-podres\") pod \"perf-node-gather-daemonset-wdxr2\" (UID: \"538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6\") " pod="openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2" Jul 08 17:00:22.597308 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.597174 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rpz8\" (UniqueName: \"kubernetes.io/projected/538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6-kube-api-access-7rpz8\") pod \"perf-node-gather-daemonset-wdxr2\" (UID: \"538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6\") " pod="openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2" Jul 08 17:00:22.597308 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.597200 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6-sys\") pod \"perf-node-gather-daemonset-wdxr2\" (UID: \"538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6\") " pod="openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2" Jul 08 17:00:22.597308 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.597221 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6-proc\") pod \"perf-node-gather-daemonset-wdxr2\" (UID: \"538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6\") " pod="openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2" Jul 08 17:00:22.597308 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.597235 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6-lib-modules\") pod \"perf-node-gather-daemonset-wdxr2\" (UID: \"538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6\") " pod="openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2" Jul 08 17:00:22.597308 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.597268 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6-podres\") pod \"perf-node-gather-daemonset-wdxr2\" (UID: \"538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6\") " pod="openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2" Jul 08 17:00:22.597308 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.597289 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6-sys\") pod \"perf-node-gather-daemonset-wdxr2\" (UID: \"538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6\") " pod="openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2" Jul 08 17:00:22.597308 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.597301 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6-proc\") pod \"perf-node-gather-daemonset-wdxr2\" (UID: \"538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6\") " pod="openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2" Jul 08 17:00:22.597622 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.597379 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6-lib-modules\") pod \"perf-node-gather-daemonset-wdxr2\" (UID: \"538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6\") " pod="openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2" Jul 08 17:00:22.605352 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.605332 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rpz8\" (UniqueName: \"kubernetes.io/projected/538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6-kube-api-access-7rpz8\") pod \"perf-node-gather-daemonset-wdxr2\" (UID: \"538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6\") " pod="openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2" Jul 08 17:00:22.726317 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.726229 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2" Jul 08 17:00:22.850405 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.850361 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2"] Jul 08 17:00:22.853937 ip-10-0-141-103 kubenswrapper[2573]: W0708 17:00:22.853910 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod538d2ee7_e3af_45b8_8c9d_3fd4bb39d7c6.slice/crio-e7becb459b80605996091557bec98e70e77b63941c5d99454cc439539438e328 WatchSource:0}: Error finding container e7becb459b80605996091557bec98e70e77b63941c5d99454cc439539438e328: Status 404 returned error can't find the container with id e7becb459b80605996091557bec98e70e77b63941c5d99454cc439539438e328 Jul 08 17:00:22.896794 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.896748 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-48pb8_ab27cf16-00d0-4e83-a2a8-2fd78083cfe4/dns/0.log" Jul 08 17:00:22.923259 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:22.923225 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-48pb8_ab27cf16-00d0-4e83-a2a8-2fd78083cfe4/kube-rbac-proxy/0.log" Jul 08 17:00:23.107563 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:23.107536 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r88w9_2af41183-3d27-438a-a4b4-d1cea1df572a/dns-node-resolver/0.log" Jul 08 17:00:23.552426 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:23.552390 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2" event={"ID":"538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6","Type":"ContainerStarted","Data":"34074714ee8ad6933a0cb296abeaacdcc9b957cea7ab6327005f05dcaf8c67e2"} Jul 08 17:00:23.552603 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:23.552437 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2" event={"ID":"538d2ee7-e3af-45b8-8c9d-3fd4bb39d7c6","Type":"ContainerStarted","Data":"e7becb459b80605996091557bec98e70e77b63941c5d99454cc439539438e328"} Jul 08 17:00:23.552603 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:23.552467 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2" Jul 08 17:00:23.569126 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:23.568955 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2" podStartSLOduration=1.568937239 podStartE2EDuration="1.568937239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:00:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:00:23.56882025 +0000 UTC m=+1558.116843986" watchObservedRunningTime="2026-07-08 17:00:23.568937239 +0000 UTC m=+1558.116960977" Jul 08 17:00:23.601114 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:23.601089 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6flz5_781fe4a6-3af0-440e-959e-5a1201135619/node-ca/0.log" Jul 08 17:00:24.479353 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:24.479327 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55c8746687-c4jzc_d742f12e-0c93-4210-8ec1-88167c556ae5/router/0.log" Jul 08 17:00:24.878087 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:24.878057 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8xwcl_b165419b-99f2-46fc-944a-588f787fbda8/serve-healthcheck-canary/0.log" Jul 08 17:00:25.295140 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:25.295063 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-kbftc_1816c65a-cbd4-4aa1-a834-577c758bd2b8/insights-operator/0.log" Jul 08 17:00:25.295281 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:25.295179 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-kbftc_1816c65a-cbd4-4aa1-a834-577c758bd2b8/insights-operator/1.log" Jul 08 17:00:25.324703 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:25.324673 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4wc4j_939df774-67a9-4217-9883-ee901b722a54/kube-rbac-proxy/0.log" Jul 08 17:00:25.349282 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:25.349252 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4wc4j_939df774-67a9-4217-9883-ee901b722a54/exporter/0.log" Jul 08 17:00:25.376393 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:25.376342 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4wc4j_939df774-67a9-4217-9883-ee901b722a54/extractor/0.log" Jul 08 17:00:27.690605 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:27.690573 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-687b7449bc-vhcrl_baf10fe6-0bbb-468c-8afa-52ea9438aa6a/manager/0.log" Jul 08 17:00:27.735630 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:27.735596 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-8l7vd_2df8139e-47ad-4228-a379-ae911a621245/server/0.log" Jul 08 17:00:28.011597 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:28.011509 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-custom-8b44d767d-zv2mn_9e0177c5-d243-4c80-807f-58f20d00e2e7/seaweedfs-tls-custom/0.log" Jul 08 17:00:29.566595 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:29.566565 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-72rhc/perf-node-gather-daemonset-wdxr2" Jul 08 17:00:32.717223 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:32.717115 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-6rgk2_f22fd4ec-e3b0-4718-851d-629899796803/kube-storage-version-migrator-operator/1.log" Jul 08 17:00:32.718097 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:32.718080 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-6rgk2_f22fd4ec-e3b0-4718-851d-629899796803/kube-storage-version-migrator-operator/0.log" Jul 08 17:00:33.764659 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:33.764588 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-55np5_967f78fb-318f-47a8-95a5-776c45f8eb8a/kube-multus/0.log" Jul 08 17:00:33.793431 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:33.793403 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhvqv_a7eac5be-6022-406e-8a03-f6e22b5a1f20/kube-multus-additional-cni-plugins/0.log" Jul 08 17:00:33.818731 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:33.818706 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhvqv_a7eac5be-6022-406e-8a03-f6e22b5a1f20/egress-router-binary-copy/0.log" Jul 08 17:00:33.845661 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:33.845637 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhvqv_a7eac5be-6022-406e-8a03-f6e22b5a1f20/cni-plugins/0.log" Jul 08 17:00:33.868623 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:33.868600 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhvqv_a7eac5be-6022-406e-8a03-f6e22b5a1f20/bond-cni-plugin/0.log" Jul 08 17:00:33.890514 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:33.890493 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhvqv_a7eac5be-6022-406e-8a03-f6e22b5a1f20/routeoverride-cni/0.log" Jul 08 17:00:33.913507 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:33.913471 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhvqv_a7eac5be-6022-406e-8a03-f6e22b5a1f20/whereabouts-cni-bincopy/0.log" Jul 08 17:00:33.940597 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:33.940574 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fhvqv_a7eac5be-6022-406e-8a03-f6e22b5a1f20/whereabouts-cni/0.log" Jul 08 17:00:34.443912 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:34.443873 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bgxr6_ab6fc392-dce6-4bfc-aa9d-2f99fd378c53/network-metrics-daemon/0.log" Jul 08 17:00:34.467368 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:34.467344 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bgxr6_ab6fc392-dce6-4bfc-aa9d-2f99fd378c53/kube-rbac-proxy/0.log" Jul 08 17:00:35.969632 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:35.969607 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmpkp_cfebfd20-7c02-468d-8ce6-3cae5e30391a/ovn-controller/0.log" Jul 08 17:00:35.995390 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:35.995366 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmpkp_cfebfd20-7c02-468d-8ce6-3cae5e30391a/ovn-acl-logging/0.log" Jul 08 17:00:36.023046 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:36.023005 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmpkp_cfebfd20-7c02-468d-8ce6-3cae5e30391a/kube-rbac-proxy-node/0.log" Jul 08 17:00:36.050552 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:36.050533 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmpkp_cfebfd20-7c02-468d-8ce6-3cae5e30391a/kube-rbac-proxy-ovn-metrics/0.log" Jul 08 17:00:36.072974 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:36.072956 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmpkp_cfebfd20-7c02-468d-8ce6-3cae5e30391a/northd/0.log" Jul 08 17:00:36.106778 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:36.106760 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmpkp_cfebfd20-7c02-468d-8ce6-3cae5e30391a/nbdb/0.log" Jul 08 17:00:36.141087 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:36.141071 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmpkp_cfebfd20-7c02-468d-8ce6-3cae5e30391a/sbdb/0.log" Jul 08 17:00:36.185585 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:36.185563 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xmpkp_cfebfd20-7c02-468d-8ce6-3cae5e30391a/ovnkube-controller/0.log" Jul 08 17:00:37.298820 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:37.298790 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-68grn_0cfa0994-c414-44f2-b02f-27b70e765bc0/network-check-target-container/0.log" Jul 08 17:00:38.335225 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:38.335201 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-8tmjf_04d6fce6-7129-47b4-80d3-72185a0a4bc9/iptables-alerter/0.log" Jul 08 17:00:39.055434 ip-10-0-141-103 kubenswrapper[2573]: I0708 17:00:39.055407 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-zv2j8_6d610c40-b3e2-43e0-9c3e-cb0913dd90a6/tuned/0.log"