Jul 23 14:10:04.342525 ip-10-0-138-123 systemd[1]: Starting Kubernetes Kubelet... Jul 23 14:10:04.667625 ip-10-0-138-123 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 14:10:04.667625 ip-10-0-138-123 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 23 14:10:04.667625 ip-10-0-138-123 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 14:10:04.667625 ip-10-0-138-123 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 23 14:10:04.667625 ip-10-0-138-123 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 14:10:04.668329 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.668221 2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 23 14:10:04.672322 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672305 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 14:10:04.672322 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672321 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 14:10:04.672322 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672325 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 14:10:04.672409 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672328 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 14:10:04.672409 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672332 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 14:10:04.672409 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672335 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 14:10:04.672409 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672338 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 14:10:04.672409 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672341 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 14:10:04.672409 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672344 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 14:10:04.672409 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672346 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 14:10:04.672409 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672353 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 14:10:04.672409 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672356 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 14:10:04.672409 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672358 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 14:10:04.672409 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672361 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 14:10:04.672409 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672364 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 14:10:04.672409 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672366 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 14:10:04.672409 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672369 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 14:10:04.672409 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672372 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 14:10:04.672409 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672375 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 14:10:04.672409 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672378 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 14:10:04.672409 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672381 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 14:10:04.672409 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672384 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 14:10:04.672409 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672386 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 14:10:04.672867 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672389 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 14:10:04.672867 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672392 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 14:10:04.672867 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672394 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 14:10:04.672867 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672397 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 14:10:04.672867 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672399 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 14:10:04.672867 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672401 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 14:10:04.672867 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672406 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 14:10:04.672867 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672409 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 14:10:04.672867 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672412 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 23 14:10:04.672867 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672415 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 14:10:04.672867 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672417 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 14:10:04.672867 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672420 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 14:10:04.672867 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672423 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 14:10:04.672867 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672426 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 14:10:04.672867 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672430 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 14:10:04.672867 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672433 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 14:10:04.672867 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672436 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 14:10:04.672867 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672438 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 14:10:04.672867 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672441 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 14:10:04.673386 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672443 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 14:10:04.673386 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672446 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 14:10:04.673386 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672448 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 14:10:04.673386 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672451 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 14:10:04.673386 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672453 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 14:10:04.673386 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672456 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 14:10:04.673386 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672458 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 14:10:04.673386 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672461 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 14:10:04.673386 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672464 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 14:10:04.673386 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672467 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 14:10:04.673386 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672470 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 14:10:04.673386 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672473 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 14:10:04.673386 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672475 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 14:10:04.673386 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672478 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 14:10:04.673386 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672482 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 14:10:04.673386 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672485 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 14:10:04.673386 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672488 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 14:10:04.673386 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672490 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 14:10:04.673386 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672493 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 14:10:04.673386 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672495 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 14:10:04.674192 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672498 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 14:10:04.674192 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672500 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 14:10:04.674192 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672503 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 14:10:04.674192 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672505 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 14:10:04.674192 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672508 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 14:10:04.674192 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672510 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 14:10:04.674192 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672512 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 14:10:04.674192 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672515 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 14:10:04.674192 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672518 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 14:10:04.674192 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672520 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 14:10:04.674192 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672523 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 14:10:04.674192 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672525 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 14:10:04.674192 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672527 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 14:10:04.674192 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672530 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 14:10:04.674192 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672532 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 14:10:04.674192 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672535 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 14:10:04.674192 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672538 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 14:10:04.674192 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672540 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 14:10:04.674192 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672543 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 14:10:04.674192 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672548 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 14:10:04.674925 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672551 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 14:10:04.674925 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672554 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 14:10:04.674925 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672558 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 14:10:04.674925 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672561 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 14:10:04.674925 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672564 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 14:10:04.674925 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672566 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 14:10:04.674925 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672570 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 14:10:04.674925 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672572 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 14:10:04.674925 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672575 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 14:10:04.674925 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672578 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 14:10:04.674925 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672581 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 14:10:04.674925 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672583 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 14:10:04.674925 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672586 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 14:10:04.674925 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672588 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 14:10:04.674925 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672590 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 14:10:04.674925 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672593 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 14:10:04.674925 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.672595 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 14:10:04.675401 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675196 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 14:10:04.675401 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675210 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 14:10:04.675401 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675214 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 14:10:04.675401 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675217 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 14:10:04.675401 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675220 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 14:10:04.675401 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675223 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 14:10:04.675401 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675226 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 14:10:04.675401 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675229 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 14:10:04.675401 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675251 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 14:10:04.675401 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675255 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 14:10:04.675401 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675258 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 14:10:04.675401 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675261 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 14:10:04.675401 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675263 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 14:10:04.675401 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675266 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 14:10:04.675401 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675269 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 14:10:04.675401 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675271 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 14:10:04.675401 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675274 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 14:10:04.675401 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675277 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 14:10:04.675401 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675281 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 14:10:04.675401 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675283 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 14:10:04.675907 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675286 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 14:10:04.675907 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675288 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 14:10:04.675907 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675291 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 14:10:04.675907 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675294 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 14:10:04.675907 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675296 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 14:10:04.675907 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675299 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 14:10:04.675907 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675301 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 14:10:04.675907 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675304 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 14:10:04.675907 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675306 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 14:10:04.675907 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675308 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 14:10:04.675907 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675311 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 14:10:04.675907 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675314 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 14:10:04.675907 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675317 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 14:10:04.675907 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675320 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 14:10:04.675907 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675324 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 14:10:04.675907 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675327 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 14:10:04.675907 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675340 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 14:10:04.675907 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675344 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 14:10:04.675907 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675346 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 14:10:04.675907 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675349 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 14:10:04.676418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675351 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 14:10:04.676418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675354 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 23 14:10:04.676418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675356 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 14:10:04.676418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675359 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 14:10:04.676418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675361 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 14:10:04.676418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675364 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 14:10:04.676418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675367 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 14:10:04.676418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675369 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 14:10:04.676418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675372 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 14:10:04.676418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675374 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 14:10:04.676418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675378 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 14:10:04.676418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675380 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 14:10:04.676418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675383 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 14:10:04.676418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675385 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 14:10:04.676418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675388 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 14:10:04.676418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675393 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 14:10:04.676418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675397 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 14:10:04.676418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675400 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 14:10:04.676418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675403 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 14:10:04.676418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675405 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 14:10:04.676983 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675408 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 14:10:04.676983 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675411 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 14:10:04.676983 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675413 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 14:10:04.676983 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675416 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 14:10:04.676983 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675418 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 14:10:04.676983 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675422 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 14:10:04.676983 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675426 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 14:10:04.676983 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675428 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 14:10:04.676983 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675431 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 14:10:04.676983 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675433 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 14:10:04.676983 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675436 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 14:10:04.676983 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675439 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 14:10:04.676983 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675443 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 14:10:04.676983 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675445 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 14:10:04.676983 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675448 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 14:10:04.676983 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675450 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 14:10:04.676983 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675453 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 14:10:04.676983 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675456 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 14:10:04.676983 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675458 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 14:10:04.677457 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675461 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 14:10:04.677457 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675463 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 14:10:04.677457 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675466 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 14:10:04.677457 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675468 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 14:10:04.677457 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675471 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 14:10:04.677457 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675475 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 14:10:04.677457 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675479 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 14:10:04.677457 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675482 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 14:10:04.677457 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675485 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 14:10:04.677457 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675487 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 14:10:04.677457 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675490 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 14:10:04.677457 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675492 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 14:10:04.677457 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675495 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 14:10:04.677457 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675497 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 14:10:04.677457 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675499 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 14:10:04.677457 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675502 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 14:10:04.677457 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675504 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 14:10:04.677457 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675507 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 14:10:04.677457 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675510 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 14:10:04.677950 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675513 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 14:10:04.677950 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675896 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 14:10:04.677950 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675903 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 14:10:04.677950 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675907 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 14:10:04.677950 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675910 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 14:10:04.677950 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675913 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 14:10:04.677950 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675916 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 14:10:04.677950 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675919 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 14:10:04.677950 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675921 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 14:10:04.677950 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675924 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 14:10:04.677950 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675927 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 14:10:04.677950 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675929 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 14:10:04.677950 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675932 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 14:10:04.677950 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675936 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 14:10:04.677950 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675939 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 14:10:04.677950 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675943 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 14:10:04.677950 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675945 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 14:10:04.677950 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675949 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 14:10:04.677950 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675951 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 14:10:04.678420 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675954 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 14:10:04.678420 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675957 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 14:10:04.678420 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675960 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 14:10:04.678420 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675962 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 14:10:04.678420 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675965 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 14:10:04.678420 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675968 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 23 14:10:04.678420 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675970 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 14:10:04.678420 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675973 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 14:10:04.678420 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675975 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 14:10:04.678420 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675978 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 14:10:04.678420 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675980 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 14:10:04.678420 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675983 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 14:10:04.678420 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675986 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 14:10:04.678420 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675989 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 14:10:04.678420 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675991 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 14:10:04.678420 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675994 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 14:10:04.678420 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675996 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 14:10:04.678420 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.675999 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 14:10:04.678420 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676001 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 14:10:04.678420 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676004 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 14:10:04.678898 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676006 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 14:10:04.678898 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676009 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 14:10:04.678898 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676011 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 14:10:04.678898 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676013 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 14:10:04.678898 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676016 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 14:10:04.678898 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676018 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 14:10:04.678898 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676021 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 14:10:04.678898 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676024 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 14:10:04.678898 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676026 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 14:10:04.678898 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676028 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 14:10:04.678898 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676031 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 14:10:04.678898 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676035 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 14:10:04.678898 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676039 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 14:10:04.678898 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676042 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 14:10:04.678898 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676044 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 14:10:04.678898 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676047 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 14:10:04.678898 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676049 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 14:10:04.678898 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676051 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 14:10:04.678898 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676054 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 14:10:04.678898 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676057 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 14:10:04.679436 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676059 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 14:10:04.679436 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676061 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 14:10:04.679436 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676064 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 14:10:04.679436 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676067 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 14:10:04.679436 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676069 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 14:10:04.679436 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676072 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 14:10:04.679436 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676074 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 14:10:04.679436 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676077 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 14:10:04.679436 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676079 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 14:10:04.679436 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676082 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 14:10:04.679436 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676084 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 14:10:04.679436 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676086 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 14:10:04.679436 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676089 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 14:10:04.679436 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676091 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 14:10:04.679436 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676094 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 14:10:04.679436 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676096 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 14:10:04.679436 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676098 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 14:10:04.679436 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676101 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 14:10:04.679436 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676103 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 14:10:04.679436 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676106 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 14:10:04.679906 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676108 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 14:10:04.679906 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676111 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 14:10:04.679906 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676114 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 14:10:04.679906 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676117 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 14:10:04.679906 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676122 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 14:10:04.679906 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676125 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 14:10:04.679906 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676127 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 14:10:04.679906 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676130 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 14:10:04.679906 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676132 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 14:10:04.679906 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676135 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 14:10:04.679906 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676137 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 14:10:04.679906 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676139 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 14:10:04.679906 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676142 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 14:10:04.679906 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676146 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 14:10:04.679906 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676149 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 14:10:04.679906 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676152 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 14:10:04.679906 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676155 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 14:10:04.679906 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676158 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 14:10:04.679906 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676160 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676163 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676165 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676246 2583 flags.go:64] FLAG: --address="0.0.0.0" Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676256 2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676264 2583 flags.go:64] FLAG: --anonymous-auth="true" Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676268 2583 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676272 2583 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676276 2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676280 2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676285 2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676288 2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676291 2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676295 2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676298 2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676301 2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676304 2583 flags.go:64] FLAG: --cgroup-root="" Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676306 2583 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676311 2583 flags.go:64] FLAG: --client-ca-file="" Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676315 2583 flags.go:64] FLAG: --cloud-provider="external" Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676318 2583 flags.go:64] FLAG: --cluster-dns="[]" Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676322 2583 flags.go:64] FLAG: --cluster-domain="" Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676325 2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676328 2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 23 14:10:04.680382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676331 2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676334 2583 flags.go:64] FLAG: --container-log-max-files="5" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676341 2583 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676344 2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676347 2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676350 2583 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676354 2583 flags.go:64] FLAG: --contention-profiling="false" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676356 2583 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676359 2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676362 2583 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676365 2583 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676369 2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676372 2583 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676375 2583 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676378 2583 flags.go:64] FLAG: --enable-load-reader="false" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676380 2583 flags.go:64] FLAG: --enable-server="true" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676384 2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676389 2583 flags.go:64] FLAG: --event-burst="100" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676392 2583 flags.go:64] FLAG: --event-qps="50" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676395 2583 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676398 2583 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676401 2583 flags.go:64] FLAG: --eviction-hard="" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676404 2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676407 2583 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676410 2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 23 14:10:04.680993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676413 2583 flags.go:64] FLAG: --eviction-soft="" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676419 2583 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676422 2583 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676427 2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676430 2583 flags.go:64] FLAG: --experimental-mounter-path="" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676433 2583 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676435 2583 flags.go:64] FLAG: --fail-swap-on="true" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676438 2583 flags.go:64] FLAG: --feature-gates="" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676442 2583 flags.go:64] FLAG: --file-check-frequency="20s" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676445 2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676448 2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676451 2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676454 2583 flags.go:64] FLAG: --healthz-port="10248" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676457 2583 flags.go:64] FLAG: --help="false" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676459 2583 flags.go:64] FLAG: --hostname-override="ip-10-0-138-123.ec2.internal" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676463 2583 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676466 2583 flags.go:64] FLAG: --http-check-frequency="20s" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676469 2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676472 2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676475 2583 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676478 2583 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676481 2583 flags.go:64] FLAG: --image-service-endpoint="" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676484 2583 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 23 14:10:04.681586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676487 2583 flags.go:64] FLAG: --kube-api-burst="100" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676490 2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676493 2583 flags.go:64] FLAG: --kube-api-qps="50" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676496 2583 flags.go:64] FLAG: --kube-reserved="" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676498 2583 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676501 2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676504 2583 flags.go:64] FLAG: --kubelet-cgroups="" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676507 2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676510 2583 flags.go:64] FLAG: --lock-file="" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676513 2583 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676517 2583 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676520 2583 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676526 2583 flags.go:64] FLAG: --log-json-split-stream="false" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676529 2583 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676532 2583 flags.go:64] FLAG: --log-text-split-stream="false" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676535 2583 flags.go:64] FLAG: --logging-format="text" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676537 2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676540 2583 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676543 2583 flags.go:64] FLAG: --manifest-url="" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676546 2583 flags.go:64] FLAG: --manifest-url-header="" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676550 2583 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676553 2583 flags.go:64] FLAG: --max-open-files="1000000" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676557 2583 flags.go:64] FLAG: --max-pods="110" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676562 2583 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676564 2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 23 14:10:04.682153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676567 2583 flags.go:64] FLAG: --memory-manager-policy="None" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676570 2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676573 2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676576 2583 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676579 2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676586 2583 flags.go:64] FLAG: --node-status-max-images="50" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676589 2583 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676592 2583 flags.go:64] FLAG: --oom-score-adj="-999" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676595 2583 flags.go:64] FLAG: --pod-cidr="" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676597 2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676603 2583 flags.go:64] FLAG: --pod-manifest-path="" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676606 2583 flags.go:64] FLAG: --pod-max-pids="-1" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676609 2583 flags.go:64] FLAG: --pods-per-core="0" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676612 2583 flags.go:64] FLAG: --port="10250" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676615 2583 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676618 2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-080c704c67f88711e" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676621 2583 flags.go:64] FLAG: --qos-reserved="" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676624 2583 flags.go:64] FLAG: --read-only-port="10255" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676628 2583 flags.go:64] FLAG: --register-node="true" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676631 2583 flags.go:64] FLAG: --register-with-taints="" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676635 2583 flags.go:64] FLAG: --registry-burst="10" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676638 2583 flags.go:64] FLAG: --registry-qps="5" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676641 2583 flags.go:64] FLAG: --reserved-cpus="" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676644 2583 flags.go:64] FLAG: --reserved-memory="" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676647 2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 23 14:10:04.682848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676650 2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676653 2583 flags.go:64] FLAG: --rotate-certificates="false" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676656 2583 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676659 2583 flags.go:64] FLAG: --runonce="false" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676661 2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676666 2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676669 2583 flags.go:64] FLAG: --seccomp-default="false" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676671 2583 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676674 2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676677 2583 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676680 2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676683 2583 flags.go:64] FLAG: --storage-driver-password="root" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676686 2583 flags.go:64] FLAG: --storage-driver-secure="false" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676689 2583 flags.go:64] FLAG: --storage-driver-table="stats" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676691 2583 flags.go:64] FLAG: --storage-driver-user="root" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676694 2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676697 2583 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676700 2583 flags.go:64] FLAG: --system-cgroups="" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676703 2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676708 2583 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676711 2583 flags.go:64] FLAG: --tls-cert-file="" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676713 2583 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676717 2583 flags.go:64] FLAG: --tls-min-version="" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676720 2583 flags.go:64] FLAG: --tls-private-key-file="" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676722 2583 flags.go:64] FLAG: --topology-manager-policy="none" Jul 23 14:10:04.683493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676727 2583 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 23 14:10:04.684088 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676729 2583 flags.go:64] FLAG: --topology-manager-scope="container" Jul 23 14:10:04.684088 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676732 2583 flags.go:64] FLAG: --v="2" Jul 23 14:10:04.684088 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676736 2583 flags.go:64] FLAG: --version="false" Jul 23 14:10:04.684088 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676740 2583 flags.go:64] FLAG: --vmodule="" Jul 23 14:10:04.684088 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676745 2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 23 14:10:04.684088 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.676748 2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 23 14:10:04.684088 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676861 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 14:10:04.684088 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676864 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 14:10:04.684088 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676867 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 14:10:04.684088 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676870 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 14:10:04.684088 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676874 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 14:10:04.684088 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676879 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 14:10:04.684088 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676883 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 14:10:04.684088 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676886 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 14:10:04.684088 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676889 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 14:10:04.684088 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676892 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 14:10:04.684088 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676895 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 14:10:04.684088 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676898 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 14:10:04.684088 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676901 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 14:10:04.684088 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676903 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 14:10:04.684088 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676906 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 14:10:04.684636 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676908 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 14:10:04.684636 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676911 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 14:10:04.684636 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676914 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 14:10:04.684636 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676916 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 14:10:04.684636 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676920 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 14:10:04.684636 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676924 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 14:10:04.684636 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676927 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 14:10:04.684636 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676930 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 14:10:04.684636 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676933 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 14:10:04.684636 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676935 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 14:10:04.684636 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676939 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 14:10:04.684636 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676942 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 14:10:04.684636 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676945 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 14:10:04.684636 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676947 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 14:10:04.684636 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676950 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 14:10:04.684636 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676953 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 14:10:04.684636 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676955 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 14:10:04.684636 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676958 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 14:10:04.684636 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676960 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 14:10:04.685101 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676963 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 14:10:04.685101 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676966 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 14:10:04.685101 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676968 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 14:10:04.685101 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676972 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 14:10:04.685101 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676975 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 14:10:04.685101 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676977 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 14:10:04.685101 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676980 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 14:10:04.685101 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676983 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 14:10:04.685101 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676986 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 14:10:04.685101 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676989 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 14:10:04.685101 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676991 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 14:10:04.685101 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676995 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 14:10:04.685101 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.676997 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 14:10:04.685101 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677000 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 14:10:04.685101 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677003 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 14:10:04.685101 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677005 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 14:10:04.685101 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677008 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 14:10:04.685101 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677011 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 14:10:04.685101 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677013 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 14:10:04.685101 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677016 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 14:10:04.685591 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677018 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 14:10:04.685591 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677021 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 14:10:04.685591 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677024 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 14:10:04.685591 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677027 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 14:10:04.685591 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677030 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 14:10:04.685591 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677033 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 14:10:04.685591 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677035 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 14:10:04.685591 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677038 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 14:10:04.685591 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677040 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 23 14:10:04.685591 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677044 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 14:10:04.685591 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677046 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 14:10:04.685591 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677049 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 14:10:04.685591 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677051 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 14:10:04.685591 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677054 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 14:10:04.685591 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677057 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 14:10:04.685591 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677061 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 14:10:04.685591 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677063 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 14:10:04.685591 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677066 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 14:10:04.685591 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677068 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 14:10:04.685591 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677071 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 14:10:04.686075 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677074 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 14:10:04.686075 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677077 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 14:10:04.686075 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677080 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 14:10:04.686075 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677083 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 14:10:04.686075 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677086 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 14:10:04.686075 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677088 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 14:10:04.686075 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677091 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 14:10:04.686075 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677094 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 14:10:04.686075 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677096 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 14:10:04.686075 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677098 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 14:10:04.686075 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677101 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 14:10:04.686075 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677103 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 14:10:04.686075 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677106 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 14:10:04.686075 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677108 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 14:10:04.686075 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677111 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 14:10:04.686075 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677115 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 14:10:04.686075 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677117 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 14:10:04.686075 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677120 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 14:10:04.686075 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677123 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 14:10:04.686555 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677125 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 14:10:04.686555 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677128 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 14:10:04.686555 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677131 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 14:10:04.686555 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677134 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 14:10:04.686555 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677137 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 14:10:04.686555 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.677139 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 14:10:04.686555 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.677657 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 14:10:04.686555 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.684300 2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 23 14:10:04.686555 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.684322 2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 23 14:10:04.686555 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.684342 2583 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 23 14:10:04.686555 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.684352 2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 23 14:10:04.686555 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684407 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 14:10:04.686555 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684413 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 14:10:04.686555 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684417 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 14:10:04.686555 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684420 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 14:10:04.686920 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684423 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 14:10:04.686920 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684426 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 14:10:04.686920 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684429 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 14:10:04.686920 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684431 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 14:10:04.686920 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684434 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 14:10:04.686920 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684437 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 14:10:04.686920 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684440 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 14:10:04.686920 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684443 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 14:10:04.686920 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684445 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 14:10:04.686920 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684448 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 14:10:04.686920 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684450 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 14:10:04.686920 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684453 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 14:10:04.686920 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684456 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 14:10:04.686920 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684459 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 14:10:04.686920 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684461 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 14:10:04.686920 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684464 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 14:10:04.686920 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684466 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 14:10:04.686920 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684469 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 14:10:04.686920 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684471 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 14:10:04.686920 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684474 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 14:10:04.687418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684476 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 14:10:04.687418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684479 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 14:10:04.687418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684481 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 14:10:04.687418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684485 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 14:10:04.687418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684489 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 14:10:04.687418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684496 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 14:10:04.687418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684499 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 14:10:04.687418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684502 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 14:10:04.687418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684504 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 14:10:04.687418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684507 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 14:10:04.687418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684509 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 14:10:04.687418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684512 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 14:10:04.687418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684514 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 14:10:04.687418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684517 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 14:10:04.687418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684519 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 14:10:04.687418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684522 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 14:10:04.687418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684524 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 14:10:04.687418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684527 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 14:10:04.687418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684529 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 14:10:04.687418 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684532 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 14:10:04.687897 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684535 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 14:10:04.687897 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684537 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 14:10:04.687897 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684540 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 14:10:04.687897 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684543 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 14:10:04.687897 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684546 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 14:10:04.687897 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684548 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 14:10:04.687897 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684552 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 14:10:04.687897 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684556 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 14:10:04.687897 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684559 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 14:10:04.687897 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684561 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 14:10:04.687897 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684563 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 14:10:04.687897 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684566 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 14:10:04.687897 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684568 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 14:10:04.687897 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684571 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 14:10:04.687897 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684573 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 14:10:04.687897 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684576 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 23 14:10:04.687897 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684578 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 14:10:04.687897 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684582 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 14:10:04.687897 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684585 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 14:10:04.687897 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684588 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 14:10:04.688400 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684591 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 14:10:04.688400 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684593 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 14:10:04.688400 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684595 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 14:10:04.688400 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684598 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 14:10:04.688400 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684601 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 14:10:04.688400 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684603 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 14:10:04.688400 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684606 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 14:10:04.688400 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684608 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 14:10:04.688400 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684611 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 14:10:04.688400 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684613 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 14:10:04.688400 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684616 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 14:10:04.688400 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684618 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 14:10:04.688400 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684621 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 14:10:04.688400 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684623 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 14:10:04.688400 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684627 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 14:10:04.688400 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684629 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 14:10:04.688400 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684632 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 14:10:04.688400 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684634 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 14:10:04.688400 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684637 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 14:10:04.688845 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684640 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 14:10:04.688845 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684643 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 14:10:04.688845 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684645 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 14:10:04.688845 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684648 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 14:10:04.688845 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684651 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 14:10:04.688845 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684653 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 14:10:04.688845 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684656 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 14:10:04.688845 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684658 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 14:10:04.688845 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684661 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 14:10:04.688845 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684663 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 14:10:04.688845 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684668 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 14:10:04.688845 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684671 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 14:10:04.688845 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684674 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 14:10:04.688845 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684677 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 14:10:04.688845 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684680 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 14:10:04.688845 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684683 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 14:10:04.689244 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.684688 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 14:10:04.689244 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684798 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 14:10:04.689244 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684802 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 14:10:04.689244 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684805 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 14:10:04.689244 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684808 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 14:10:04.689244 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684811 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 14:10:04.689244 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684814 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 14:10:04.689244 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684817 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 14:10:04.689244 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684819 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 14:10:04.689244 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684822 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 14:10:04.689244 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684824 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 14:10:04.689244 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684827 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 14:10:04.689244 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684829 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 14:10:04.689244 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684832 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 23 14:10:04.689244 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684836 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 14:10:04.689608 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684839 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 14:10:04.689608 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684842 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 14:10:04.689608 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684844 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 14:10:04.689608 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684846 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 14:10:04.689608 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684849 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 14:10:04.689608 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684851 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 14:10:04.689608 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684854 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 14:10:04.689608 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684856 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 14:10:04.689608 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684859 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 14:10:04.689608 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684861 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 14:10:04.689608 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684864 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 14:10:04.689608 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684867 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 14:10:04.689608 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684870 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 14:10:04.689608 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684872 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 14:10:04.689608 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684875 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 14:10:04.689608 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684878 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 14:10:04.689608 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684881 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 14:10:04.689608 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684883 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 14:10:04.689608 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684886 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 14:10:04.689608 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684888 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 14:10:04.690086 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684891 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 14:10:04.690086 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684893 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 14:10:04.690086 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684896 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 14:10:04.690086 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684898 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 14:10:04.690086 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684901 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 14:10:04.690086 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684903 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 14:10:04.690086 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684905 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 14:10:04.690086 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684908 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 14:10:04.690086 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684910 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 14:10:04.690086 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684913 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 14:10:04.690086 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684915 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 14:10:04.690086 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684918 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 14:10:04.690086 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684920 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 14:10:04.690086 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684923 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 14:10:04.690086 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684925 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 14:10:04.690086 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684927 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 14:10:04.690086 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684930 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 14:10:04.690086 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684933 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 14:10:04.690086 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684935 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 14:10:04.690086 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684938 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 14:10:04.690571 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684942 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 14:10:04.690571 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684945 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 14:10:04.690571 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684948 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 14:10:04.690571 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684952 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 14:10:04.690571 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684955 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 14:10:04.690571 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684958 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 14:10:04.690571 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684961 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 14:10:04.690571 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684964 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 14:10:04.690571 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684967 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 14:10:04.690571 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684969 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 14:10:04.690571 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684972 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 14:10:04.690571 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684974 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 14:10:04.690571 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684977 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 14:10:04.690571 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684979 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 14:10:04.690571 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684982 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 14:10:04.690571 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684985 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 14:10:04.690571 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684988 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 14:10:04.690571 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684991 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 14:10:04.690571 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684994 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 14:10:04.691035 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684997 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 14:10:04.691035 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.684999 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 14:10:04.691035 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685001 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 14:10:04.691035 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685004 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 14:10:04.691035 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685006 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 14:10:04.691035 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685009 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 14:10:04.691035 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685012 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 14:10:04.691035 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685014 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 14:10:04.691035 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685016 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 14:10:04.691035 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685019 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 14:10:04.691035 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685021 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 14:10:04.691035 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685024 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 14:10:04.691035 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685026 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 14:10:04.691035 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685029 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 14:10:04.691035 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685031 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 14:10:04.691035 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685034 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 14:10:04.691035 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685036 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 14:10:04.691035 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685039 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 14:10:04.691035 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685042 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 14:10:04.691035 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685044 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 14:10:04.691558 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685047 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 14:10:04.691558 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685049 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 14:10:04.691558 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685052 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 14:10:04.691558 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685054 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 14:10:04.691558 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685057 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 14:10:04.691558 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:04.685059 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 14:10:04.691558 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.685065 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 14:10:04.691558 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.685171 2583 server.go:962] "Client rotation is on, will bootstrap in background" Jul 23 14:10:04.691558 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.687916 2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 23 14:10:04.691558 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.689089 2583 server.go:1019] "Starting client certificate rotation" Jul 23 14:10:04.691558 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.689187 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 14:10:04.691558 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.689216 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 14:10:04.691558 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.691158 2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 14:10:04.692514 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.692494 2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 14:10:04.698468 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.698453 2583 log.go:25] "Validated CRI v1 runtime API" Jul 23 14:10:04.700530 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.700514 2583 log.go:25] "Validated CRI v1 image API" Jul 23 14:10:04.701337 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.701311 2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 23 14:10:04.705747 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.705720 2583 fs.go:135] Filesystem UUIDs: map[4b8e460c-8d71-4098-8f38-5b2786cf34a8:/dev/nvme0n1p4 52b3881f-dc53-46b3-9816-f71e47b3e4e5:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 23 14:10:04.705824 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.705745 2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 23 14:10:04.711751 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.711641 2583 manager.go:216] Machine: {Timestamp:2026-07-23 14:10:04.711135758 +0000 UTC m=+0.270964097 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099963 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bc469855a082cb35a5126e314bbb9 SystemUUID:ec2bc469-855a-082c-b35a-5126e314bbb9 BootID:c5016b50-27e4-4493-8bd8-7e017859eabe Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:92:c3:89:62:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:92:c3:89:62:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:94:b7:cd:a2:ac Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 23 14:10:04.711751 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.711736 2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 23 14:10:04.711925 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.711838 2583 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 23 14:10:04.713574 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.713548 2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 23 14:10:04.713735 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.713577 2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-123.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 23 14:10:04.714733 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.714721 2583 topology_manager.go:138] "Creating topology manager with none policy" Jul 23 14:10:04.714798 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.714739 2583 container_manager_linux.go:309] "Creating device plugin manager" Jul 23 14:10:04.714798 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.714751 2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 14:10:04.715324 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.715309 2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 14:10:04.716575 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.716562 2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 23 14:10:04.717912 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.717894 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 14:10:04.720698 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.720684 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 23 14:10:04.720828 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.720817 2583 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 23 14:10:04.720883 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.720862 2583 kubelet.go:486] "Attempting to sync node with API server" Jul 23 14:10:04.720883 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.720877 2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 23 14:10:04.720965 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.720895 2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 23 14:10:04.720965 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.720909 2583 kubelet.go:398] "Adding apiserver pod source" Jul 23 14:10:04.720965 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.720922 2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 23 14:10:04.721319 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.721305 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 14:10:04.721391 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.721328 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 14:10:04.723122 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.723100 2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 23 14:10:04.724938 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.724925 2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 23 14:10:04.724996 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.724956 2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 23 14:10:04.726360 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.726348 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 23 14:10:04.726430 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.726364 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 23 14:10:04.726430 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.726370 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 23 14:10:04.726430 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.726376 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 23 14:10:04.726430 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.726385 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 23 14:10:04.726430 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.726391 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 23 14:10:04.726430 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.726399 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 23 14:10:04.726430 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.726404 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 23 14:10:04.726430 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.726410 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 23 14:10:04.726430 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.726416 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 23 14:10:04.726430 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.726424 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 23 14:10:04.726430 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.726429 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 23 14:10:04.727032 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.727024 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 23 14:10:04.727032 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.727032 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 23 14:10:04.730012 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.730001 2583 server.go:1268] "Started kubelet" Jul 23 14:10:04.730157 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.730105 2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 23 14:10:04.730314 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.730256 2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 23 14:10:04.730375 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.730325 2583 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 23 14:10:04.730919 ip-10-0-138-123 systemd[1]: Started Kubernetes Kubelet. Jul 23 14:10:04.731754 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.731739 2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 23 14:10:04.732518 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.732503 2583 server.go:310] "Adding debug handlers to kubelet server" Jul 23 14:10:04.732935 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.732898 2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-123.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 23 14:10:04.733177 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:04.733154 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-123.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 23 14:10:04.733420 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:04.733402 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 23 14:10:04.735496 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:04.735480 2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 23 14:10:04.738552 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.738538 2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 23 14:10:04.738619 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.738553 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 23 14:10:04.738676 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:04.738642 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-123.ec2.internal\" not found" Jul 23 14:10:04.739081 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.739043 2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 23 14:10:04.739081 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.739046 2583 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 23 14:10:04.739205 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.739106 2583 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 23 14:10:04.739270 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.739206 2583 reconstruct.go:97] "Volume reconstruction finished" Jul 23 14:10:04.739270 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.739216 2583 reconciler.go:29] "Reconciler: start to sync state" Jul 23 14:10:04.739374 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.739323 2583 factory.go:55] Registering systemd factory Jul 23 14:10:04.739374 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.739347 2583 factory.go:223] Registration of the systemd container factory successfully Jul 23 14:10:04.739556 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.739542 2583 factory.go:153] Registering CRI-O factory Jul 23 14:10:04.739627 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.739559 2583 factory.go:223] Registration of the crio container factory successfully Jul 23 14:10:04.739627 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.739610 2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 23 14:10:04.739709 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.739635 2583 factory.go:103] Registering Raw factory Jul 23 14:10:04.739709 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.739648 2583 manager.go:1196] Started watching for new ooms in manager Jul 23 14:10:04.740040 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.740023 2583 manager.go:349] Starting recovery of all containers Jul 23 14:10:04.741491 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:04.740660 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-123.ec2.internal.18c4f0849e6ee3d5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-123.ec2.internal,UID:ip-10-0-138-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-123.ec2.internal,},FirstTimestamp:2026-07-23 14:10:04.729975765 +0000 UTC m=+0.289804097,LastTimestamp:2026-07-23 14:10:04.729975765 +0000 UTC m=+0.289804097,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-123.ec2.internal,}" Jul 23 14:10:04.741677 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:04.741645 2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-123.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 23 14:10:04.741745 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:04.741723 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 23 14:10:04.751637 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.751618 2583 manager.go:354] Recovery completed Jul 23 14:10:04.756020 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.756008 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 14:10:04.757940 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.757919 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientMemory" Jul 23 14:10:04.758032 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.757961 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 14:10:04.758032 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.757974 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientPID" Jul 23 14:10:04.758426 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.758412 2583 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 23 14:10:04.758426 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.758425 2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 23 14:10:04.758534 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.758441 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 14:10:04.758534 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.758442 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 23 14:10:04.759046 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.759032 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientMemory" Jul 23 14:10:04.759095 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.759058 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 14:10:04.759095 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.759067 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientPID" Jul 23 14:10:04.760426 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:04.760336 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-123.ec2.internal.18c4f084a019a36c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-123.ec2.internal,UID:ip-10-0-138-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-123.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-123.ec2.internal,},FirstTimestamp:2026-07-23 14:10:04.757943148 +0000 UTC m=+0.317771488,LastTimestamp:2026-07-23 14:10:04.757943148 +0000 UTC m=+0.317771488,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-123.ec2.internal,}" Jul 23 14:10:04.760615 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.760602 2583 policy_none.go:49] "None policy: Start" Jul 23 14:10:04.760668 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.760619 2583 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 23 14:10:04.760668 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.760631 2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 23 14:10:04.762533 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.762521 2583 policy_none.go:47] "Start" Jul 23 14:10:04.769172 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:04.769003 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-123.ec2.internal.18c4f084a01a0255 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-123.ec2.internal,UID:ip-10-0-138-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-123.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-123.ec2.internal,},FirstTimestamp:2026-07-23 14:10:04.757967445 +0000 UTC m=+0.317795781,LastTimestamp:2026-07-23 14:10:04.757967445 +0000 UTC m=+0.317795781,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-123.ec2.internal,}" Jul 23 14:10:04.781286 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:04.781204 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-123.ec2.internal.18c4f084a01a2c54 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-123.ec2.internal,UID:ip-10-0-138-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-123.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-123.ec2.internal,},FirstTimestamp:2026-07-23 14:10:04.757978196 +0000 UTC m=+0.317806529,LastTimestamp:2026-07-23 14:10:04.757978196 +0000 UTC m=+0.317806529,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-123.ec2.internal,}" Jul 23 14:10:04.789936 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.789915 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2bks9" Jul 23 14:10:04.794533 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:04.794466 2583 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-123.ec2.internal.18c4f084a019a36c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-123.ec2.internal.18c4f084a019a36c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-123.ec2.internal,UID:ip-10-0-138-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-123.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-123.ec2.internal,},FirstTimestamp:2026-07-23 14:10:04.757943148 +0000 UTC m=+0.317771488,LastTimestamp:2026-07-23 14:10:04.759045583 +0000 UTC m=+0.318873916,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-123.ec2.internal,}" Jul 23 14:10:04.796417 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.796400 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2bks9" Jul 23 14:10:04.803191 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:04.803125 2583 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-123.ec2.internal.18c4f084a01a0255\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-123.ec2.internal.18c4f084a01a0255 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-123.ec2.internal,UID:ip-10-0-138-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-123.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-123.ec2.internal,},FirstTimestamp:2026-07-23 14:10:04.757967445 +0000 UTC m=+0.317795781,LastTimestamp:2026-07-23 14:10:04.759062702 +0000 UTC m=+0.318891037,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-123.ec2.internal,}" Jul 23 14:10:04.804854 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.804842 2583 manager.go:337] "Starting Device Plugin manager" Jul 23 14:10:04.804909 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:04.804874 2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 23 14:10:04.804909 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.804887 2583 server.go:87] "Starting device plugin registration server" Jul 23 14:10:04.805166 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.805156 2583 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 23 14:10:04.805207 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.805170 2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 23 14:10:04.805293 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.805281 2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 23 14:10:04.805386 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.805359 2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 23 14:10:04.805386 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.805371 2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 23 14:10:04.805909 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:04.805891 2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 23 14:10:04.805975 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:04.805945 2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-123.ec2.internal\" not found" Jul 23 14:10:04.876806 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.876768 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 23 14:10:04.879056 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.877967 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 23 14:10:04.879056 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.877998 2583 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 23 14:10:04.879056 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.878019 2583 kubelet.go:2448] "Starting kubelet main sync loop" Jul 23 14:10:04.879056 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:04.878048 2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 23 14:10:04.880700 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.880682 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 14:10:04.905924 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.905907 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 14:10:04.906769 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.906753 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientMemory" Jul 23 14:10:04.906848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.906784 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 14:10:04.906848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.906795 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientPID" Jul 23 14:10:04.906848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.906816 2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-123.ec2.internal" Jul 23 14:10:04.915798 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.915783 2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-123.ec2.internal" Jul 23 14:10:04.915846 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:04.915804 2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-123.ec2.internal\": node \"ip-10-0-138-123.ec2.internal\" not found" Jul 23 14:10:04.978408 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.978284 2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-123.ec2.internal"] Jul 23 14:10:04.978408 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.978394 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 14:10:04.979321 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.979306 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientMemory" Jul 23 14:10:04.979400 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.979340 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 14:10:04.979400 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.979352 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientPID" Jul 23 14:10:04.981651 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.981639 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 14:10:04.981797 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.981783 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal" Jul 23 14:10:04.981849 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.981811 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 14:10:04.983103 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.983088 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientMemory" Jul 23 14:10:04.983174 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.983113 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 14:10:04.983174 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.983127 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientPID" Jul 23 14:10:04.983274 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.983192 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientMemory" Jul 23 14:10:04.983274 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.983213 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 14:10:04.983274 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.983226 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientPID" Jul 23 14:10:04.985519 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.985494 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-123.ec2.internal" Jul 23 14:10:04.985519 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.985521 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 14:10:04.986140 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.986125 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientMemory" Jul 23 14:10:04.986140 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.986147 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 14:10:04.986247 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:04.986163 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientPID" Jul 23 14:10:04.993689 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:04.993672 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-123.ec2.internal\" not found" Jul 23 14:10:05.005799 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:05.005779 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-123.ec2.internal\" not found" node="ip-10-0-138-123.ec2.internal" Jul 23 14:10:05.009298 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:05.009282 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-123.ec2.internal\" not found" node="ip-10-0-138-123.ec2.internal" Jul 23 14:10:05.041435 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.041403 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/750ea20679ea3c97f137d0a145b9b20b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal\" (UID: \"750ea20679ea3c97f137d0a145b9b20b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal" Jul 23 14:10:05.041435 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.041437 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/750ea20679ea3c97f137d0a145b9b20b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal\" (UID: \"750ea20679ea3c97f137d0a145b9b20b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal" Jul 23 14:10:05.041570 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.041457 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/02af97281464b2933292233b4d9f32de-config\") pod \"kube-apiserver-proxy-ip-10-0-138-123.ec2.internal\" (UID: \"02af97281464b2933292233b4d9f32de\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-123.ec2.internal" Jul 23 14:10:05.094391 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:05.094358 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-123.ec2.internal\" not found" Jul 23 14:10:05.141693 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.141666 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/750ea20679ea3c97f137d0a145b9b20b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal\" (UID: \"750ea20679ea3c97f137d0a145b9b20b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal" Jul 23 14:10:05.141771 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.141700 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/750ea20679ea3c97f137d0a145b9b20b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal\" (UID: \"750ea20679ea3c97f137d0a145b9b20b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal" Jul 23 14:10:05.141771 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.141719 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/02af97281464b2933292233b4d9f32de-config\") pod \"kube-apiserver-proxy-ip-10-0-138-123.ec2.internal\" (UID: \"02af97281464b2933292233b4d9f32de\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-123.ec2.internal" Jul 23 14:10:05.141771 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.141751 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/750ea20679ea3c97f137d0a145b9b20b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal\" (UID: \"750ea20679ea3c97f137d0a145b9b20b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal" Jul 23 14:10:05.141870 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.141770 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/02af97281464b2933292233b4d9f32de-config\") pod \"kube-apiserver-proxy-ip-10-0-138-123.ec2.internal\" (UID: \"02af97281464b2933292233b4d9f32de\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-123.ec2.internal" Jul 23 14:10:05.141870 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.141790 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/750ea20679ea3c97f137d0a145b9b20b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal\" (UID: \"750ea20679ea3c97f137d0a145b9b20b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal" Jul 23 14:10:05.195153 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:05.195128 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-123.ec2.internal\" not found" Jul 23 14:10:05.295459 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:05.295377 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-123.ec2.internal\" not found" Jul 23 14:10:05.309610 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.309577 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal" Jul 23 14:10:05.311891 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.311874 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-123.ec2.internal" Jul 23 14:10:05.397215 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:05.397150 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-123.ec2.internal\" not found" Jul 23 14:10:05.501528 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:05.501475 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-123.ec2.internal\" not found" Jul 23 14:10:05.602994 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:05.602898 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-123.ec2.internal\" not found" Jul 23 14:10:05.650603 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.650574 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 14:10:05.690270 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.690224 2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 23 14:10:05.690711 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.690388 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 14:10:05.690711 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.690404 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 14:10:05.703687 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:05.703657 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-123.ec2.internal\" not found" Jul 23 14:10:05.795357 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.795311 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 14:10:05.797369 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.797346 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientMemory" Jul 23 14:10:05.797499 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.797383 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 14:10:05.797499 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.797394 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientPID" Jul 23 14:10:05.802330 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.802296 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 14:05:04 +0000 UTC" deadline="2028-01-30 05:47:48.949139808 +0000 UTC" Jul 23 14:10:05.802330 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.802325 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13335h37m43.146819076s" Jul 23 14:10:05.804549 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:05.804530 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-123.ec2.internal\" not found" Jul 23 14:10:05.905427 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:05.905352 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-123.ec2.internal\" not found" Jul 23 14:10:05.932067 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.932040 2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 14:10:05.939275 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.939249 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-123.ec2.internal" Jul 23 14:10:05.954843 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.954822 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 14:10:05.956399 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.956381 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal" Jul 23 14:10:05.957095 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:05.957061 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod750ea20679ea3c97f137d0a145b9b20b.slice/crio-c6f32dc05631f6ff70f0b17ed284c03f53820eef6543d3a1eacdb4f2e1744dde WatchSource:0}: Error finding container c6f32dc05631f6ff70f0b17ed284c03f53820eef6543d3a1eacdb4f2e1744dde: Status 404 returned error can't find the container with id c6f32dc05631f6ff70f0b17ed284c03f53820eef6543d3a1eacdb4f2e1744dde Jul 23 14:10:05.960987 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.960968 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 14:10:05.966274 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:05.966230 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02af97281464b2933292233b4d9f32de.slice/crio-518d473a41dff30c2981a9ef30d01b3ccd28e60ff52569f9fa318515c0de71e0 WatchSource:0}: Error finding container 518d473a41dff30c2981a9ef30d01b3ccd28e60ff52569f9fa318515c0de71e0: Status 404 returned error can't find the container with id 518d473a41dff30c2981a9ef30d01b3ccd28e60ff52569f9fa318515c0de71e0 Jul 23 14:10:05.971730 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:05.971714 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 14:10:06.070945 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.070919 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 14:10:06.714307 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.714265 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 14:10:06.722875 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.722847 2583 apiserver.go:52] "Watching apiserver" Jul 23 14:10:06.729367 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.729339 2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 23 14:10:06.729894 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.729867 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-f97l5","openshift-image-registry/node-ca-nplv4","openshift-multus/multus-g4sv7","openshift-network-diagnostics/network-check-target-r8nkd","openshift-cluster-node-tuning-operator/tuned-s9k8r","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal","openshift-multus/multus-additional-cni-plugins-hlpcq","openshift-multus/network-metrics-daemon-hhx5z","openshift-network-operator/iptables-alerter-4wft5","openshift-ovn-kubernetes/ovnkube-node-cgj4x","kube-system/global-pull-secret-syncer-9rmzs","kube-system/konnectivity-agent-4gxs4","kube-system/kube-apiserver-proxy-ip-10-0-138-123.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk"] Jul 23 14:10:06.732916 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.732892 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.736600 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.736186 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pcmvc\"" Jul 23 14:10:06.736712 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.736682 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:06.736777 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:06.736753 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmzs" podUID="c33444eb-d4db-46c0-a1fe-23a9191cd4f5" Jul 23 14:10:06.737294 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.737042 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 23 14:10:06.737449 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.737315 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 23 14:10:06.738036 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.737660 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 23 14:10:06.738036 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.737762 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 23 14:10:06.738036 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.737882 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 23 14:10:06.741735 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.739375 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 23 14:10:06.741735 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.740202 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.742969 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.742610 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rx5pf\"" Jul 23 14:10:06.743066 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.743007 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 23 14:10:06.746155 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.746137 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:06.746249 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:06.746205 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8nkd" podUID="45236e03-e24a-4cc3-a8a3-814bc70d6b01" Jul 23 14:10:06.749449 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.749422 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz4ct\" (UniqueName: \"kubernetes.io/projected/13c16f90-fca6-420e-a294-6c75ba13ffa9-kube-api-access-bz4ct\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.749551 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.749451 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-cnibin\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.749551 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.749468 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-os-release\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.749551 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.749485 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-cni-binary-copy\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.749551 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.749508 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13c16f90-fca6-420e-a294-6c75ba13ffa9-cni-binary-copy\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.749551 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.749530 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-multus-socket-dir-parent\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.749845 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.749554 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-host-var-lib-cni-multus\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.749845 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.749578 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.749845 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.749603 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qc6q\" (UniqueName: \"kubernetes.io/projected/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-kube-api-access-6qc6q\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.749845 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.749628 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-host-var-lib-cni-bin\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.749845 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.749652 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-host-run-multus-certs\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.749845 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.749683 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-etc-kubernetes\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.749845 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.749713 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.749845 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.749737 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-dbus\") pod \"global-pull-secret-syncer-9rmzs\" (UID: \"c33444eb-d4db-46c0-a1fe-23a9191cd4f5\") " pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:06.749845 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.749768 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-system-cni-dir\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.749845 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.749794 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-cnibin\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.749845 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.749820 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-os-release\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.750411 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.749863 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-host-var-lib-kubelet\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.750411 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.749899 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-multus-conf-dir\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.750411 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.749931 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/13c16f90-fca6-420e-a294-6c75ba13ffa9-multus-daemon-config\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.750411 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.749966 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.750411 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.749994 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-hostroot\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.750411 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.750042 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret\") pod \"global-pull-secret-syncer-9rmzs\" (UID: \"c33444eb-d4db-46c0-a1fe-23a9191cd4f5\") " pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:06.750411 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.750080 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-host-run-netns\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.750411 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.750105 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-system-cni-dir\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.750411 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.750136 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-kubelet-config\") pod \"global-pull-secret-syncer-9rmzs\" (UID: \"c33444eb-d4db-46c0-a1fe-23a9191cd4f5\") " pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:06.750411 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.750161 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-multus-cni-dir\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.750411 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.750186 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-host-run-k8s-cni-cncf-io\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.751062 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.751041 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.754994 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.754970 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 23 14:10:06.755382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.755364 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qn442\"" Jul 23 14:10:06.768533 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.766631 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:06.768533 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.766940 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 23 14:10:06.770798 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.770516 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 23 14:10:06.770941 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.770919 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4wft5" Jul 23 14:10:06.772798 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.772531 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 23 14:10:06.772798 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.772673 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 14:10:06.773160 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.772972 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 23 14:10:06.773160 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.772979 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ttmpq\"" Jul 23 14:10:06.774437 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.774416 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 23 14:10:06.774533 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.774439 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 23 14:10:06.774920 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.774904 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q5gpl\"" Jul 23 14:10:06.775446 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.775430 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:06.775623 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:06.775597 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhx5z" podUID="d96c127f-a6dd-40c9-8dab-1a64c2af3f75" Jul 23 14:10:06.775861 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.775837 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 23 14:10:06.777691 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.777670 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nplv4" Jul 23 14:10:06.781154 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.779971 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 23 14:10:06.781154 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.780213 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 23 14:10:06.781154 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.780517 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.781154 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.780578 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 23 14:10:06.781154 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.781005 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c5jn2\"" Jul 23 14:10:06.783581 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.782990 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f97l5" Jul 23 14:10:06.783581 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.783239 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 23 14:10:06.783581 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.783299 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 23 14:10:06.783581 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.783473 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 23 14:10:06.783895 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.783670 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 23 14:10:06.783962 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.783913 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-br65d\"" Jul 23 14:10:06.784019 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.783988 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 23 14:10:06.784376 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.784140 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 23 14:10:06.785291 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.785191 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 23 14:10:06.785817 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.785653 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 23 14:10:06.785817 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.785764 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xcwtp\"" Jul 23 14:10:06.786949 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.786414 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4gxs4" Jul 23 14:10:06.788352 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.788018 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zhwph" Jul 23 14:10:06.789148 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.788912 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 23 14:10:06.789148 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.789018 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-64q8z\"" Jul 23 14:10:06.789858 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.789746 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 23 14:10:06.797764 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.797713 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zhwph" Jul 23 14:10:06.840730 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.840646 2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 23 14:10:06.850831 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.850802 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-hostroot\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.850976 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.850845 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-var-lib-kubelet\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.850976 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.850873 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vsqx\" (UniqueName: \"kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx\") pod \"network-check-target-r8nkd\" (UID: \"45236e03-e24a-4cc3-a8a3-814bc70d6b01\") " pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:06.850976 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.850901 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6ab12b46-de62-4b32-9811-ded59879930d-registration-dir\") pod \"aws-ebs-csi-driver-node-brfqk\" (UID: \"6ab12b46-de62-4b32-9811-ded59879930d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:06.850976 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.850915 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-hostroot\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.850976 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.850947 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6ab12b46-de62-4b32-9811-ded59879930d-sys-fs\") pod \"aws-ebs-csi-driver-node-brfqk\" (UID: \"6ab12b46-de62-4b32-9811-ded59879930d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:06.851249 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.850984 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-systemd-units\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.851249 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851015 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-lib-modules\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.851249 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851049 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6ab12b46-de62-4b32-9811-ded59879930d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-brfqk\" (UID: \"6ab12b46-de62-4b32-9811-ded59879930d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:06.851249 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851076 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/22c3acf1-51b9-4a51-87f0-0e3266a2bf21-iptables-alerter-script\") pod \"iptables-alerter-4wft5\" (UID: \"22c3acf1-51b9-4a51-87f0-0e3266a2bf21\") " pod="openshift-network-operator/iptables-alerter-4wft5" Jul 23 14:10:06.851249 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851105 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-run-openvswitch\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.851249 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851147 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/973616e7-c535-4446-ab85-b5c397fa3601-env-overrides\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.851249 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851185 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-host-run-netns\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.851249 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851212 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-multus-cni-dir\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.851249 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851235 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-etc-sysctl-d\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.851760 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851277 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6ab12b46-de62-4b32-9811-ded59879930d-device-dir\") pod \"aws-ebs-csi-driver-node-brfqk\" (UID: \"6ab12b46-de62-4b32-9811-ded59879930d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:06.851760 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851304 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcj2q\" (UniqueName: \"kubernetes.io/projected/22c3acf1-51b9-4a51-87f0-0e3266a2bf21-kube-api-access-rcj2q\") pod \"iptables-alerter-4wft5\" (UID: \"22c3acf1-51b9-4a51-87f0-0e3266a2bf21\") " pod="openshift-network-operator/iptables-alerter-4wft5" Jul 23 14:10:06.851760 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851343 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-run-ovn\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.851760 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851377 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-log-socket\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.851760 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851392 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-host-run-netns\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.851760 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851409 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13c16f90-fca6-420e-a294-6c75ba13ffa9-cni-binary-copy\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.851760 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851491 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0d66bd7-7a9d-48d2-904b-621a1eacc15e-hosts-file\") pod \"node-resolver-f97l5\" (UID: \"f0d66bd7-7a9d-48d2-904b-621a1eacc15e\") " pod="openshift-dns/node-resolver-f97l5" Jul 23 14:10:06.851760 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851500 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-multus-cni-dir\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.851760 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851517 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x74pr\" (UniqueName: \"kubernetes.io/projected/f0d66bd7-7a9d-48d2-904b-621a1eacc15e-kube-api-access-x74pr\") pod \"node-resolver-f97l5\" (UID: \"f0d66bd7-7a9d-48d2-904b-621a1eacc15e\") " pod="openshift-dns/node-resolver-f97l5" Jul 23 14:10:06.851760 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851560 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98tbr\" (UniqueName: \"kubernetes.io/projected/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-kube-api-access-98tbr\") pod \"network-metrics-daemon-hhx5z\" (UID: \"d96c127f-a6dd-40c9-8dab-1a64c2af3f75\") " pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:06.851760 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851618 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-multus-socket-dir-parent\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.851760 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851685 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-host-run-netns\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.851760 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851706 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-multus-socket-dir-parent\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.851760 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851723 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.851760 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851753 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-host-run-multus-certs\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.852605 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851779 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-etc-kubernetes\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.852605 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851804 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-etc-modprobe-d\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.852605 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851842 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.852605 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851867 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-dbus\") pod \"global-pull-secret-syncer-9rmzs\" (UID: \"c33444eb-d4db-46c0-a1fe-23a9191cd4f5\") " pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:06.852605 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851893 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0d66bd7-7a9d-48d2-904b-621a1eacc15e-tmp-dir\") pod \"node-resolver-f97l5\" (UID: \"f0d66bd7-7a9d-48d2-904b-621a1eacc15e\") " pod="openshift-dns/node-resolver-f97l5" Jul 23 14:10:06.852605 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851867 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-host-run-multus-certs\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.852605 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851923 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6ab12b46-de62-4b32-9811-ded59879930d-etc-selinux\") pod \"aws-ebs-csi-driver-node-brfqk\" (UID: \"6ab12b46-de62-4b32-9811-ded59879930d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:06.852605 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851952 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-run-systemd\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.852605 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.851964 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-dbus\") pod \"global-pull-secret-syncer-9rmzs\" (UID: \"c33444eb-d4db-46c0-a1fe-23a9191cd4f5\") " pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:06.852605 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852002 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-etc-kubernetes\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.852605 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852007 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-system-cni-dir\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.852605 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852035 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-os-release\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.852605 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852079 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-multus-conf-dir\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.852605 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852129 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-host-kubelet\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.852605 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852155 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-host-cni-netd\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.852605 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852167 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13c16f90-fca6-420e-a294-6c75ba13ffa9-cni-binary-copy\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.852605 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852180 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/973616e7-c535-4446-ab85-b5c397fa3601-ovnkube-script-lib\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.853547 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852210 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.853547 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852265 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-os-release\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.853547 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852324 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d86c011-dcb3-4103-badd-9557cc53906a-host\") pod \"node-ca-nplv4\" (UID: \"4d86c011-dcb3-4103-badd-9557cc53906a\") " pod="openshift-image-registry/node-ca-nplv4" Jul 23 14:10:06.853547 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852344 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.853547 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852353 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-var-lib-openvswitch\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.853547 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852386 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret\") pod \"global-pull-secret-syncer-9rmzs\" (UID: \"c33444eb-d4db-46c0-a1fe-23a9191cd4f5\") " pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:06.853547 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852392 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-multus-conf-dir\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.853547 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852414 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-etc-kubernetes\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.853547 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852419 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.853547 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852454 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.853547 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852523 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-system-cni-dir\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.853547 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852564 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4d86c011-dcb3-4103-badd-9557cc53906a-serviceca\") pod \"node-ca-nplv4\" (UID: \"4d86c011-dcb3-4103-badd-9557cc53906a\") " pod="openshift-image-registry/node-ca-nplv4" Jul 23 14:10:06.853547 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852565 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.853547 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852623 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-system-cni-dir\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.853547 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:06.852689 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 14:10:06.853547 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852712 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-kubelet-config\") pod \"global-pull-secret-syncer-9rmzs\" (UID: \"c33444eb-d4db-46c0-a1fe-23a9191cd4f5\") " pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:06.853547 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852722 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-system-cni-dir\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.854407 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:06.852796 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret podName:c33444eb-d4db-46c0-a1fe-23a9191cd4f5 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:07.35275798 +0000 UTC m=+2.912586320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret") pod "global-pull-secret-syncer-9rmzs" (UID: "c33444eb-d4db-46c0-a1fe-23a9191cd4f5") : object "kube-system"/"original-pull-secret" not registered Jul 23 14:10:06.854407 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852807 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-kubelet-config\") pod \"global-pull-secret-syncer-9rmzs\" (UID: \"c33444eb-d4db-46c0-a1fe-23a9191cd4f5\") " pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:06.854407 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852818 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-host-run-k8s-cni-cncf-io\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.854407 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852857 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz4ct\" (UniqueName: \"kubernetes.io/projected/13c16f90-fca6-420e-a294-6c75ba13ffa9-kube-api-access-bz4ct\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.854407 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852888 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-host-run-k8s-cni-cncf-io\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.854407 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.852926 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/973616e7-c535-4446-ab85-b5c397fa3601-ovn-node-metrics-cert\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.854407 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853117 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-cnibin\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.854407 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853148 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-os-release\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.854407 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853173 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-cni-binary-copy\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.854407 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853201 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-etc-sysctl-conf\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.854407 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853236 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-host\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.854407 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853278 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b5cc372-ff28-4b28-bd97-119a983da3da-etc-tuned\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.854407 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853291 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-os-release\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.854407 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853303 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-host-var-lib-cni-multus\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.854407 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853327 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-etc-sysconfig\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.854407 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853343 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-cnibin\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.855290 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853349 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-run\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.855290 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853374 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzbgc\" (UniqueName: \"kubernetes.io/projected/4d86c011-dcb3-4103-badd-9557cc53906a-kube-api-access-nzbgc\") pod \"node-ca-nplv4\" (UID: \"4d86c011-dcb3-4103-badd-9557cc53906a\") " pod="openshift-image-registry/node-ca-nplv4" Jul 23 14:10:06.855290 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853415 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e648ed66-32b8-4ff9-8b04-fb537b96da10-agent-certs\") pod \"konnectivity-agent-4gxs4\" (UID: \"e648ed66-32b8-4ff9-8b04-fb537b96da10\") " pod="kube-system/konnectivity-agent-4gxs4" Jul 23 14:10:06.855290 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853438 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e648ed66-32b8-4ff9-8b04-fb537b96da10-konnectivity-ca\") pod \"konnectivity-agent-4gxs4\" (UID: \"e648ed66-32b8-4ff9-8b04-fb537b96da10\") " pod="kube-system/konnectivity-agent-4gxs4" Jul 23 14:10:06.855290 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853462 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-host-slash\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.855290 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853522 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc6hx\" (UniqueName: \"kubernetes.io/projected/973616e7-c535-4446-ab85-b5c397fa3601-kube-api-access-nc6hx\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.855290 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853551 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qc6q\" (UniqueName: \"kubernetes.io/projected/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-kube-api-access-6qc6q\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.855290 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853576 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-host-var-lib-cni-bin\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.855290 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853609 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6ab12b46-de62-4b32-9811-ded59879930d-socket-dir\") pod \"aws-ebs-csi-driver-node-brfqk\" (UID: \"6ab12b46-de62-4b32-9811-ded59879930d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:06.855290 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853636 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9mw8\" (UniqueName: \"kubernetes.io/projected/6ab12b46-de62-4b32-9811-ded59879930d-kube-api-access-s9mw8\") pod \"aws-ebs-csi-driver-node-brfqk\" (UID: \"6ab12b46-de62-4b32-9811-ded59879930d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:06.855290 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853666 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-etc-openvswitch\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.855290 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853692 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-node-log\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.855290 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853724 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-host-run-ovn-kubernetes\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.855290 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853760 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-etc-systemd\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.855290 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853784 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-sys\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.855290 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853808 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22c3acf1-51b9-4a51-87f0-0e3266a2bf21-host-slash\") pod \"iptables-alerter-4wft5\" (UID: \"22c3acf1-51b9-4a51-87f0-0e3266a2bf21\") " pod="openshift-network-operator/iptables-alerter-4wft5" Jul 23 14:10:06.856106 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853841 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs\") pod \"network-metrics-daemon-hhx5z\" (UID: \"d96c127f-a6dd-40c9-8dab-1a64c2af3f75\") " pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:06.856106 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853870 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-cni-binary-copy\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.856106 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853889 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-cnibin\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.856106 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853950 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-host-var-lib-kubelet\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.856106 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.854015 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-host-var-lib-kubelet\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.856106 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.853987 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/13c16f90-fca6-420e-a294-6c75ba13ffa9-multus-daemon-config\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.856106 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.854049 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-cnibin\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.856106 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.854096 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b5cc372-ff28-4b28-bd97-119a983da3da-tmp\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.856106 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.854150 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq68c\" (UniqueName: \"kubernetes.io/projected/2b5cc372-ff28-4b28-bd97-119a983da3da-kube-api-access-mq68c\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.856106 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.854166 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-host-var-lib-cni-bin\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.856106 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.854201 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-host-cni-bin\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.856106 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.854211 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/13c16f90-fca6-420e-a294-6c75ba13ffa9-host-var-lib-cni-multus\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.856106 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.854256 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/973616e7-c535-4446-ab85-b5c397fa3601-ovnkube-config\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.856106 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.854596 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/13c16f90-fca6-420e-a294-6c75ba13ffa9-multus-daemon-config\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.864479 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.864430 2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 23 14:10:06.869970 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.869901 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz4ct\" (UniqueName: \"kubernetes.io/projected/13c16f90-fca6-420e-a294-6c75ba13ffa9-kube-api-access-bz4ct\") pod \"multus-g4sv7\" (UID: \"13c16f90-fca6-420e-a294-6c75ba13ffa9\") " pod="openshift-multus/multus-g4sv7" Jul 23 14:10:06.870840 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.870816 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qc6q\" (UniqueName: \"kubernetes.io/projected/6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4-kube-api-access-6qc6q\") pod \"multus-additional-cni-plugins-hlpcq\" (UID: \"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4\") " pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:06.886362 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.886231 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-123.ec2.internal" event={"ID":"02af97281464b2933292233b4d9f32de","Type":"ContainerStarted","Data":"518d473a41dff30c2981a9ef30d01b3ccd28e60ff52569f9fa318515c0de71e0"} Jul 23 14:10:06.888037 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.888009 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal" event={"ID":"750ea20679ea3c97f137d0a145b9b20b","Type":"ContainerStarted","Data":"c6f32dc05631f6ff70f0b17ed284c03f53820eef6543d3a1eacdb4f2e1744dde"} Jul 23 14:10:06.954559 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.954520 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-etc-kubernetes\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.954733 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.954573 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.954733 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.954604 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4d86c011-dcb3-4103-badd-9557cc53906a-serviceca\") pod \"node-ca-nplv4\" (UID: \"4d86c011-dcb3-4103-badd-9557cc53906a\") " pod="openshift-image-registry/node-ca-nplv4" Jul 23 14:10:06.954733 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.954630 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-etc-kubernetes\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.954733 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.954635 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/973616e7-c535-4446-ab85-b5c397fa3601-ovn-node-metrics-cert\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.954733 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.954698 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-etc-sysctl-conf\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.954733 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.954726 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-host\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.955077 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.954751 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b5cc372-ff28-4b28-bd97-119a983da3da-etc-tuned\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.955077 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.954777 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-etc-sysconfig\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.955077 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.954800 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-run\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.955077 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.954828 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzbgc\" (UniqueName: \"kubernetes.io/projected/4d86c011-dcb3-4103-badd-9557cc53906a-kube-api-access-nzbgc\") pod \"node-ca-nplv4\" (UID: \"4d86c011-dcb3-4103-badd-9557cc53906a\") " pod="openshift-image-registry/node-ca-nplv4" Jul 23 14:10:06.955077 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.954855 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e648ed66-32b8-4ff9-8b04-fb537b96da10-agent-certs\") pod \"konnectivity-agent-4gxs4\" (UID: \"e648ed66-32b8-4ff9-8b04-fb537b96da10\") " pod="kube-system/konnectivity-agent-4gxs4" Jul 23 14:10:06.955077 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.954879 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e648ed66-32b8-4ff9-8b04-fb537b96da10-konnectivity-ca\") pod \"konnectivity-agent-4gxs4\" (UID: \"e648ed66-32b8-4ff9-8b04-fb537b96da10\") " pod="kube-system/konnectivity-agent-4gxs4" Jul 23 14:10:06.955077 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.954906 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-host-slash\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.955077 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.954932 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc6hx\" (UniqueName: \"kubernetes.io/projected/973616e7-c535-4446-ab85-b5c397fa3601-kube-api-access-nc6hx\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.955077 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.954959 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6ab12b46-de62-4b32-9811-ded59879930d-socket-dir\") pod \"aws-ebs-csi-driver-node-brfqk\" (UID: \"6ab12b46-de62-4b32-9811-ded59879930d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:06.955077 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.954984 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9mw8\" (UniqueName: \"kubernetes.io/projected/6ab12b46-de62-4b32-9811-ded59879930d-kube-api-access-s9mw8\") pod \"aws-ebs-csi-driver-node-brfqk\" (UID: \"6ab12b46-de62-4b32-9811-ded59879930d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:06.955077 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955009 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-etc-openvswitch\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.955077 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955033 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-node-log\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.956831 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955105 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.956831 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955158 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-host-run-ovn-kubernetes\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.956831 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955192 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-etc-systemd\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.956831 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955219 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-sys\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.956831 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955244 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22c3acf1-51b9-4a51-87f0-0e3266a2bf21-host-slash\") pod \"iptables-alerter-4wft5\" (UID: \"22c3acf1-51b9-4a51-87f0-0e3266a2bf21\") " pod="openshift-network-operator/iptables-alerter-4wft5" Jul 23 14:10:06.956831 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955289 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs\") pod \"network-metrics-daemon-hhx5z\" (UID: \"d96c127f-a6dd-40c9-8dab-1a64c2af3f75\") " pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:06.956831 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955318 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b5cc372-ff28-4b28-bd97-119a983da3da-tmp\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.956831 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955343 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq68c\" (UniqueName: \"kubernetes.io/projected/2b5cc372-ff28-4b28-bd97-119a983da3da-kube-api-access-mq68c\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.956831 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955367 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-host-cni-bin\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.956831 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955424 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-host-cni-bin\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.956831 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955444 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-host\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.956831 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955469 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-node-log\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.956831 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955486 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6ab12b46-de62-4b32-9811-ded59879930d-socket-dir\") pod \"aws-ebs-csi-driver-node-brfqk\" (UID: \"6ab12b46-de62-4b32-9811-ded59879930d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:06.956831 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955498 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-etc-sysctl-conf\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.956831 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955495 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/973616e7-c535-4446-ab85-b5c397fa3601-ovnkube-config\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.956831 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955615 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-var-lib-kubelet\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.956831 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955647 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vsqx\" (UniqueName: \"kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx\") pod \"network-check-target-r8nkd\" (UID: \"45236e03-e24a-4cc3-a8a3-814bc70d6b01\") " pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:06.957697 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955676 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6ab12b46-de62-4b32-9811-ded59879930d-registration-dir\") pod \"aws-ebs-csi-driver-node-brfqk\" (UID: \"6ab12b46-de62-4b32-9811-ded59879930d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:06.957697 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955651 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-etc-openvswitch\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.957697 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955697 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e648ed66-32b8-4ff9-8b04-fb537b96da10-konnectivity-ca\") pod \"konnectivity-agent-4gxs4\" (UID: \"e648ed66-32b8-4ff9-8b04-fb537b96da10\") " pod="kube-system/konnectivity-agent-4gxs4" Jul 23 14:10:06.957697 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955706 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6ab12b46-de62-4b32-9811-ded59879930d-sys-fs\") pod \"aws-ebs-csi-driver-node-brfqk\" (UID: \"6ab12b46-de62-4b32-9811-ded59879930d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:06.957697 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955736 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-systemd-units\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.957697 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955761 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-host-slash\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.957697 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955765 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-lib-modules\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.957697 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955793 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6ab12b46-de62-4b32-9811-ded59879930d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-brfqk\" (UID: \"6ab12b46-de62-4b32-9811-ded59879930d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:06.957697 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955801 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22c3acf1-51b9-4a51-87f0-0e3266a2bf21-host-slash\") pod \"iptables-alerter-4wft5\" (UID: \"22c3acf1-51b9-4a51-87f0-0e3266a2bf21\") " pod="openshift-network-operator/iptables-alerter-4wft5" Jul 23 14:10:06.957697 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955820 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/22c3acf1-51b9-4a51-87f0-0e3266a2bf21-iptables-alerter-script\") pod \"iptables-alerter-4wft5\" (UID: \"22c3acf1-51b9-4a51-87f0-0e3266a2bf21\") " pod="openshift-network-operator/iptables-alerter-4wft5" Jul 23 14:10:06.957697 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955846 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-run-openvswitch\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.957697 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955874 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/973616e7-c535-4446-ab85-b5c397fa3601-env-overrides\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.957697 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955882 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-host-run-ovn-kubernetes\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.957697 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955949 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-etc-systemd\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.957697 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955996 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-var-lib-kubelet\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.957697 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956079 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/973616e7-c535-4446-ab85-b5c397fa3601-ovnkube-config\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.957697 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:06.956153 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:10:06.957697 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956163 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6ab12b46-de62-4b32-9811-ded59879930d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-brfqk\" (UID: \"6ab12b46-de62-4b32-9811-ded59879930d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:06.958659 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.955849 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-etc-sysconfig\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.958659 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:06.956293 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs podName:d96c127f-a6dd-40c9-8dab-1a64c2af3f75 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:07.456273752 +0000 UTC m=+3.016102089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs") pod "network-metrics-daemon-hhx5z" (UID: "d96c127f-a6dd-40c9-8dab-1a64c2af3f75") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:10:06.958659 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956304 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-run-openvswitch\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.958659 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956378 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6ab12b46-de62-4b32-9811-ded59879930d-registration-dir\") pod \"aws-ebs-csi-driver-node-brfqk\" (UID: \"6ab12b46-de62-4b32-9811-ded59879930d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:06.958659 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956425 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6ab12b46-de62-4b32-9811-ded59879930d-sys-fs\") pod \"aws-ebs-csi-driver-node-brfqk\" (UID: \"6ab12b46-de62-4b32-9811-ded59879930d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:06.958659 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956487 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-systemd-units\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.958659 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956531 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-etc-sysctl-d\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.958659 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956564 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6ab12b46-de62-4b32-9811-ded59879930d-device-dir\") pod \"aws-ebs-csi-driver-node-brfqk\" (UID: \"6ab12b46-de62-4b32-9811-ded59879930d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:06.958659 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956594 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcj2q\" (UniqueName: \"kubernetes.io/projected/22c3acf1-51b9-4a51-87f0-0e3266a2bf21-kube-api-access-rcj2q\") pod \"iptables-alerter-4wft5\" (UID: \"22c3acf1-51b9-4a51-87f0-0e3266a2bf21\") " pod="openshift-network-operator/iptables-alerter-4wft5" Jul 23 14:10:06.958659 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956530 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4d86c011-dcb3-4103-badd-9557cc53906a-serviceca\") pod \"node-ca-nplv4\" (UID: \"4d86c011-dcb3-4103-badd-9557cc53906a\") " pod="openshift-image-registry/node-ca-nplv4" Jul 23 14:10:06.958659 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956623 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-lib-modules\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.958659 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956668 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-run-ovn\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.958659 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956681 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6ab12b46-de62-4b32-9811-ded59879930d-device-dir\") pod \"aws-ebs-csi-driver-node-brfqk\" (UID: \"6ab12b46-de62-4b32-9811-ded59879930d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:06.958659 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956697 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-log-socket\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.958659 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956711 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/22c3acf1-51b9-4a51-87f0-0e3266a2bf21-iptables-alerter-script\") pod \"iptables-alerter-4wft5\" (UID: \"22c3acf1-51b9-4a51-87f0-0e3266a2bf21\") " pod="openshift-network-operator/iptables-alerter-4wft5" Jul 23 14:10:06.958659 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956725 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0d66bd7-7a9d-48d2-904b-621a1eacc15e-hosts-file\") pod \"node-resolver-f97l5\" (UID: \"f0d66bd7-7a9d-48d2-904b-621a1eacc15e\") " pod="openshift-dns/node-resolver-f97l5" Jul 23 14:10:06.958659 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956773 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x74pr\" (UniqueName: \"kubernetes.io/projected/f0d66bd7-7a9d-48d2-904b-621a1eacc15e-kube-api-access-x74pr\") pod \"node-resolver-f97l5\" (UID: \"f0d66bd7-7a9d-48d2-904b-621a1eacc15e\") " pod="openshift-dns/node-resolver-f97l5" Jul 23 14:10:06.959572 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956786 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-log-socket\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.959572 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956791 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-run-ovn\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.959572 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956805 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98tbr\" (UniqueName: \"kubernetes.io/projected/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-kube-api-access-98tbr\") pod \"network-metrics-daemon-hhx5z\" (UID: \"d96c127f-a6dd-40c9-8dab-1a64c2af3f75\") " pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:06.959572 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956915 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-run\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.959572 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956918 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-etc-sysctl-d\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.959572 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.956958 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0d66bd7-7a9d-48d2-904b-621a1eacc15e-hosts-file\") pod \"node-resolver-f97l5\" (UID: \"f0d66bd7-7a9d-48d2-904b-621a1eacc15e\") " pod="openshift-dns/node-resolver-f97l5" Jul 23 14:10:06.959572 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.957005 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-sys\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.959572 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.957044 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-host-run-netns\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.959572 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.957183 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-host-run-netns\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.959572 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.957221 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-etc-modprobe-d\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.959572 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.957227 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/973616e7-c535-4446-ab85-b5c397fa3601-env-overrides\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.959572 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.957275 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0d66bd7-7a9d-48d2-904b-621a1eacc15e-tmp-dir\") pod \"node-resolver-f97l5\" (UID: \"f0d66bd7-7a9d-48d2-904b-621a1eacc15e\") " pod="openshift-dns/node-resolver-f97l5" Jul 23 14:10:06.959572 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.957339 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6ab12b46-de62-4b32-9811-ded59879930d-etc-selinux\") pod \"aws-ebs-csi-driver-node-brfqk\" (UID: \"6ab12b46-de62-4b32-9811-ded59879930d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:06.959572 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.957349 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b5cc372-ff28-4b28-bd97-119a983da3da-etc-modprobe-d\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.959572 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.957379 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-run-systemd\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.959572 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.957434 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-run-systemd\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.959572 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.957435 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6ab12b46-de62-4b32-9811-ded59879930d-etc-selinux\") pod \"aws-ebs-csi-driver-node-brfqk\" (UID: \"6ab12b46-de62-4b32-9811-ded59879930d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:06.959572 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.957472 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-host-kubelet\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.960537 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.957518 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-host-cni-netd\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.960537 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.957553 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-host-kubelet\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.960537 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.957576 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0d66bd7-7a9d-48d2-904b-621a1eacc15e-tmp-dir\") pod \"node-resolver-f97l5\" (UID: \"f0d66bd7-7a9d-48d2-904b-621a1eacc15e\") " pod="openshift-dns/node-resolver-f97l5" Jul 23 14:10:06.960537 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.957601 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-host-cni-netd\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.960537 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.957620 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/973616e7-c535-4446-ab85-b5c397fa3601-ovnkube-script-lib\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.960537 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.957673 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d86c011-dcb3-4103-badd-9557cc53906a-host\") pod \"node-ca-nplv4\" (UID: \"4d86c011-dcb3-4103-badd-9557cc53906a\") " pod="openshift-image-registry/node-ca-nplv4" Jul 23 14:10:06.960537 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.957807 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-var-lib-openvswitch\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.960537 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.957830 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d86c011-dcb3-4103-badd-9557cc53906a-host\") pod \"node-ca-nplv4\" (UID: \"4d86c011-dcb3-4103-badd-9557cc53906a\") " pod="openshift-image-registry/node-ca-nplv4" Jul 23 14:10:06.960537 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.957949 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/973616e7-c535-4446-ab85-b5c397fa3601-var-lib-openvswitch\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.960537 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.958212 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/973616e7-c535-4446-ab85-b5c397fa3601-ovnkube-script-lib\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.960537 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.959045 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/973616e7-c535-4446-ab85-b5c397fa3601-ovn-node-metrics-cert\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.960537 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.959475 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e648ed66-32b8-4ff9-8b04-fb537b96da10-agent-certs\") pod \"konnectivity-agent-4gxs4\" (UID: \"e648ed66-32b8-4ff9-8b04-fb537b96da10\") " pod="kube-system/konnectivity-agent-4gxs4" Jul 23 14:10:06.961204 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.960678 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b5cc372-ff28-4b28-bd97-119a983da3da-etc-tuned\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.961204 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.960765 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b5cc372-ff28-4b28-bd97-119a983da3da-tmp\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:06.965045 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:06.964993 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 14:10:06.965045 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:06.965021 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 14:10:06.965045 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:06.965036 2583 projected.go:196] Error preparing data for projected volume kube-api-access-5vsqx for pod openshift-network-diagnostics/network-check-target-r8nkd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:10:06.965389 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:06.965099 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx podName:45236e03-e24a-4cc3-a8a3-814bc70d6b01 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:07.465081132 +0000 UTC m=+3.024909477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5vsqx" (UniqueName: "kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx") pod "network-check-target-r8nkd" (UID: "45236e03-e24a-4cc3-a8a3-814bc70d6b01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:10:06.967309 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.967284 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9mw8\" (UniqueName: \"kubernetes.io/projected/6ab12b46-de62-4b32-9811-ded59879930d-kube-api-access-s9mw8\") pod \"aws-ebs-csi-driver-node-brfqk\" (UID: \"6ab12b46-de62-4b32-9811-ded59879930d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:06.969248 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.969181 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzbgc\" (UniqueName: \"kubernetes.io/projected/4d86c011-dcb3-4103-badd-9557cc53906a-kube-api-access-nzbgc\") pod \"node-ca-nplv4\" (UID: \"4d86c011-dcb3-4103-badd-9557cc53906a\") " pod="openshift-image-registry/node-ca-nplv4" Jul 23 14:10:06.969715 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.969664 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcj2q\" (UniqueName: \"kubernetes.io/projected/22c3acf1-51b9-4a51-87f0-0e3266a2bf21-kube-api-access-rcj2q\") pod \"iptables-alerter-4wft5\" (UID: \"22c3acf1-51b9-4a51-87f0-0e3266a2bf21\") " pod="openshift-network-operator/iptables-alerter-4wft5" Jul 23 14:10:06.971169 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.971146 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc6hx\" (UniqueName: \"kubernetes.io/projected/973616e7-c535-4446-ab85-b5c397fa3601-kube-api-access-nc6hx\") pod \"ovnkube-node-cgj4x\" (UID: \"973616e7-c535-4446-ab85-b5c397fa3601\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:06.972555 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.972531 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x74pr\" (UniqueName: \"kubernetes.io/projected/f0d66bd7-7a9d-48d2-904b-621a1eacc15e-kube-api-access-x74pr\") pod \"node-resolver-f97l5\" (UID: \"f0d66bd7-7a9d-48d2-904b-621a1eacc15e\") " pod="openshift-dns/node-resolver-f97l5" Jul 23 14:10:06.973093 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.973070 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98tbr\" (UniqueName: \"kubernetes.io/projected/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-kube-api-access-98tbr\") pod \"network-metrics-daemon-hhx5z\" (UID: \"d96c127f-a6dd-40c9-8dab-1a64c2af3f75\") " pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:06.973277 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:06.973243 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq68c\" (UniqueName: \"kubernetes.io/projected/2b5cc372-ff28-4b28-bd97-119a983da3da-kube-api-access-mq68c\") pod \"tuned-s9k8r\" (UID: \"2b5cc372-ff28-4b28-bd97-119a983da3da\") " pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:07.049326 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:07.049294 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hlpcq" Jul 23 14:10:07.059010 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:07.058984 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e6cdb35_6f1c_4d3b_b81b_fd615bafa8e4.slice/crio-d74f4ded959db01bcafa5c75899711d29110482dd52e375a37023bcd45347fce WatchSource:0}: Error finding container d74f4ded959db01bcafa5c75899711d29110482dd52e375a37023bcd45347fce: Status 404 returned error can't find the container with id d74f4ded959db01bcafa5c75899711d29110482dd52e375a37023bcd45347fce Jul 23 14:10:07.066816 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:07.066787 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g4sv7" Jul 23 14:10:07.080455 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:07.080435 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" Jul 23 14:10:07.090431 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:07.090408 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" Jul 23 14:10:07.107590 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:07.107431 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4wft5" Jul 23 14:10:07.116449 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:07.116421 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nplv4" Jul 23 14:10:07.125458 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:07.125425 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:07.134381 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:07.134360 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f97l5" Jul 23 14:10:07.143355 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:07.143333 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4gxs4" Jul 23 14:10:07.360799 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:07.360710 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret\") pod \"global-pull-secret-syncer-9rmzs\" (UID: \"c33444eb-d4db-46c0-a1fe-23a9191cd4f5\") " pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:07.360973 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:07.360850 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 14:10:07.360973 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:07.360917 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret podName:c33444eb-d4db-46c0-a1fe-23a9191cd4f5 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:08.360897827 +0000 UTC m=+3.920726151 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret") pod "global-pull-secret-syncer-9rmzs" (UID: "c33444eb-d4db-46c0-a1fe-23a9191cd4f5") : object "kube-system"/"original-pull-secret" not registered Jul 23 14:10:07.461766 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:07.461731 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs\") pod \"network-metrics-daemon-hhx5z\" (UID: \"d96c127f-a6dd-40c9-8dab-1a64c2af3f75\") " pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:07.461912 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:07.461884 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:10:07.462022 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:07.461947 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs podName:d96c127f-a6dd-40c9-8dab-1a64c2af3f75 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:08.461930097 +0000 UTC m=+4.021758418 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs") pod "network-metrics-daemon-hhx5z" (UID: "d96c127f-a6dd-40c9-8dab-1a64c2af3f75") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:10:07.562587 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:07.562546 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vsqx\" (UniqueName: \"kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx\") pod \"network-check-target-r8nkd\" (UID: \"45236e03-e24a-4cc3-a8a3-814bc70d6b01\") " pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:07.562751 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:07.562694 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 14:10:07.562751 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:07.562710 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 14:10:07.562751 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:07.562722 2583 projected.go:196] Error preparing data for projected volume kube-api-access-5vsqx for pod openshift-network-diagnostics/network-check-target-r8nkd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:10:07.562925 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:07.562782 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx podName:45236e03-e24a-4cc3-a8a3-814bc70d6b01 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:08.56276528 +0000 UTC m=+4.122593608 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vsqx" (UniqueName: "kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx") pod "network-check-target-r8nkd" (UID: "45236e03-e24a-4cc3-a8a3-814bc70d6b01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:10:07.800890 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:07.800807 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 14:05:06 +0000 UTC" deadline="2028-01-31 16:27:12.059494037 +0000 UTC" Jul 23 14:10:07.800890 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:07.800846 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13370h17m4.258655626s" Jul 23 14:10:07.878704 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:07.878673 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:07.878854 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:07.878797 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmzs" podUID="c33444eb-d4db-46c0-a1fe-23a9191cd4f5" Jul 23 14:10:07.890839 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:07.890800 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlpcq" event={"ID":"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4","Type":"ContainerStarted","Data":"d74f4ded959db01bcafa5c75899711d29110482dd52e375a37023bcd45347fce"} Jul 23 14:10:08.086542 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:08.086516 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0d66bd7_7a9d_48d2_904b_621a1eacc15e.slice/crio-dd513e08cd25fed7e959f231264e7aa6dd829a988bfda52df4fb7eacd8d424b2 WatchSource:0}: Error finding container dd513e08cd25fed7e959f231264e7aa6dd829a988bfda52df4fb7eacd8d424b2: Status 404 returned error can't find the container with id dd513e08cd25fed7e959f231264e7aa6dd829a988bfda52df4fb7eacd8d424b2 Jul 23 14:10:08.088332 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:08.088299 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d86c011_dcb3_4103_badd_9557cc53906a.slice/crio-cb8e44c95c6cde7feff492e524f4bc505d9120aa6d1f5f10af497d4b35ed8766 WatchSource:0}: Error finding container cb8e44c95c6cde7feff492e524f4bc505d9120aa6d1f5f10af497d4b35ed8766: Status 404 returned error can't find the container with id cb8e44c95c6cde7feff492e524f4bc505d9120aa6d1f5f10af497d4b35ed8766 Jul 23 14:10:08.368912 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:08.368881 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret\") pod \"global-pull-secret-syncer-9rmzs\" (UID: \"c33444eb-d4db-46c0-a1fe-23a9191cd4f5\") " pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:08.369039 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:08.368988 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 14:10:08.369039 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:08.369035 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret podName:c33444eb-d4db-46c0-a1fe-23a9191cd4f5 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:10.369022428 +0000 UTC m=+5.928850749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret") pod "global-pull-secret-syncer-9rmzs" (UID: "c33444eb-d4db-46c0-a1fe-23a9191cd4f5") : object "kube-system"/"original-pull-secret" not registered Jul 23 14:10:08.469648 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:08.469606 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs\") pod \"network-metrics-daemon-hhx5z\" (UID: \"d96c127f-a6dd-40c9-8dab-1a64c2af3f75\") " pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:08.469813 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:08.469763 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:10:08.469876 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:08.469834 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs podName:d96c127f-a6dd-40c9-8dab-1a64c2af3f75 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:10.469814484 +0000 UTC m=+6.029642804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs") pod "network-metrics-daemon-hhx5z" (UID: "d96c127f-a6dd-40c9-8dab-1a64c2af3f75") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:10:08.570991 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:08.570923 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vsqx\" (UniqueName: \"kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx\") pod \"network-check-target-r8nkd\" (UID: \"45236e03-e24a-4cc3-a8a3-814bc70d6b01\") " pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:08.571144 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:08.571118 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 14:10:08.571144 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:08.571144 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 14:10:08.571293 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:08.571158 2583 projected.go:196] Error preparing data for projected volume kube-api-access-5vsqx for pod openshift-network-diagnostics/network-check-target-r8nkd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:10:08.571293 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:08.571212 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx podName:45236e03-e24a-4cc3-a8a3-814bc70d6b01 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:10.571198135 +0000 UTC m=+6.131026478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vsqx" (UniqueName: "kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx") pod "network-check-target-r8nkd" (UID: "45236e03-e24a-4cc3-a8a3-814bc70d6b01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:10:08.787836 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:08.787761 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 14:10:08.801364 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:08.801307 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 14:05:06 +0000 UTC" deadline="2028-02-16 20:17:47.78951583 +0000 UTC" Jul 23 14:10:08.801364 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:08.801360 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13758h7m38.988159572s" Jul 23 14:10:08.881358 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:08.881331 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:08.881513 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:08.881457 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8nkd" podUID="45236e03-e24a-4cc3-a8a3-814bc70d6b01" Jul 23 14:10:08.881877 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:08.881851 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:08.881988 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:08.881964 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhx5z" podUID="d96c127f-a6dd-40c9-8dab-1a64c2af3f75" Jul 23 14:10:08.907176 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:08.906418 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-123.ec2.internal" event={"ID":"02af97281464b2933292233b4d9f32de","Type":"ContainerStarted","Data":"44c42e272a394407d66f443e212c45a7185df019847302e0e9e39a921efe4326"} Jul 23 14:10:08.914655 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:08.914628 2583 generic.go:356] "Generic (PLEG): container finished" podID="750ea20679ea3c97f137d0a145b9b20b" containerID="43a9678df2b718398f4982c87a5cf695ea7dc58a95a9487f3fb980e49f4c3ce6" exitCode=0 Jul 23 14:10:08.914833 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:08.914717 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal" event={"ID":"750ea20679ea3c97f137d0a145b9b20b","Type":"ContainerDied","Data":"43a9678df2b718398f4982c87a5cf695ea7dc58a95a9487f3fb980e49f4c3ce6"} Jul 23 14:10:08.920653 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:08.920606 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" event={"ID":"2b5cc372-ff28-4b28-bd97-119a983da3da","Type":"ContainerStarted","Data":"b5a0f9f87ebdf952ac473ce61336189f759b2102f9ae969583e24c720a93c33c"} Jul 23 14:10:08.922219 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:08.922188 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4wft5" event={"ID":"22c3acf1-51b9-4a51-87f0-0e3266a2bf21","Type":"ContainerStarted","Data":"a4e3538f6943472d545c15411c081508e6e94576bd9c4707c069ec732cff21f0"} Jul 23 14:10:08.924624 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:08.924525 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" event={"ID":"973616e7-c535-4446-ab85-b5c397fa3601","Type":"ContainerStarted","Data":"83d483ef8fbfb14ea50ef8b695e45d3bc7d0efa7071ab5eb48be9cb39d67f79c"} Jul 23 14:10:08.928863 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:08.928106 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-123.ec2.internal" podStartSLOduration=2.928090022 podStartE2EDuration="2.928090022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:10:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:10:08.927363972 +0000 UTC m=+4.487192330" watchObservedRunningTime="2026-07-23 14:10:08.928090022 +0000 UTC m=+4.487918367" Jul 23 14:10:08.928863 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:08.928654 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4gxs4" event={"ID":"e648ed66-32b8-4ff9-8b04-fb537b96da10","Type":"ContainerStarted","Data":"c7f3516c2cb33b65b5bac1e5e5f6eaaf403216bba5d42f35850dc5100d041918"} Jul 23 14:10:08.931485 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:08.931460 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nplv4" event={"ID":"4d86c011-dcb3-4103-badd-9557cc53906a","Type":"ContainerStarted","Data":"cb8e44c95c6cde7feff492e524f4bc505d9120aa6d1f5f10af497d4b35ed8766"} Jul 23 14:10:08.935407 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:08.934990 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" event={"ID":"6ab12b46-de62-4b32-9811-ded59879930d","Type":"ContainerStarted","Data":"7d906e9f98e2099a9d5b1674920d0641da6c006eb7c7628efd682e87739ec28f"} Jul 23 14:10:08.938068 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:08.938043 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g4sv7" event={"ID":"13c16f90-fca6-420e-a294-6c75ba13ffa9","Type":"ContainerStarted","Data":"122af773f5009eb36a18fa628ffbd0679d1c7ae21570d3d4db9457e9a34d19a3"} Jul 23 14:10:08.943498 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:08.943476 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f97l5" event={"ID":"f0d66bd7-7a9d-48d2-904b-621a1eacc15e","Type":"ContainerStarted","Data":"dd513e08cd25fed7e959f231264e7aa6dd829a988bfda52df4fb7eacd8d424b2"} Jul 23 14:10:09.878269 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:09.878200 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:09.878726 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:09.878353 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmzs" podUID="c33444eb-d4db-46c0-a1fe-23a9191cd4f5" Jul 23 14:10:09.974369 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:09.974336 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal" event={"ID":"750ea20679ea3c97f137d0a145b9b20b","Type":"ContainerStarted","Data":"9e25c113135984122e3ec16458ee4cd908cd7825679534ccb25ed55631f9bb9f"} Jul 23 14:10:10.388225 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:10.388191 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret\") pod \"global-pull-secret-syncer-9rmzs\" (UID: \"c33444eb-d4db-46c0-a1fe-23a9191cd4f5\") " pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:10.388478 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:10.388438 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 14:10:10.388550 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:10.388499 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret podName:c33444eb-d4db-46c0-a1fe-23a9191cd4f5 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:14.38848085 +0000 UTC m=+9.948309170 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret") pod "global-pull-secret-syncer-9rmzs" (UID: "c33444eb-d4db-46c0-a1fe-23a9191cd4f5") : object "kube-system"/"original-pull-secret" not registered Jul 23 14:10:10.489260 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:10.489213 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs\") pod \"network-metrics-daemon-hhx5z\" (UID: \"d96c127f-a6dd-40c9-8dab-1a64c2af3f75\") " pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:10.489442 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:10.489424 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:10:10.489513 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:10.489499 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs podName:d96c127f-a6dd-40c9-8dab-1a64c2af3f75 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:14.489480804 +0000 UTC m=+10.049309126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs") pod "network-metrics-daemon-hhx5z" (UID: "d96c127f-a6dd-40c9-8dab-1a64c2af3f75") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:10:10.589743 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:10.589694 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vsqx\" (UniqueName: \"kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx\") pod \"network-check-target-r8nkd\" (UID: \"45236e03-e24a-4cc3-a8a3-814bc70d6b01\") " pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:10.590000 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:10.589848 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 14:10:10.590000 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:10.589867 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 14:10:10.590000 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:10.589879 2583 projected.go:196] Error preparing data for projected volume kube-api-access-5vsqx for pod openshift-network-diagnostics/network-check-target-r8nkd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:10:10.590000 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:10.589935 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx podName:45236e03-e24a-4cc3-a8a3-814bc70d6b01 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:14.589915496 +0000 UTC m=+10.149743834 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vsqx" (UniqueName: "kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx") pod "network-check-target-r8nkd" (UID: "45236e03-e24a-4cc3-a8a3-814bc70d6b01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:10:10.880063 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:10.879989 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:10.880557 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:10.880104 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:10.880557 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:10.880129 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8nkd" podUID="45236e03-e24a-4cc3-a8a3-814bc70d6b01" Jul 23 14:10:10.880557 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:10.880318 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhx5z" podUID="d96c127f-a6dd-40c9-8dab-1a64c2af3f75" Jul 23 14:10:11.879094 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:11.879031 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:11.879314 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:11.879172 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmzs" podUID="c33444eb-d4db-46c0-a1fe-23a9191cd4f5" Jul 23 14:10:12.879029 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:12.878943 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:12.879505 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:12.878948 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:12.879505 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:12.879074 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8nkd" podUID="45236e03-e24a-4cc3-a8a3-814bc70d6b01" Jul 23 14:10:12.879505 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:12.879170 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhx5z" podUID="d96c127f-a6dd-40c9-8dab-1a64c2af3f75" Jul 23 14:10:13.878592 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:13.878561 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:13.878763 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:13.878701 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmzs" podUID="c33444eb-d4db-46c0-a1fe-23a9191cd4f5" Jul 23 14:10:14.421250 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:14.421191 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret\") pod \"global-pull-secret-syncer-9rmzs\" (UID: \"c33444eb-d4db-46c0-a1fe-23a9191cd4f5\") " pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:14.421714 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:14.421368 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 14:10:14.421714 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:14.421454 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret podName:c33444eb-d4db-46c0-a1fe-23a9191cd4f5 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:22.421426908 +0000 UTC m=+17.981255239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret") pod "global-pull-secret-syncer-9rmzs" (UID: "c33444eb-d4db-46c0-a1fe-23a9191cd4f5") : object "kube-system"/"original-pull-secret" not registered Jul 23 14:10:14.522516 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:14.522486 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs\") pod \"network-metrics-daemon-hhx5z\" (UID: \"d96c127f-a6dd-40c9-8dab-1a64c2af3f75\") " pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:14.522694 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:14.522674 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:10:14.522758 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:14.522747 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs podName:d96c127f-a6dd-40c9-8dab-1a64c2af3f75 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:22.522726596 +0000 UTC m=+18.082554919 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs") pod "network-metrics-daemon-hhx5z" (UID: "d96c127f-a6dd-40c9-8dab-1a64c2af3f75") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:10:14.623505 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:14.623433 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vsqx\" (UniqueName: \"kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx\") pod \"network-check-target-r8nkd\" (UID: \"45236e03-e24a-4cc3-a8a3-814bc70d6b01\") " pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:14.623686 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:14.623642 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 14:10:14.623686 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:14.623672 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 14:10:14.623686 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:14.623686 2583 projected.go:196] Error preparing data for projected volume kube-api-access-5vsqx for pod openshift-network-diagnostics/network-check-target-r8nkd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:10:14.623857 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:14.623755 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx podName:45236e03-e24a-4cc3-a8a3-814bc70d6b01 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:22.623734257 +0000 UTC m=+18.183562596 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vsqx" (UniqueName: "kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx") pod "network-check-target-r8nkd" (UID: "45236e03-e24a-4cc3-a8a3-814bc70d6b01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:10:14.879422 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:14.878928 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:14.879422 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:14.879006 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8nkd" podUID="45236e03-e24a-4cc3-a8a3-814bc70d6b01" Jul 23 14:10:14.879422 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:14.879285 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:14.879422 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:14.879347 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhx5z" podUID="d96c127f-a6dd-40c9-8dab-1a64c2af3f75" Jul 23 14:10:15.878558 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:15.878517 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:15.879007 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:15.878706 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmzs" podUID="c33444eb-d4db-46c0-a1fe-23a9191cd4f5" Jul 23 14:10:16.878946 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:16.878862 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:16.879426 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:16.878993 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8nkd" podUID="45236e03-e24a-4cc3-a8a3-814bc70d6b01" Jul 23 14:10:16.879426 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:16.879093 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:16.879426 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:16.879211 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhx5z" podUID="d96c127f-a6dd-40c9-8dab-1a64c2af3f75" Jul 23 14:10:17.878434 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:17.878398 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:17.878620 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:17.878529 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmzs" podUID="c33444eb-d4db-46c0-a1fe-23a9191cd4f5" Jul 23 14:10:18.878406 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:18.878374 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:18.878716 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:18.878427 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:18.878716 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:18.878512 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhx5z" podUID="d96c127f-a6dd-40c9-8dab-1a64c2af3f75" Jul 23 14:10:18.878716 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:18.878621 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8nkd" podUID="45236e03-e24a-4cc3-a8a3-814bc70d6b01" Jul 23 14:10:19.878547 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:19.878508 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:19.879005 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:19.878613 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmzs" podUID="c33444eb-d4db-46c0-a1fe-23a9191cd4f5" Jul 23 14:10:20.878231 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:20.878198 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:20.878405 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:20.878351 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhx5z" podUID="d96c127f-a6dd-40c9-8dab-1a64c2af3f75" Jul 23 14:10:20.878467 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:20.878402 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:20.878525 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:20.878506 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8nkd" podUID="45236e03-e24a-4cc3-a8a3-814bc70d6b01" Jul 23 14:10:21.878734 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:21.878708 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:21.879136 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:21.878812 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmzs" podUID="c33444eb-d4db-46c0-a1fe-23a9191cd4f5" Jul 23 14:10:22.485105 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:22.485063 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret\") pod \"global-pull-secret-syncer-9rmzs\" (UID: \"c33444eb-d4db-46c0-a1fe-23a9191cd4f5\") " pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:22.485295 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:22.485211 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 14:10:22.485355 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:22.485300 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret podName:c33444eb-d4db-46c0-a1fe-23a9191cd4f5 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:38.485280953 +0000 UTC m=+34.045109277 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret") pod "global-pull-secret-syncer-9rmzs" (UID: "c33444eb-d4db-46c0-a1fe-23a9191cd4f5") : object "kube-system"/"original-pull-secret" not registered Jul 23 14:10:22.585465 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:22.585415 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs\") pod \"network-metrics-daemon-hhx5z\" (UID: \"d96c127f-a6dd-40c9-8dab-1a64c2af3f75\") " pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:22.585697 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:22.585574 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:10:22.585697 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:22.585647 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs podName:d96c127f-a6dd-40c9-8dab-1a64c2af3f75 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:38.585631445 +0000 UTC m=+34.145459766 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs") pod "network-metrics-daemon-hhx5z" (UID: "d96c127f-a6dd-40c9-8dab-1a64c2af3f75") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:10:22.686345 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:22.686311 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vsqx\" (UniqueName: \"kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx\") pod \"network-check-target-r8nkd\" (UID: \"45236e03-e24a-4cc3-a8a3-814bc70d6b01\") " pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:22.686532 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:22.686511 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 14:10:22.686605 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:22.686540 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 14:10:22.686605 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:22.686554 2583 projected.go:196] Error preparing data for projected volume kube-api-access-5vsqx for pod openshift-network-diagnostics/network-check-target-r8nkd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:10:22.686704 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:22.686619 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx podName:45236e03-e24a-4cc3-a8a3-814bc70d6b01 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:38.686600168 +0000 UTC m=+34.246428503 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vsqx" (UniqueName: "kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx") pod "network-check-target-r8nkd" (UID: "45236e03-e24a-4cc3-a8a3-814bc70d6b01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:10:22.879358 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:22.879283 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:22.879761 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:22.879296 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:22.879761 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:22.879415 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8nkd" podUID="45236e03-e24a-4cc3-a8a3-814bc70d6b01" Jul 23 14:10:22.879761 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:22.879518 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhx5z" podUID="d96c127f-a6dd-40c9-8dab-1a64c2af3f75" Jul 23 14:10:23.878709 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:23.878673 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:23.878898 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:23.878798 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmzs" podUID="c33444eb-d4db-46c0-a1fe-23a9191cd4f5" Jul 23 14:10:24.879039 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:24.879004 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:24.879528 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:24.879113 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8nkd" podUID="45236e03-e24a-4cc3-a8a3-814bc70d6b01" Jul 23 14:10:24.879528 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:24.879168 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:24.879528 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:24.879302 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhx5z" podUID="d96c127f-a6dd-40c9-8dab-1a64c2af3f75" Jul 23 14:10:25.878433 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:25.878400 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:25.878638 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:25.878506 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmzs" podUID="c33444eb-d4db-46c0-a1fe-23a9191cd4f5" Jul 23 14:10:26.879071 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:26.878913 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:26.879508 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:26.879094 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhx5z" podUID="d96c127f-a6dd-40c9-8dab-1a64c2af3f75" Jul 23 14:10:26.879508 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:26.879189 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:26.879508 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:26.879326 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8nkd" podUID="45236e03-e24a-4cc3-a8a3-814bc70d6b01" Jul 23 14:10:27.009646 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:27.009500 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f97l5" event={"ID":"f0d66bd7-7a9d-48d2-904b-621a1eacc15e","Type":"ContainerStarted","Data":"28b4c3e987129764288447ccd4b25e520ac5a9f00c33973dadec3e5f618b00be"} Jul 23 14:10:27.011045 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:27.011023 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" event={"ID":"2b5cc372-ff28-4b28-bd97-119a983da3da","Type":"ContainerStarted","Data":"9acf3b75054c6817b16a96ccd3df9fcfca274fe4675b4e6535b3ef443bae75da"} Jul 23 14:10:27.012497 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:27.012474 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" event={"ID":"973616e7-c535-4446-ab85-b5c397fa3601","Type":"ContainerStarted","Data":"dd104343849e9ad5a9a6eb1bad2f377aecd996126fd87d7be144b1cff2dd929f"} Jul 23 14:10:27.013860 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:27.013840 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4gxs4" event={"ID":"e648ed66-32b8-4ff9-8b04-fb537b96da10","Type":"ContainerStarted","Data":"d861d29cb7702a42a2b5bd63d7f160f05ac4f545354c93b986fbf454b8b5fb62"} Jul 23 14:10:27.015360 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:27.015337 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nplv4" event={"ID":"4d86c011-dcb3-4103-badd-9557cc53906a","Type":"ContainerStarted","Data":"1c263edf285443a3120fc0946cf05da1cc1872f21ee42b49d4b18094f75d4651"} Jul 23 14:10:27.016815 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:27.016604 2583 generic.go:356] "Generic (PLEG): container finished" podID="6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4" containerID="1f711092839fc3411cb4ca685fe829ab467e5d4b3c79fee5c63ec5d5daf2ba35" exitCode=0 Jul 23 14:10:27.016815 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:27.016642 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlpcq" event={"ID":"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4","Type":"ContainerDied","Data":"1f711092839fc3411cb4ca685fe829ab467e5d4b3c79fee5c63ec5d5daf2ba35"} Jul 23 14:10:27.018031 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:27.018010 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" event={"ID":"6ab12b46-de62-4b32-9811-ded59879930d","Type":"ContainerStarted","Data":"074abf5a705ca61a5b2c9cd7fe823b27366265b452982bad0a2ea98357e31c88"} Jul 23 14:10:27.019718 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:27.019401 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g4sv7" event={"ID":"13c16f90-fca6-420e-a294-6c75ba13ffa9","Type":"ContainerStarted","Data":"c18301a3ae11acd98c5254def29b9d22422fe653c514a6f54425d87f981c91e6"} Jul 23 14:10:27.025870 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:27.025799 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal" podStartSLOduration=21.025784368 podStartE2EDuration="21.025784368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:10:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:10:09.992315058 +0000 UTC m=+5.552143397" watchObservedRunningTime="2026-07-23 14:10:27.025784368 +0000 UTC m=+22.585612712" Jul 23 14:10:27.047667 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:27.047604 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-f97l5" podStartSLOduration=3.387350271 podStartE2EDuration="22.047583334s" totalImagesPullingTime="18.660233063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:10:27.026061528 +0000 UTC m=+22.585889871" watchObservedRunningTime="2026-07-23 14:10:27.047583334 +0000 UTC m=+22.607411678" Jul 23 14:10:27.065454 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:27.065402 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s9k8r" podStartSLOduration=3.429131974 podStartE2EDuration="22.06538753s" totalImagesPullingTime="18.636255556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:10:27.064817252 +0000 UTC m=+22.624645585" watchObservedRunningTime="2026-07-23 14:10:27.06538753 +0000 UTC m=+22.625215872" Jul 23 14:10:27.081210 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:27.081150 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nplv4" podStartSLOduration=7.165472508 podStartE2EDuration="22.081129024s" totalImagesPullingTime="14.915656516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:10:27.08041978 +0000 UTC m=+22.640248124" watchObservedRunningTime="2026-07-23 14:10:27.081129024 +0000 UTC m=+22.640957367" Jul 23 14:10:27.116432 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:27.116380 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g4sv7" podStartSLOduration=3.39987437 podStartE2EDuration="22.116361036s" totalImagesPullingTime="18.716486666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:10:27.115815118 +0000 UTC m=+22.675643461" watchObservedRunningTime="2026-07-23 14:10:27.116361036 +0000 UTC m=+22.676189378" Jul 23 14:10:27.145442 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:27.145385 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4gxs4" podStartSLOduration=3.490776385 podStartE2EDuration="22.145368636s" totalImagesPullingTime="18.654592251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:10:27.145092505 +0000 UTC m=+22.704920846" watchObservedRunningTime="2026-07-23 14:10:27.145368636 +0000 UTC m=+22.705196979" Jul 23 14:10:27.878507 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:27.878480 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:27.878657 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:27.878571 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmzs" podUID="c33444eb-d4db-46c0-a1fe-23a9191cd4f5" Jul 23 14:10:28.025548 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:28.025509 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" event={"ID":"973616e7-c535-4446-ab85-b5c397fa3601","Type":"ContainerStarted","Data":"447c9d5873d95afb64a37fd7e7afa4f4d0771e5b34824cc70328567f3a424160"} Jul 23 14:10:28.026499 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:28.025611 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" event={"ID":"973616e7-c535-4446-ab85-b5c397fa3601","Type":"ContainerStarted","Data":"09a92c059131cddfe6b9d32cce106dae200655bf907ab900d9e3513c98ec5de6"} Jul 23 14:10:28.026499 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:28.025665 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" event={"ID":"973616e7-c535-4446-ab85-b5c397fa3601","Type":"ContainerStarted","Data":"13bef48224ff503cf3b991b7d6254ac379753816f90200a0062fe2269c93b31f"} Jul 23 14:10:28.026499 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:28.025713 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" event={"ID":"973616e7-c535-4446-ab85-b5c397fa3601","Type":"ContainerStarted","Data":"801cff0ecbba80e80515c694679dcae835fb9f0cf7b37cd41820214a2a3375b3"} Jul 23 14:10:28.026499 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:28.025759 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" event={"ID":"973616e7-c535-4446-ab85-b5c397fa3601","Type":"ContainerStarted","Data":"dc1655b15ce05233e8a5741da3a3d6b99a5615293e4ab8afbcfb994a630e3319"} Jul 23 14:10:28.326192 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:28.326154 2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 23 14:10:28.380203 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:28.380166 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4gxs4" Jul 23 14:10:28.380806 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:28.380783 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4gxs4" Jul 23 14:10:28.815525 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:28.815368 2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T14:10:28.326177762Z","UUID":"f5f0055e-2edf-4a02-9075-e575b1da60db","Handler":null,"Name":"","Endpoint":""} Jul 23 14:10:28.816774 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:28.816757 2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 23 14:10:28.816865 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:28.816809 2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 23 14:10:28.878560 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:28.878527 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:28.878887 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:28.878527 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:28.878887 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:28.878669 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8nkd" podUID="45236e03-e24a-4cc3-a8a3-814bc70d6b01" Jul 23 14:10:28.878887 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:28.878766 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhx5z" podUID="d96c127f-a6dd-40c9-8dab-1a64c2af3f75" Jul 23 14:10:29.029634 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:29.029595 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4wft5" event={"ID":"22c3acf1-51b9-4a51-87f0-0e3266a2bf21","Type":"ContainerStarted","Data":"dfd4ad27e605f0f71031283d9baec3e7090528bf93cc3dcc83831fb096862e3a"} Jul 23 14:10:29.031669 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:29.031640 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" event={"ID":"6ab12b46-de62-4b32-9811-ded59879930d","Type":"ContainerStarted","Data":"de23c6bf3c6d51a70137e83b77485bada94a442b9a4c68d9d869155b4477b144"} Jul 23 14:10:29.031798 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:29.031783 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4gxs4" Jul 23 14:10:29.032298 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:29.032284 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4gxs4" Jul 23 14:10:29.045673 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:29.045626 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4wft5" podStartSLOduration=5.419923175 podStartE2EDuration="24.045610626s" totalImagesPullingTime="18.625687451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:10:29.045439458 +0000 UTC m=+24.605267783" watchObservedRunningTime="2026-07-23 14:10:29.045610626 +0000 UTC m=+24.605438967" Jul 23 14:10:29.879276 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:29.879184 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:29.879468 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:29.879335 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmzs" podUID="c33444eb-d4db-46c0-a1fe-23a9191cd4f5" Jul 23 14:10:30.036275 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:30.036012 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" event={"ID":"6ab12b46-de62-4b32-9811-ded59879930d","Type":"ContainerStarted","Data":"a512a8ef8af8d511b69fb65e60c35bc8b304c980aa49fe7d1d651cc73a3b551a"} Jul 23 14:10:30.039618 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:30.039589 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" event={"ID":"973616e7-c535-4446-ab85-b5c397fa3601","Type":"ContainerStarted","Data":"c877e80b71c0c21adcac363c91bd4724bd050eb944aea0d6d2214743293a8d5e"} Jul 23 14:10:30.878905 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:30.878700 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:30.879065 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:30.878744 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:30.879065 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:30.879004 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8nkd" podUID="45236e03-e24a-4cc3-a8a3-814bc70d6b01" Jul 23 14:10:30.879065 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:30.879050 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhx5z" podUID="d96c127f-a6dd-40c9-8dab-1a64c2af3f75" Jul 23 14:10:31.878189 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:31.878159 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:31.878608 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:31.878303 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmzs" podUID="c33444eb-d4db-46c0-a1fe-23a9191cd4f5" Jul 23 14:10:32.878311 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:32.878273 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:32.878734 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:32.878278 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:32.878734 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:32.878394 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8nkd" podUID="45236e03-e24a-4cc3-a8a3-814bc70d6b01" Jul 23 14:10:32.878734 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:32.878502 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhx5z" podUID="d96c127f-a6dd-40c9-8dab-1a64c2af3f75" Jul 23 14:10:33.878723 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:33.878548 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:33.879394 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:33.878791 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmzs" podUID="c33444eb-d4db-46c0-a1fe-23a9191cd4f5" Jul 23 14:10:34.050779 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:34.050741 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" event={"ID":"973616e7-c535-4446-ab85-b5c397fa3601","Type":"ContainerStarted","Data":"cace7fe8c60f9c367f828a5b0cf2ffe46a33b317a296cf980941d59d530786aa"} Jul 23 14:10:34.050988 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:34.050969 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:34.052502 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:34.052473 2583 generic.go:356] "Generic (PLEG): container finished" podID="6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4" containerID="f50741c450d41d6bdbf457af947857134a61f95ee8ef8962d34ed985c9688ce0" exitCode=0 Jul 23 14:10:34.052619 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:34.052507 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlpcq" event={"ID":"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4","Type":"ContainerDied","Data":"f50741c450d41d6bdbf457af947857134a61f95ee8ef8962d34ed985c9688ce0"} Jul 23 14:10:34.066767 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:34.066728 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:34.082731 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:34.082679 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" podStartSLOduration=10.358830676 podStartE2EDuration="29.082663974s" totalImagesPullingTime="18.723833298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:10:34.082402089 +0000 UTC m=+29.642230432" watchObservedRunningTime="2026-07-23 14:10:34.082663974 +0000 UTC m=+29.642492316" Jul 23 14:10:34.082929 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:34.082909 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-brfqk" podStartSLOduration=7.991293117 podStartE2EDuration="29.082904227s" totalImagesPullingTime="21.09161111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:10:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:10:30.055470444 +0000 UTC m=+25.615298787" watchObservedRunningTime="2026-07-23 14:10:34.082904227 +0000 UTC m=+29.642732580" Jul 23 14:10:34.879832 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:34.879800 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:34.880420 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:34.879892 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:34.880420 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:34.879910 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8nkd" podUID="45236e03-e24a-4cc3-a8a3-814bc70d6b01" Jul 23 14:10:34.880420 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:34.880020 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhx5z" podUID="d96c127f-a6dd-40c9-8dab-1a64c2af3f75" Jul 23 14:10:35.055222 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:35.055197 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:35.055380 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:35.055272 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:35.071701 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:35.071667 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:10:35.253994 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:35.253966 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9rmzs"] Jul 23 14:10:35.254110 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:35.254091 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:35.254213 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:35.254192 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmzs" podUID="c33444eb-d4db-46c0-a1fe-23a9191cd4f5" Jul 23 14:10:35.256824 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:35.256802 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hhx5z"] Jul 23 14:10:35.256932 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:35.256909 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:35.257036 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:35.257012 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhx5z" podUID="d96c127f-a6dd-40c9-8dab-1a64c2af3f75" Jul 23 14:10:35.257535 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:35.257504 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r8nkd"] Jul 23 14:10:35.257617 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:35.257600 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:35.257699 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:35.257674 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8nkd" podUID="45236e03-e24a-4cc3-a8a3-814bc70d6b01" Jul 23 14:10:36.059039 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:36.059005 2583 generic.go:356] "Generic (PLEG): container finished" podID="6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4" containerID="edb3ebd3d665fa66497d7a32ff5101a7c6abf03c90aedf750768f500d0a91d44" exitCode=0 Jul 23 14:10:36.059396 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:36.059084 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlpcq" event={"ID":"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4","Type":"ContainerDied","Data":"edb3ebd3d665fa66497d7a32ff5101a7c6abf03c90aedf750768f500d0a91d44"} Jul 23 14:10:36.878893 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:36.878858 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:36.878893 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:36.878878 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:36.879147 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:36.878858 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:36.879147 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:36.878974 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhx5z" podUID="d96c127f-a6dd-40c9-8dab-1a64c2af3f75" Jul 23 14:10:36.879147 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:36.879051 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8nkd" podUID="45236e03-e24a-4cc3-a8a3-814bc70d6b01" Jul 23 14:10:36.879147 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:36.879112 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmzs" podUID="c33444eb-d4db-46c0-a1fe-23a9191cd4f5" Jul 23 14:10:38.496491 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:38.496300 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret\") pod \"global-pull-secret-syncer-9rmzs\" (UID: \"c33444eb-d4db-46c0-a1fe-23a9191cd4f5\") " pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:38.496491 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:38.496438 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 14:10:38.496906 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:38.496550 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret podName:c33444eb-d4db-46c0-a1fe-23a9191cd4f5 nodeName:}" failed. No retries permitted until 2026-07-23 14:11:10.496533737 +0000 UTC m=+66.056362057 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret") pod "global-pull-secret-syncer-9rmzs" (UID: "c33444eb-d4db-46c0-a1fe-23a9191cd4f5") : object "kube-system"/"original-pull-secret" not registered Jul 23 14:10:38.597400 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:38.597360 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs\") pod \"network-metrics-daemon-hhx5z\" (UID: \"d96c127f-a6dd-40c9-8dab-1a64c2af3f75\") " pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:38.597591 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:38.597521 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:10:38.597591 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:38.597590 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs podName:d96c127f-a6dd-40c9-8dab-1a64c2af3f75 nodeName:}" failed. No retries permitted until 2026-07-23 14:11:10.597574144 +0000 UTC m=+66.157402468 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs") pod "network-metrics-daemon-hhx5z" (UID: "d96c127f-a6dd-40c9-8dab-1a64c2af3f75") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 14:10:38.698249 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:38.698197 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vsqx\" (UniqueName: \"kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx\") pod \"network-check-target-r8nkd\" (UID: \"45236e03-e24a-4cc3-a8a3-814bc70d6b01\") " pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:38.698418 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:38.698360 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 14:10:38.698418 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:38.698383 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 14:10:38.698418 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:38.698394 2583 projected.go:196] Error preparing data for projected volume kube-api-access-5vsqx for pod openshift-network-diagnostics/network-check-target-r8nkd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:10:38.698525 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:38.698444 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx podName:45236e03-e24a-4cc3-a8a3-814bc70d6b01 nodeName:}" failed. No retries permitted until 2026-07-23 14:11:10.698430963 +0000 UTC m=+66.258259283 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vsqx" (UniqueName: "kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx") pod "network-check-target-r8nkd" (UID: "45236e03-e24a-4cc3-a8a3-814bc70d6b01") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 14:10:38.879212 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:38.879176 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:38.879212 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:38.879208 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:38.879437 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:38.879180 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:38.879437 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:38.879327 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8nkd" podUID="45236e03-e24a-4cc3-a8a3-814bc70d6b01" Jul 23 14:10:38.879437 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:38.879376 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9rmzs" podUID="c33444eb-d4db-46c0-a1fe-23a9191cd4f5" Jul 23 14:10:38.879531 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:38.879434 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhx5z" podUID="d96c127f-a6dd-40c9-8dab-1a64c2af3f75" Jul 23 14:10:39.067897 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.067861 2583 generic.go:356] "Generic (PLEG): container finished" podID="6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4" containerID="b08185fc90a36f42154ed4a1b9f2c3d202aac9e3553d2f518f2ef6e6ea3b9200" exitCode=0 Jul 23 14:10:39.068053 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.067893 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlpcq" event={"ID":"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4","Type":"ContainerDied","Data":"b08185fc90a36f42154ed4a1b9f2c3d202aac9e3553d2f518f2ef6e6ea3b9200"} Jul 23 14:10:39.757003 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.756977 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeReady" Jul 23 14:10:39.757410 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.757137 2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 23 14:10:39.810813 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.810781 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75c7487ddc-74nwt"] Jul 23 14:10:39.814957 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.814942 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:39.817320 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.817297 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 23 14:10:39.817405 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.817346 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7876l\"" Jul 23 14:10:39.817621 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.817605 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 23 14:10:39.818299 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.818280 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 23 14:10:39.824453 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.824415 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 23 14:10:39.827723 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.826951 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ffmql"] Jul 23 14:10:39.832570 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.832547 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-l4sls"] Jul 23 14:10:39.832769 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.832665 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ffmql" Jul 23 14:10:39.836536 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.836519 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-kf559"] Jul 23 14:10:39.836648 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.836634 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-l4sls" Jul 23 14:10:39.840185 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.840166 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gkbtz"] Jul 23 14:10:39.840406 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.840387 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-kf559" Jul 23 14:10:39.843727 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.843707 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 23 14:10:39.843846 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.843827 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75c7487ddc-74nwt"] Jul 23 14:10:39.843974 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.843956 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 23 14:10:39.844049 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.843973 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9"] Jul 23 14:10:39.844049 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.843982 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 23 14:10:39.844144 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.843891 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gkbtz" Jul 23 14:10:39.844254 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.844219 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 23 14:10:39.844326 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.844316 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 23 14:10:39.844424 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.843983 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-hs9mk\"" Jul 23 14:10:39.844816 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.843925 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 23 14:10:39.845133 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.845112 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7vr5z\"" Jul 23 14:10:39.845738 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.845643 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 23 14:10:39.846764 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.846564 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 23 14:10:39.846890 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.846783 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 23 14:10:39.847547 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.847527 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 23 14:10:39.848505 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.848489 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-v2s79\"" Jul 23 14:10:39.848605 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.848553 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-695b7bcf8d-qtpwr"] Jul 23 14:10:39.848665 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.848551 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lxrmg\"" Jul 23 14:10:39.848931 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.848915 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9" Jul 23 14:10:39.851478 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.851403 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 23 14:10:39.851546 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.851507 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 23 14:10:39.851629 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.851609 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 23 14:10:39.852122 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.852001 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 23 14:10:39.852122 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.852061 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 23 14:10:39.852584 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.852274 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8msz5\"" Jul 23 14:10:39.852808 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.852789 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-thrtj"] Jul 23 14:10:39.853395 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.853374 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 23 14:10:39.853395 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.853391 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 23 14:10:39.853662 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.853647 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:39.856855 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.856832 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 23 14:10:39.856967 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.856859 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 23 14:10:39.857061 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.856832 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-99t4g\"" Jul 23 14:10:39.857380 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.857360 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 23 14:10:39.858644 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.857366 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6c44f"] Jul 23 14:10:39.858644 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.857435 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-thrtj" Jul 23 14:10:39.858644 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.857552 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 23 14:10:39.858644 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.858007 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 23 14:10:39.858644 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.858188 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 23 14:10:39.858644 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.858367 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 23 14:10:39.860200 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.860183 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 23 14:10:39.860321 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.860257 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 23 14:10:39.860564 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.860411 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 23 14:10:39.861369 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.861347 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 23 14:10:39.861591 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.861568 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n7bbn"] Jul 23 14:10:39.861714 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.861601 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8fx25\"" Jul 23 14:10:39.861884 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.861867 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6c44f" Jul 23 14:10:39.864451 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.864434 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wtwlc\"" Jul 23 14:10:39.864553 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.864464 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 23 14:10:39.864553 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.864548 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 23 14:10:39.865134 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.865104 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ffmql"] Jul 23 14:10:39.865301 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.865140 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-l4sls"] Jul 23 14:10:39.865301 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.865158 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gkbtz"] Jul 23 14:10:39.865301 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.865183 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-kf559"] Jul 23 14:10:39.865596 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.865576 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n7bbn" Jul 23 14:10:39.873060 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.872287 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 23 14:10:39.873060 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.872914 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 23 14:10:39.873401 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.873381 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 23 14:10:39.873696 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.873675 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 23 14:10:39.874374 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.874355 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-cwkqc\"" Jul 23 14:10:39.874979 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.874945 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 23 14:10:39.875201 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.875186 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9"] Jul 23 14:10:39.876930 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.876910 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-thrtj"] Jul 23 14:10:39.877676 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.877661 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-695b7bcf8d-qtpwr"] Jul 23 14:10:39.879770 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.879751 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6c44f"] Jul 23 14:10:39.882537 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.882518 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-fjlpb"] Jul 23 14:10:39.886308 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.886289 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-fjlpb" Jul 23 14:10:39.888595 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.888574 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-dtqtx"] Jul 23 14:10:39.891276 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.891259 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 14:10:39.891553 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.891535 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 14:10:39.891998 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.891980 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5bqgn"] Jul 23 14:10:39.892090 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.892073 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-c2m67\"" Jul 23 14:10:39.892147 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.892083 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtqtx" Jul 23 14:10:39.894708 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.894691 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 23 14:10:39.895412 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.895392 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5bqgn" Jul 23 14:10:39.895899 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.895881 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-gvwtb\"" Jul 23 14:10:39.895998 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.895881 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 23 14:10:39.896745 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.896725 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n7bbn"] Jul 23 14:10:39.898021 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.897947 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 23 14:10:39.898116 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.898035 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ftn7g\"" Jul 23 14:10:39.898116 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.898049 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 23 14:10:39.898394 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.898308 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 23 14:10:39.900636 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.900588 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-fjlpb"] Jul 23 14:10:39.905843 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.905816 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:39.907596 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.907577 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/78668789-e865-4b71-a251-7a81549d1442-snapshots\") pod \"insights-operator-555d9d7885-kf559\" (UID: \"78668789-e865-4b71-a251-7a81549d1442\") " pod="openshift-insights/insights-operator-555d9d7885-kf559" Jul 23 14:10:39.907676 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.907616 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/78668789-e865-4b71-a251-7a81549d1442-serving-cert\") pod \"insights-operator-555d9d7885-kf559\" (UID: \"78668789-e865-4b71-a251-7a81549d1442\") " pod="openshift-insights/insights-operator-555d9d7885-kf559" Jul 23 14:10:39.907676 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.907644 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/26f702c8-73af-4693-95ac-2c03483b6116-trusted-ca\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:39.907676 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.907671 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/26f702c8-73af-4693-95ac-2c03483b6116-installation-pull-secrets\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:39.907822 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.907702 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b0bbf318-4828-4843-867e-438dbf40fae0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-l4sls\" (UID: \"b0bbf318-4828-4843-867e-438dbf40fae0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-l4sls" Jul 23 14:10:39.907988 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.907965 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqj45\" (UniqueName: \"kubernetes.io/projected/f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4-kube-api-access-xqj45\") pod \"service-ca-operator-5bcbc94c78-gkbtz\" (UID: \"f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gkbtz" Jul 23 14:10:39.908093 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.908006 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78668789-e865-4b71-a251-7a81549d1442-service-ca-bundle\") pod \"insights-operator-555d9d7885-kf559\" (UID: \"78668789-e865-4b71-a251-7a81549d1442\") " pod="openshift-insights/insights-operator-555d9d7885-kf559" Jul 23 14:10:39.908093 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.908034 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgmqg\" (UniqueName: \"kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-kube-api-access-hgmqg\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:39.908093 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.908092 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7jdr\" (UniqueName: \"kubernetes.io/projected/b0bbf318-4828-4843-867e-438dbf40fae0-kube-api-access-n7jdr\") pod \"cluster-samples-operator-79b7c55f87-l4sls\" (UID: \"b0bbf318-4828-4843-867e-438dbf40fae0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-l4sls" Jul 23 14:10:39.908292 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.908111 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkpcc\" (UniqueName: \"kubernetes.io/projected/78668789-e865-4b71-a251-7a81549d1442-kube-api-access-jkpcc\") pod \"insights-operator-555d9d7885-kf559\" (UID: \"78668789-e865-4b71-a251-7a81549d1442\") " pod="openshift-insights/insights-operator-555d9d7885-kf559" Jul 23 14:10:39.908292 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.908135 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/26f702c8-73af-4693-95ac-2c03483b6116-image-registry-private-configuration\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:39.908292 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.908163 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:39.908292 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.908282 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/26f702c8-73af-4693-95ac-2c03483b6116-registry-certificates\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:39.908519 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.908317 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4-config\") pod \"service-ca-operator-5bcbc94c78-gkbtz\" (UID: \"f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gkbtz" Jul 23 14:10:39.908519 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.908350 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5c9f\" (UniqueName: \"kubernetes.io/projected/7605d097-5e0f-4270-a9f9-50e11e897253-kube-api-access-g5c9f\") pod \"volume-data-source-validator-78cf4c6f6-ffmql\" (UID: \"7605d097-5e0f-4270-a9f9-50e11e897253\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ffmql" Jul 23 14:10:39.908519 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.908376 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/26f702c8-73af-4693-95ac-2c03483b6116-ca-trust-extracted\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:39.908519 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.908442 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-bound-sa-token\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:39.909455 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.908767 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78668789-e865-4b71-a251-7a81549d1442-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-kf559\" (UID: \"78668789-e865-4b71-a251-7a81549d1442\") " pod="openshift-insights/insights-operator-555d9d7885-kf559" Jul 23 14:10:39.909455 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.908805 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78668789-e865-4b71-a251-7a81549d1442-tmp\") pod \"insights-operator-555d9d7885-kf559\" (UID: \"78668789-e865-4b71-a251-7a81549d1442\") " pod="openshift-insights/insights-operator-555d9d7885-kf559" Jul 23 14:10:39.909455 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.908834 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4-serving-cert\") pod \"service-ca-operator-5bcbc94c78-gkbtz\" (UID: \"f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gkbtz" Jul 23 14:10:39.910652 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.910631 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-dtqtx"] Jul 23 14:10:39.912599 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:39.912578 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5bqgn"] Jul 23 14:10:40.010082 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.009976 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9e8f751-c4aa-4c3b-a110-de695a817c76-service-ca-bundle\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:40.010082 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010063 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/26f702c8-73af-4693-95ac-2c03483b6116-registry-certificates\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:40.010344 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010092 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4-config\") pod \"service-ca-operator-5bcbc94c78-gkbtz\" (UID: \"f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gkbtz" Jul 23 14:10:40.010344 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010203 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4ff440c-7a41-4adf-956d-8f2d35b0889f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dtqtx\" (UID: \"a4ff440c-7a41-4adf-956d-8f2d35b0889f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtqtx" Jul 23 14:10:40.010344 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010253 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-bound-sa-token\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:40.010344 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010284 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-tmp-dir\") pod \"dns-default-6c44f\" (UID: \"d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b\") " pod="openshift-dns/dns-default-6c44f" Jul 23 14:10:40.010344 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010317 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78668789-e865-4b71-a251-7a81549d1442-tmp\") pod \"insights-operator-555d9d7885-kf559\" (UID: \"78668789-e865-4b71-a251-7a81549d1442\") " pod="openshift-insights/insights-operator-555d9d7885-kf559" Jul 23 14:10:40.010344 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010345 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddnlt\" (UniqueName: \"kubernetes.io/projected/368b9cb3-9200-489d-b70c-832898906791-kube-api-access-ddnlt\") pod \"console-operator-565b7b569d-thrtj\" (UID: \"368b9cb3-9200-489d-b70c-832898906791\") " pod="openshift-console-operator/console-operator-565b7b569d-thrtj" Jul 23 14:10:40.010618 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010377 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/368b9cb3-9200-489d-b70c-832898906791-trusted-ca\") pod \"console-operator-565b7b569d-thrtj\" (UID: \"368b9cb3-9200-489d-b70c-832898906791\") " pod="openshift-console-operator/console-operator-565b7b569d-thrtj" Jul 23 14:10:40.010618 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010413 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4-serving-cert\") pod \"service-ca-operator-5bcbc94c78-gkbtz\" (UID: \"f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gkbtz" Jul 23 14:10:40.010618 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010437 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9667\" (UniqueName: \"kubernetes.io/projected/6fca46de-acd7-4911-8fc7-3dcefade899e-kube-api-access-w9667\") pod \"kube-storage-version-migrator-operator-7658d9b749-n7bbn\" (UID: \"6fca46de-acd7-4911-8fc7-3dcefade899e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n7bbn" Jul 23 14:10:40.010618 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010468 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mxn4\" (UniqueName: \"kubernetes.io/projected/e9e8f751-c4aa-4c3b-a110-de695a817c76-kube-api-access-2mxn4\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:40.010618 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010501 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/26f702c8-73af-4693-95ac-2c03483b6116-trusted-ca\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:40.010618 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010527 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-stats-auth\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:40.010618 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010555 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b0bbf318-4828-4843-867e-438dbf40fae0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-l4sls\" (UID: \"b0bbf318-4828-4843-867e-438dbf40fae0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-l4sls" Jul 23 14:10:40.010618 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010580 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqj45\" (UniqueName: \"kubernetes.io/projected/f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4-kube-api-access-xqj45\") pod \"service-ca-operator-5bcbc94c78-gkbtz\" (UID: \"f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gkbtz" Jul 23 14:10:40.010618 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010608 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/368b9cb3-9200-489d-b70c-832898906791-config\") pod \"console-operator-565b7b569d-thrtj\" (UID: \"368b9cb3-9200-489d-b70c-832898906791\") " pod="openshift-console-operator/console-operator-565b7b569d-thrtj" Jul 23 14:10:40.010618 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010611 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4-config\") pod \"service-ca-operator-5bcbc94c78-gkbtz\" (UID: \"f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gkbtz" Jul 23 14:10:40.010975 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010637 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78668789-e865-4b71-a251-7a81549d1442-service-ca-bundle\") pod \"insights-operator-555d9d7885-kf559\" (UID: \"78668789-e865-4b71-a251-7a81549d1442\") " pod="openshift-insights/insights-operator-555d9d7885-kf559" Jul 23 14:10:40.010975 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010666 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgmqg\" (UniqueName: \"kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-kube-api-access-hgmqg\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:40.010975 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010695 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkpcc\" (UniqueName: \"kubernetes.io/projected/78668789-e865-4b71-a251-7a81549d1442-kube-api-access-jkpcc\") pod \"insights-operator-555d9d7885-kf559\" (UID: \"78668789-e865-4b71-a251-7a81549d1442\") " pod="openshift-insights/insights-operator-555d9d7885-kf559" Jul 23 14:10:40.010975 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010711 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/26f702c8-73af-4693-95ac-2c03483b6116-registry-certificates\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:40.010975 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010718 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:40.010975 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010764 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/26f702c8-73af-4693-95ac-2c03483b6116-image-registry-private-configuration\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:40.010975 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010791 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-config-volume\") pod \"dns-default-6c44f\" (UID: \"d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b\") " pod="openshift-dns/dns-default-6c44f" Jul 23 14:10:40.010975 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.010805 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 14:10:40.010975 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010815 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d1e7c79-7575-481a-af5b-b3371a5e317d-cert\") pod \"ingress-canary-5bqgn\" (UID: \"0d1e7c79-7575-481a-af5b-b3371a5e317d\") " pod="openshift-ingress-canary/ingress-canary-5bqgn" Jul 23 14:10:40.010975 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.010840 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-metrics-certs\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:40.010975 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.010820 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c7487ddc-74nwt: secret "image-registry-tls" not found Jul 23 14:10:40.010975 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.010942 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls podName:26f702c8-73af-4693-95ac-2c03483b6116 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:40.510922456 +0000 UTC m=+36.070750794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls") pod "image-registry-75c7487ddc-74nwt" (UID: "26f702c8-73af-4693-95ac-2c03483b6116") : secret "image-registry-tls" not found Jul 23 14:10:40.011509 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.011173 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 14:10:40.011509 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.011225 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0bbf318-4828-4843-867e-438dbf40fae0-samples-operator-tls podName:b0bbf318-4828-4843-867e-438dbf40fae0 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:40.511205316 +0000 UTC m=+36.071033653 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b0bbf318-4828-4843-867e-438dbf40fae0-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-l4sls" (UID: "b0bbf318-4828-4843-867e-438dbf40fae0") : secret "samples-operator-tls" not found Jul 23 14:10:40.011509 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.011388 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78668789-e865-4b71-a251-7a81549d1442-service-ca-bundle\") pod \"insights-operator-555d9d7885-kf559\" (UID: \"78668789-e865-4b71-a251-7a81549d1442\") " pod="openshift-insights/insights-operator-555d9d7885-kf559" Jul 23 14:10:40.011652 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.011627 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv5p4\" (UniqueName: \"kubernetes.io/projected/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-kube-api-access-xv5p4\") pod \"dns-default-6c44f\" (UID: \"d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b\") " pod="openshift-dns/dns-default-6c44f" Jul 23 14:10:40.011708 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.011681 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5c9f\" (UniqueName: \"kubernetes.io/projected/7605d097-5e0f-4270-a9f9-50e11e897253-kube-api-access-g5c9f\") pod \"volume-data-source-validator-78cf4c6f6-ffmql\" (UID: \"7605d097-5e0f-4270-a9f9-50e11e897253\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ffmql" Jul 23 14:10:40.011763 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.011716 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpjzb\" (UniqueName: \"kubernetes.io/projected/9922460a-be5a-46c1-a7dd-0c97f00db59d-kube-api-access-zpjzb\") pod \"network-check-source-7bc5b6bf85-fjlpb\" (UID: \"9922460a-be5a-46c1-a7dd-0c97f00db59d\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-fjlpb" Jul 23 14:10:40.011872 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.011850 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4q64\" (UniqueName: \"kubernetes.io/projected/0d1e7c79-7575-481a-af5b-b3371a5e317d-kube-api-access-n4q64\") pod \"ingress-canary-5bqgn\" (UID: \"0d1e7c79-7575-481a-af5b-b3371a5e317d\") " pod="openshift-ingress-canary/ingress-canary-5bqgn" Jul 23 14:10:40.011932 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.011912 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78668789-e865-4b71-a251-7a81549d1442-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-kf559\" (UID: \"78668789-e865-4b71-a251-7a81549d1442\") " pod="openshift-insights/insights-operator-555d9d7885-kf559" Jul 23 14:10:40.011970 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.011953 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6fca46de-acd7-4911-8fc7-3dcefade899e-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-n7bbn\" (UID: \"6fca46de-acd7-4911-8fc7-3dcefade899e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n7bbn" Jul 23 14:10:40.012058 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.012042 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78668789-e865-4b71-a251-7a81549d1442-tmp\") pod \"insights-operator-555d9d7885-kf559\" (UID: \"78668789-e865-4b71-a251-7a81549d1442\") " pod="openshift-insights/insights-operator-555d9d7885-kf559" Jul 23 14:10:40.012109 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.012051 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-metrics-tls\") pod \"dns-default-6c44f\" (UID: \"d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b\") " pod="openshift-dns/dns-default-6c44f" Jul 23 14:10:40.012161 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.012103 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/26f702c8-73af-4693-95ac-2c03483b6116-trusted-ca\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:40.012161 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.012111 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/26f702c8-73af-4693-95ac-2c03483b6116-ca-trust-extracted\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:40.012285 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.012182 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/78668789-e865-4b71-a251-7a81549d1442-snapshots\") pod \"insights-operator-555d9d7885-kf559\" (UID: \"78668789-e865-4b71-a251-7a81549d1442\") " pod="openshift-insights/insights-operator-555d9d7885-kf559" Jul 23 14:10:40.012285 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.012219 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/78668789-e865-4b71-a251-7a81549d1442-serving-cert\") pod \"insights-operator-555d9d7885-kf559\" (UID: \"78668789-e865-4b71-a251-7a81549d1442\") " pod="openshift-insights/insights-operator-555d9d7885-kf559" Jul 23 14:10:40.012405 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.012347 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/26f702c8-73af-4693-95ac-2c03483b6116-installation-pull-secrets\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:40.012405 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.012378 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w79zb\" (UniqueName: \"kubernetes.io/projected/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-kube-api-access-w79zb\") pod \"cluster-monitoring-operator-76cf8966f8-2cxf9\" (UID: \"b7938e65-26db-4bf0-9cdd-eb340fba0ba7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9" Jul 23 14:10:40.012506 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.012438 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-2cxf9\" (UID: \"b7938e65-26db-4bf0-9cdd-eb340fba0ba7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9" Jul 23 14:10:40.012506 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.012453 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/26f702c8-73af-4693-95ac-2c03483b6116-ca-trust-extracted\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:40.012506 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.012467 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2cxf9\" (UID: \"b7938e65-26db-4bf0-9cdd-eb340fba0ba7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9" Jul 23 14:10:40.012649 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.012511 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6fca46de-acd7-4911-8fc7-3dcefade899e-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-n7bbn\" (UID: \"6fca46de-acd7-4911-8fc7-3dcefade899e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n7bbn" Jul 23 14:10:40.012704 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.012668 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/78668789-e865-4b71-a251-7a81549d1442-snapshots\") pod \"insights-operator-555d9d7885-kf559\" (UID: \"78668789-e865-4b71-a251-7a81549d1442\") " pod="openshift-insights/insights-operator-555d9d7885-kf559" Jul 23 14:10:40.012758 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.012704 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78668789-e865-4b71-a251-7a81549d1442-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-kf559\" (UID: \"78668789-e865-4b71-a251-7a81549d1442\") " pod="openshift-insights/insights-operator-555d9d7885-kf559" Jul 23 14:10:40.012758 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.012749 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-default-certificate\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:40.012862 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.012794 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7jdr\" (UniqueName: \"kubernetes.io/projected/b0bbf318-4828-4843-867e-438dbf40fae0-kube-api-access-n7jdr\") pod \"cluster-samples-operator-79b7c55f87-l4sls\" (UID: \"b0bbf318-4828-4843-867e-438dbf40fae0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-l4sls" Jul 23 14:10:40.012862 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.012819 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/368b9cb3-9200-489d-b70c-832898906791-serving-cert\") pod \"console-operator-565b7b569d-thrtj\" (UID: \"368b9cb3-9200-489d-b70c-832898906791\") " pod="openshift-console-operator/console-operator-565b7b569d-thrtj" Jul 23 14:10:40.012862 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.012845 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a4ff440c-7a41-4adf-956d-8f2d35b0889f-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-dtqtx\" (UID: \"a4ff440c-7a41-4adf-956d-8f2d35b0889f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtqtx" Jul 23 14:10:40.016443 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.016307 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/78668789-e865-4b71-a251-7a81549d1442-serving-cert\") pod \"insights-operator-555d9d7885-kf559\" (UID: \"78668789-e865-4b71-a251-7a81549d1442\") " pod="openshift-insights/insights-operator-555d9d7885-kf559" Jul 23 14:10:40.016443 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.016361 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/26f702c8-73af-4693-95ac-2c03483b6116-installation-pull-secrets\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:40.016443 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.016368 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/26f702c8-73af-4693-95ac-2c03483b6116-image-registry-private-configuration\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:40.016670 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.016660 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4-serving-cert\") pod \"service-ca-operator-5bcbc94c78-gkbtz\" (UID: \"f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gkbtz" Jul 23 14:10:40.023254 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.023215 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-bound-sa-token\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:40.025017 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.024971 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgmqg\" (UniqueName: \"kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-kube-api-access-hgmqg\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:40.025138 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.025074 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkpcc\" (UniqueName: \"kubernetes.io/projected/78668789-e865-4b71-a251-7a81549d1442-kube-api-access-jkpcc\") pod \"insights-operator-555d9d7885-kf559\" (UID: \"78668789-e865-4b71-a251-7a81549d1442\") " pod="openshift-insights/insights-operator-555d9d7885-kf559" Jul 23 14:10:40.025361 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.025320 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5c9f\" (UniqueName: \"kubernetes.io/projected/7605d097-5e0f-4270-a9f9-50e11e897253-kube-api-access-g5c9f\") pod \"volume-data-source-validator-78cf4c6f6-ffmql\" (UID: \"7605d097-5e0f-4270-a9f9-50e11e897253\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ffmql" Jul 23 14:10:40.026800 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.026777 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7jdr\" (UniqueName: \"kubernetes.io/projected/b0bbf318-4828-4843-867e-438dbf40fae0-kube-api-access-n7jdr\") pod \"cluster-samples-operator-79b7c55f87-l4sls\" (UID: \"b0bbf318-4828-4843-867e-438dbf40fae0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-l4sls" Jul 23 14:10:40.026889 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.026849 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqj45\" (UniqueName: \"kubernetes.io/projected/f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4-kube-api-access-xqj45\") pod \"service-ca-operator-5bcbc94c78-gkbtz\" (UID: \"f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gkbtz" Jul 23 14:10:40.029447 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.029424 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:40.113639 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.113597 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-stats-auth\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:40.113835 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.113673 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/368b9cb3-9200-489d-b70c-832898906791-config\") pod \"console-operator-565b7b569d-thrtj\" (UID: \"368b9cb3-9200-489d-b70c-832898906791\") " pod="openshift-console-operator/console-operator-565b7b569d-thrtj" Jul 23 14:10:40.113835 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.113725 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-config-volume\") pod \"dns-default-6c44f\" (UID: \"d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b\") " pod="openshift-dns/dns-default-6c44f" Jul 23 14:10:40.113835 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.113751 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d1e7c79-7575-481a-af5b-b3371a5e317d-cert\") pod \"ingress-canary-5bqgn\" (UID: \"0d1e7c79-7575-481a-af5b-b3371a5e317d\") " pod="openshift-ingress-canary/ingress-canary-5bqgn" Jul 23 14:10:40.113835 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.113776 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-metrics-certs\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:40.113835 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.113803 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv5p4\" (UniqueName: \"kubernetes.io/projected/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-kube-api-access-xv5p4\") pod \"dns-default-6c44f\" (UID: \"d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b\") " pod="openshift-dns/dns-default-6c44f" Jul 23 14:10:40.113835 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.113831 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpjzb\" (UniqueName: \"kubernetes.io/projected/9922460a-be5a-46c1-a7dd-0c97f00db59d-kube-api-access-zpjzb\") pod \"network-check-source-7bc5b6bf85-fjlpb\" (UID: \"9922460a-be5a-46c1-a7dd-0c97f00db59d\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-fjlpb" Jul 23 14:10:40.114134 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.113862 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4q64\" (UniqueName: \"kubernetes.io/projected/0d1e7c79-7575-481a-af5b-b3371a5e317d-kube-api-access-n4q64\") pod \"ingress-canary-5bqgn\" (UID: \"0d1e7c79-7575-481a-af5b-b3371a5e317d\") " pod="openshift-ingress-canary/ingress-canary-5bqgn" Jul 23 14:10:40.114134 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.113897 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6fca46de-acd7-4911-8fc7-3dcefade899e-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-n7bbn\" (UID: \"6fca46de-acd7-4911-8fc7-3dcefade899e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n7bbn" Jul 23 14:10:40.114134 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.113919 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-metrics-tls\") pod \"dns-default-6c44f\" (UID: \"d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b\") " pod="openshift-dns/dns-default-6c44f" Jul 23 14:10:40.114134 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.113955 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w79zb\" (UniqueName: \"kubernetes.io/projected/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-kube-api-access-w79zb\") pod \"cluster-monitoring-operator-76cf8966f8-2cxf9\" (UID: \"b7938e65-26db-4bf0-9cdd-eb340fba0ba7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9" Jul 23 14:10:40.114134 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.113988 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-2cxf9\" (UID: \"b7938e65-26db-4bf0-9cdd-eb340fba0ba7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9" Jul 23 14:10:40.114134 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.114009 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2cxf9\" (UID: \"b7938e65-26db-4bf0-9cdd-eb340fba0ba7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9" Jul 23 14:10:40.114134 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.114033 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6fca46de-acd7-4911-8fc7-3dcefade899e-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-n7bbn\" (UID: \"6fca46de-acd7-4911-8fc7-3dcefade899e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n7bbn" Jul 23 14:10:40.114134 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.114060 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-default-certificate\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:40.114134 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.114104 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/368b9cb3-9200-489d-b70c-832898906791-serving-cert\") pod \"console-operator-565b7b569d-thrtj\" (UID: \"368b9cb3-9200-489d-b70c-832898906791\") " pod="openshift-console-operator/console-operator-565b7b569d-thrtj" Jul 23 14:10:40.114134 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.114130 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a4ff440c-7a41-4adf-956d-8f2d35b0889f-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-dtqtx\" (UID: \"a4ff440c-7a41-4adf-956d-8f2d35b0889f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtqtx" Jul 23 14:10:40.114622 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.114155 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9e8f751-c4aa-4c3b-a110-de695a817c76-service-ca-bundle\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:40.114622 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.114190 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4ff440c-7a41-4adf-956d-8f2d35b0889f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dtqtx\" (UID: \"a4ff440c-7a41-4adf-956d-8f2d35b0889f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtqtx" Jul 23 14:10:40.114622 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.114221 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-tmp-dir\") pod \"dns-default-6c44f\" (UID: \"d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b\") " pod="openshift-dns/dns-default-6c44f" Jul 23 14:10:40.114622 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.114271 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddnlt\" (UniqueName: \"kubernetes.io/projected/368b9cb3-9200-489d-b70c-832898906791-kube-api-access-ddnlt\") pod \"console-operator-565b7b569d-thrtj\" (UID: \"368b9cb3-9200-489d-b70c-832898906791\") " pod="openshift-console-operator/console-operator-565b7b569d-thrtj" Jul 23 14:10:40.114622 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.114301 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/368b9cb3-9200-489d-b70c-832898906791-trusted-ca\") pod \"console-operator-565b7b569d-thrtj\" (UID: \"368b9cb3-9200-489d-b70c-832898906791\") " pod="openshift-console-operator/console-operator-565b7b569d-thrtj" Jul 23 14:10:40.114622 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.114326 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9667\" (UniqueName: \"kubernetes.io/projected/6fca46de-acd7-4911-8fc7-3dcefade899e-kube-api-access-w9667\") pod \"kube-storage-version-migrator-operator-7658d9b749-n7bbn\" (UID: \"6fca46de-acd7-4911-8fc7-3dcefade899e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n7bbn" Jul 23 14:10:40.114622 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.114356 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mxn4\" (UniqueName: \"kubernetes.io/projected/e9e8f751-c4aa-4c3b-a110-de695a817c76-kube-api-access-2mxn4\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:40.114622 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.114441 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 23 14:10:40.114622 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.114523 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-metrics-certs podName:e9e8f751-c4aa-4c3b-a110-de695a817c76 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:40.614500635 +0000 UTC m=+36.174328971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-metrics-certs") pod "router-default-695b7bcf8d-qtpwr" (UID: "e9e8f751-c4aa-4c3b-a110-de695a817c76") : secret "router-metrics-certs-default" not found Jul 23 14:10:40.114622 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.114603 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9e8f751-c4aa-4c3b-a110-de695a817c76-service-ca-bundle podName:e9e8f751-c4aa-4c3b-a110-de695a817c76 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:40.614584487 +0000 UTC m=+36.174412807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e9e8f751-c4aa-4c3b-a110-de695a817c76-service-ca-bundle") pod "router-default-695b7bcf8d-qtpwr" (UID: "e9e8f751-c4aa-4c3b-a110-de695a817c76") : configmap references non-existent config key: service-ca.crt Jul 23 14:10:40.115070 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.114673 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 14:10:40.115070 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.114712 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4ff440c-7a41-4adf-956d-8f2d35b0889f-networking-console-plugin-cert podName:a4ff440c-7a41-4adf-956d-8f2d35b0889f nodeName:}" failed. No retries permitted until 2026-07-23 14:10:40.614700897 +0000 UTC m=+36.174529219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a4ff440c-7a41-4adf-956d-8f2d35b0889f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dtqtx" (UID: "a4ff440c-7a41-4adf-956d-8f2d35b0889f") : secret "networking-console-plugin-cert" not found Jul 23 14:10:40.115070 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.115005 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-tmp-dir\") pod \"dns-default-6c44f\" (UID: \"d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b\") " pod="openshift-dns/dns-default-6c44f" Jul 23 14:10:40.115224 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.115203 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-config-volume\") pod \"dns-default-6c44f\" (UID: \"d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b\") " pod="openshift-dns/dns-default-6c44f" Jul 23 14:10:40.115633 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.115327 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/368b9cb3-9200-489d-b70c-832898906791-config\") pod \"console-operator-565b7b569d-thrtj\" (UID: \"368b9cb3-9200-489d-b70c-832898906791\") " pod="openshift-console-operator/console-operator-565b7b569d-thrtj" Jul 23 14:10:40.115633 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.115337 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-2cxf9\" (UID: \"b7938e65-26db-4bf0-9cdd-eb340fba0ba7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9" Jul 23 14:10:40.115633 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.115425 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6fca46de-acd7-4911-8fc7-3dcefade899e-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-n7bbn\" (UID: \"6fca46de-acd7-4911-8fc7-3dcefade899e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n7bbn" Jul 23 14:10:40.115633 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.115441 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 14:10:40.115633 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.115499 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-cluster-monitoring-operator-tls podName:b7938e65-26db-4bf0-9cdd-eb340fba0ba7 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:40.61548401 +0000 UTC m=+36.175312335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2cxf9" (UID: "b7938e65-26db-4bf0-9cdd-eb340fba0ba7") : secret "cluster-monitoring-operator-tls" not found Jul 23 14:10:40.115633 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.115549 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 14:10:40.115633 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.115581 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-metrics-tls podName:d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b nodeName:}" failed. No retries permitted until 2026-07-23 14:10:40.615569221 +0000 UTC m=+36.175397545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-metrics-tls") pod "dns-default-6c44f" (UID: "d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b") : secret "dns-default-metrics-tls" not found Jul 23 14:10:40.115633 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.115575 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a4ff440c-7a41-4adf-956d-8f2d35b0889f-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-dtqtx\" (UID: \"a4ff440c-7a41-4adf-956d-8f2d35b0889f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtqtx" Jul 23 14:10:40.116086 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.115959 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/368b9cb3-9200-489d-b70c-832898906791-trusted-ca\") pod \"console-operator-565b7b569d-thrtj\" (UID: \"368b9cb3-9200-489d-b70c-832898906791\") " pod="openshift-console-operator/console-operator-565b7b569d-thrtj" Jul 23 14:10:40.117547 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.117508 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-stats-auth\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:40.118295 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.118153 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d1e7c79-7575-481a-af5b-b3371a5e317d-cert\") pod \"ingress-canary-5bqgn\" (UID: \"0d1e7c79-7575-481a-af5b-b3371a5e317d\") " pod="openshift-ingress-canary/ingress-canary-5bqgn" Jul 23 14:10:40.118295 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.118195 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6fca46de-acd7-4911-8fc7-3dcefade899e-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-n7bbn\" (UID: \"6fca46de-acd7-4911-8fc7-3dcefade899e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n7bbn" Jul 23 14:10:40.118437 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.118346 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-default-certificate\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:40.118668 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.118632 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/368b9cb3-9200-489d-b70c-832898906791-serving-cert\") pod \"console-operator-565b7b569d-thrtj\" (UID: \"368b9cb3-9200-489d-b70c-832898906791\") " pod="openshift-console-operator/console-operator-565b7b569d-thrtj" Jul 23 14:10:40.126596 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.126561 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpjzb\" (UniqueName: \"kubernetes.io/projected/9922460a-be5a-46c1-a7dd-0c97f00db59d-kube-api-access-zpjzb\") pod \"network-check-source-7bc5b6bf85-fjlpb\" (UID: \"9922460a-be5a-46c1-a7dd-0c97f00db59d\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-fjlpb" Jul 23 14:10:40.129650 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.129624 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv5p4\" (UniqueName: \"kubernetes.io/projected/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-kube-api-access-xv5p4\") pod \"dns-default-6c44f\" (UID: \"d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b\") " pod="openshift-dns/dns-default-6c44f" Jul 23 14:10:40.129897 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.129871 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9667\" (UniqueName: \"kubernetes.io/projected/6fca46de-acd7-4911-8fc7-3dcefade899e-kube-api-access-w9667\") pod \"kube-storage-version-migrator-operator-7658d9b749-n7bbn\" (UID: \"6fca46de-acd7-4911-8fc7-3dcefade899e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n7bbn" Jul 23 14:10:40.130090 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.130072 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4q64\" (UniqueName: \"kubernetes.io/projected/0d1e7c79-7575-481a-af5b-b3371a5e317d-kube-api-access-n4q64\") pod \"ingress-canary-5bqgn\" (UID: \"0d1e7c79-7575-481a-af5b-b3371a5e317d\") " pod="openshift-ingress-canary/ingress-canary-5bqgn" Jul 23 14:10:40.130473 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.130451 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w79zb\" (UniqueName: \"kubernetes.io/projected/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-kube-api-access-w79zb\") pod \"cluster-monitoring-operator-76cf8966f8-2cxf9\" (UID: \"b7938e65-26db-4bf0-9cdd-eb340fba0ba7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9" Jul 23 14:10:40.130558 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.130495 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddnlt\" (UniqueName: \"kubernetes.io/projected/368b9cb3-9200-489d-b70c-832898906791-kube-api-access-ddnlt\") pod \"console-operator-565b7b569d-thrtj\" (UID: \"368b9cb3-9200-489d-b70c-832898906791\") " pod="openshift-console-operator/console-operator-565b7b569d-thrtj" Jul 23 14:10:40.131560 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.131528 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mxn4\" (UniqueName: \"kubernetes.io/projected/e9e8f751-c4aa-4c3b-a110-de695a817c76-kube-api-access-2mxn4\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:40.144994 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.144962 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ffmql" Jul 23 14:10:40.165258 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.165220 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-kf559" Jul 23 14:10:40.175643 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.175614 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gkbtz" Jul 23 14:10:40.199691 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.199423 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-thrtj" Jul 23 14:10:40.215633 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.215607 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n7bbn" Jul 23 14:10:40.225398 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.223782 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-fjlpb" Jul 23 14:10:40.236353 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.236092 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5bqgn" Jul 23 14:10:40.375868 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.373403 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ffmql"] Jul 23 14:10:40.394119 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.387855 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-kf559"] Jul 23 14:10:40.414288 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.414182 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gkbtz"] Jul 23 14:10:40.418521 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:40.418481 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e8d61e_6c11_4a3b_9a97_3e8f043f4bf4.slice/crio-e9c00c2f17ab56fde24cbe375a7efe803e920d5ad3c5b8fb99db20c15da0b5be WatchSource:0}: Error finding container e9c00c2f17ab56fde24cbe375a7efe803e920d5ad3c5b8fb99db20c15da0b5be: Status 404 returned error can't find the container with id e9c00c2f17ab56fde24cbe375a7efe803e920d5ad3c5b8fb99db20c15da0b5be Jul 23 14:10:40.444681 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.444505 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-thrtj"] Jul 23 14:10:40.453570 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:40.453539 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod368b9cb3_9200_489d_b70c_832898906791.slice/crio-63ef5bc0d684b0dd0a967b24d1ff1f03517ee99c2c80534dc8f7db052e2f44ee WatchSource:0}: Error finding container 63ef5bc0d684b0dd0a967b24d1ff1f03517ee99c2c80534dc8f7db052e2f44ee: Status 404 returned error can't find the container with id 63ef5bc0d684b0dd0a967b24d1ff1f03517ee99c2c80534dc8f7db052e2f44ee Jul 23 14:10:40.474149 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.474120 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n7bbn"] Jul 23 14:10:40.477284 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:40.477258 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fca46de_acd7_4911_8fc7_3dcefade899e.slice/crio-fe373c78cfd687ee7324b2a0826e536950e37ea3003852100f0149e3ed107521 WatchSource:0}: Error finding container fe373c78cfd687ee7324b2a0826e536950e37ea3003852100f0149e3ed107521: Status 404 returned error can't find the container with id fe373c78cfd687ee7324b2a0826e536950e37ea3003852100f0149e3ed107521 Jul 23 14:10:40.491187 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.491163 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-fjlpb"] Jul 23 14:10:40.493962 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:40.493930 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9922460a_be5a_46c1_a7dd_0c97f00db59d.slice/crio-7583bc4d03c50f51f1e4c3e3f2b66d837a7bdcd986fc969cad0e3aa7d41b4093 WatchSource:0}: Error finding container 7583bc4d03c50f51f1e4c3e3f2b66d837a7bdcd986fc969cad0e3aa7d41b4093: Status 404 returned error can't find the container with id 7583bc4d03c50f51f1e4c3e3f2b66d837a7bdcd986fc969cad0e3aa7d41b4093 Jul 23 14:10:40.508127 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.508101 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5bqgn"] Jul 23 14:10:40.515642 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:10:40.515614 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d1e7c79_7575_481a_af5b_b3371a5e317d.slice/crio-ea1c3506d2631418bc0b866a18be7d3c569a06763237818ae5e98b31a04af07a WatchSource:0}: Error finding container ea1c3506d2631418bc0b866a18be7d3c569a06763237818ae5e98b31a04af07a: Status 404 returned error can't find the container with id ea1c3506d2631418bc0b866a18be7d3c569a06763237818ae5e98b31a04af07a Jul 23 14:10:40.519517 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.519492 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b0bbf318-4828-4843-867e-438dbf40fae0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-l4sls\" (UID: \"b0bbf318-4828-4843-867e-438dbf40fae0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-l4sls" Jul 23 14:10:40.519639 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.519543 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:40.519703 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.519638 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 14:10:40.519703 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.519698 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0bbf318-4828-4843-867e-438dbf40fae0-samples-operator-tls podName:b0bbf318-4828-4843-867e-438dbf40fae0 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:41.519678903 +0000 UTC m=+37.079507228 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b0bbf318-4828-4843-867e-438dbf40fae0-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-l4sls" (UID: "b0bbf318-4828-4843-867e-438dbf40fae0") : secret "samples-operator-tls" not found Jul 23 14:10:40.519812 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.519775 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 14:10:40.519812 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.519787 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c7487ddc-74nwt: secret "image-registry-tls" not found Jul 23 14:10:40.519904 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.519832 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls podName:26f702c8-73af-4693-95ac-2c03483b6116 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:41.519816085 +0000 UTC m=+37.079644408 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls") pod "image-registry-75c7487ddc-74nwt" (UID: "26f702c8-73af-4693-95ac-2c03483b6116") : secret "image-registry-tls" not found Jul 23 14:10:40.621064 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.621017 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4ff440c-7a41-4adf-956d-8f2d35b0889f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dtqtx\" (UID: \"a4ff440c-7a41-4adf-956d-8f2d35b0889f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtqtx" Jul 23 14:10:40.621270 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.621133 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-metrics-certs\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:40.621270 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.621172 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 14:10:40.621270 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.621177 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-metrics-tls\") pod \"dns-default-6c44f\" (UID: \"d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b\") " pod="openshift-dns/dns-default-6c44f" Jul 23 14:10:40.621270 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.621263 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4ff440c-7a41-4adf-956d-8f2d35b0889f-networking-console-plugin-cert podName:a4ff440c-7a41-4adf-956d-8f2d35b0889f nodeName:}" failed. No retries permitted until 2026-07-23 14:10:41.621227685 +0000 UTC m=+37.181056008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a4ff440c-7a41-4adf-956d-8f2d35b0889f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dtqtx" (UID: "a4ff440c-7a41-4adf-956d-8f2d35b0889f") : secret "networking-console-plugin-cert" not found Jul 23 14:10:40.621270 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.621268 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 14:10:40.621525 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.621268 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 23 14:10:40.621525 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.621327 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2cxf9\" (UID: \"b7938e65-26db-4bf0-9cdd-eb340fba0ba7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9" Jul 23 14:10:40.621525 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.621338 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-metrics-certs podName:e9e8f751-c4aa-4c3b-a110-de695a817c76 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:41.621323148 +0000 UTC m=+37.181151470 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-metrics-certs") pod "router-default-695b7bcf8d-qtpwr" (UID: "e9e8f751-c4aa-4c3b-a110-de695a817c76") : secret "router-metrics-certs-default" not found Jul 23 14:10:40.621525 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.621382 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-metrics-tls podName:d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b nodeName:}" failed. No retries permitted until 2026-07-23 14:10:41.621351431 +0000 UTC m=+37.181179766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-metrics-tls") pod "dns-default-6c44f" (UID: "d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b") : secret "dns-default-metrics-tls" not found Jul 23 14:10:40.621525 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.621391 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 14:10:40.621525 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.621458 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9e8f751-c4aa-4c3b-a110-de695a817c76-service-ca-bundle\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:40.621525 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.621514 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-cluster-monitoring-operator-tls podName:b7938e65-26db-4bf0-9cdd-eb340fba0ba7 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:41.62150085 +0000 UTC m=+37.181329176 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2cxf9" (UID: "b7938e65-26db-4bf0-9cdd-eb340fba0ba7") : secret "cluster-monitoring-operator-tls" not found Jul 23 14:10:40.621807 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:40.621576 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9e8f751-c4aa-4c3b-a110-de695a817c76-service-ca-bundle podName:e9e8f751-c4aa-4c3b-a110-de695a817c76 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:41.621564184 +0000 UTC m=+37.181392513 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e9e8f751-c4aa-4c3b-a110-de695a817c76-service-ca-bundle") pod "router-default-695b7bcf8d-qtpwr" (UID: "e9e8f751-c4aa-4c3b-a110-de695a817c76") : configmap references non-existent config key: service-ca.crt Jul 23 14:10:40.879081 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.878996 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:10:40.879934 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.879598 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:10:40.879934 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.879732 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:10:40.882121 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.882102 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6lvrs\"" Jul 23 14:10:40.882373 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.882355 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 14:10:40.882568 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.882547 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 14:10:40.882737 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:40.882723 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4kmz9\"" Jul 23 14:10:41.082617 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:41.080476 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-fjlpb" event={"ID":"9922460a-be5a-46c1-a7dd-0c97f00db59d","Type":"ContainerStarted","Data":"7583bc4d03c50f51f1e4c3e3f2b66d837a7bdcd986fc969cad0e3aa7d41b4093"} Jul 23 14:10:41.084062 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:41.083763 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ffmql" event={"ID":"7605d097-5e0f-4270-a9f9-50e11e897253","Type":"ContainerStarted","Data":"32492a39123d025bed69aa0789a161920b7af9319781bb99864a3fedca0181df"} Jul 23 14:10:41.089551 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:41.089480 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gkbtz" event={"ID":"f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4","Type":"ContainerStarted","Data":"e9c00c2f17ab56fde24cbe375a7efe803e920d5ad3c5b8fb99db20c15da0b5be"} Jul 23 14:10:41.093026 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:41.092950 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5bqgn" event={"ID":"0d1e7c79-7575-481a-af5b-b3371a5e317d","Type":"ContainerStarted","Data":"ea1c3506d2631418bc0b866a18be7d3c569a06763237818ae5e98b31a04af07a"} Jul 23 14:10:41.096213 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:41.096152 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-thrtj" event={"ID":"368b9cb3-9200-489d-b70c-832898906791","Type":"ContainerStarted","Data":"63ef5bc0d684b0dd0a967b24d1ff1f03517ee99c2c80534dc8f7db052e2f44ee"} Jul 23 14:10:41.102145 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:41.102118 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-kf559" event={"ID":"78668789-e865-4b71-a251-7a81549d1442","Type":"ContainerStarted","Data":"75a583fbc947274d498426b2b968f383960b348194e363be6af95ba3a52c28a5"} Jul 23 14:10:41.110202 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:41.110174 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n7bbn" event={"ID":"6fca46de-acd7-4911-8fc7-3dcefade899e","Type":"ContainerStarted","Data":"fe373c78cfd687ee7324b2a0826e536950e37ea3003852100f0149e3ed107521"} Jul 23 14:10:41.531510 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:41.531469 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b0bbf318-4828-4843-867e-438dbf40fae0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-l4sls\" (UID: \"b0bbf318-4828-4843-867e-438dbf40fae0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-l4sls" Jul 23 14:10:41.531722 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:41.531525 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:41.531782 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:41.531739 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 14:10:41.531782 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:41.531753 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c7487ddc-74nwt: secret "image-registry-tls" not found Jul 23 14:10:41.531923 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:41.531812 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls podName:26f702c8-73af-4693-95ac-2c03483b6116 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:43.531794365 +0000 UTC m=+39.091622690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls") pod "image-registry-75c7487ddc-74nwt" (UID: "26f702c8-73af-4693-95ac-2c03483b6116") : secret "image-registry-tls" not found Jul 23 14:10:41.532288 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:41.532268 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 14:10:41.532377 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:41.532329 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0bbf318-4828-4843-867e-438dbf40fae0-samples-operator-tls podName:b0bbf318-4828-4843-867e-438dbf40fae0 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:43.532313105 +0000 UTC m=+39.092141446 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b0bbf318-4828-4843-867e-438dbf40fae0-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-l4sls" (UID: "b0bbf318-4828-4843-867e-438dbf40fae0") : secret "samples-operator-tls" not found Jul 23 14:10:41.555392 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:41.555348 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:41.632714 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:41.632673 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-metrics-tls\") pod \"dns-default-6c44f\" (UID: \"d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b\") " pod="openshift-dns/dns-default-6c44f" Jul 23 14:10:41.632900 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:41.632749 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2cxf9\" (UID: \"b7938e65-26db-4bf0-9cdd-eb340fba0ba7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9" Jul 23 14:10:41.632900 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:41.632805 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9e8f751-c4aa-4c3b-a110-de695a817c76-service-ca-bundle\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:41.632900 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:41.632843 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4ff440c-7a41-4adf-956d-8f2d35b0889f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dtqtx\" (UID: \"a4ff440c-7a41-4adf-956d-8f2d35b0889f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtqtx" Jul 23 14:10:41.633049 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:41.632941 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-metrics-certs\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:41.633106 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:41.633074 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 23 14:10:41.633157 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:41.633137 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-metrics-certs podName:e9e8f751-c4aa-4c3b-a110-de695a817c76 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:43.633119193 +0000 UTC m=+39.192947519 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-metrics-certs") pod "router-default-695b7bcf8d-qtpwr" (UID: "e9e8f751-c4aa-4c3b-a110-de695a817c76") : secret "router-metrics-certs-default" not found Jul 23 14:10:41.633688 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:41.633563 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 14:10:41.633688 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:41.633618 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-metrics-tls podName:d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b nodeName:}" failed. No retries permitted until 2026-07-23 14:10:43.633603057 +0000 UTC m=+39.193431383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-metrics-tls") pod "dns-default-6c44f" (UID: "d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b") : secret "dns-default-metrics-tls" not found Jul 23 14:10:41.633688 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:41.633668 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 14:10:41.633915 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:41.633700 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-cluster-monitoring-operator-tls podName:b7938e65-26db-4bf0-9cdd-eb340fba0ba7 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:43.633689447 +0000 UTC m=+39.193517767 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2cxf9" (UID: "b7938e65-26db-4bf0-9cdd-eb340fba0ba7") : secret "cluster-monitoring-operator-tls" not found Jul 23 14:10:41.633915 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:41.633764 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9e8f751-c4aa-4c3b-a110-de695a817c76-service-ca-bundle podName:e9e8f751-c4aa-4c3b-a110-de695a817c76 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:43.633755618 +0000 UTC m=+39.193583953 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e9e8f751-c4aa-4c3b-a110-de695a817c76-service-ca-bundle") pod "router-default-695b7bcf8d-qtpwr" (UID: "e9e8f751-c4aa-4c3b-a110-de695a817c76") : configmap references non-existent config key: service-ca.crt Jul 23 14:10:41.633915 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:41.633816 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 14:10:41.633915 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:41.633850 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4ff440c-7a41-4adf-956d-8f2d35b0889f-networking-console-plugin-cert podName:a4ff440c-7a41-4adf-956d-8f2d35b0889f nodeName:}" failed. No retries permitted until 2026-07-23 14:10:43.633839986 +0000 UTC m=+39.193668312 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a4ff440c-7a41-4adf-956d-8f2d35b0889f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dtqtx" (UID: "a4ff440c-7a41-4adf-956d-8f2d35b0889f") : secret "networking-console-plugin-cert" not found Jul 23 14:10:41.655786 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:41.655654 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:43.124538 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:43.123957 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ffmql" event={"ID":"7605d097-5e0f-4270-a9f9-50e11e897253","Type":"ContainerStarted","Data":"ff9604efd29e28eaacc698a4bf3b12195d6322a7ede5ff1e98d48b3e81c5a06c"} Jul 23 14:10:43.269357 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:43.269316 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:43.348427 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:43.348333 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:43.554108 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:43.554071 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b0bbf318-4828-4843-867e-438dbf40fae0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-l4sls\" (UID: \"b0bbf318-4828-4843-867e-438dbf40fae0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-l4sls" Jul 23 14:10:43.554108 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:43.554110 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:43.554375 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:43.554269 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 14:10:43.554375 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:43.554278 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 14:10:43.554375 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:43.554293 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c7487ddc-74nwt: secret "image-registry-tls" not found Jul 23 14:10:43.554375 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:43.554334 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0bbf318-4828-4843-867e-438dbf40fae0-samples-operator-tls podName:b0bbf318-4828-4843-867e-438dbf40fae0 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:47.554315841 +0000 UTC m=+43.114144179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b0bbf318-4828-4843-867e-438dbf40fae0-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-l4sls" (UID: "b0bbf318-4828-4843-867e-438dbf40fae0") : secret "samples-operator-tls" not found Jul 23 14:10:43.554375 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:43.554353 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls podName:26f702c8-73af-4693-95ac-2c03483b6116 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:47.55434453 +0000 UTC m=+43.114172850 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls") pod "image-registry-75c7487ddc-74nwt" (UID: "26f702c8-73af-4693-95ac-2c03483b6116") : secret "image-registry-tls" not found Jul 23 14:10:43.655523 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:43.655421 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-metrics-tls\") pod \"dns-default-6c44f\" (UID: \"d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b\") " pod="openshift-dns/dns-default-6c44f" Jul 23 14:10:43.655523 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:43.655478 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2cxf9\" (UID: \"b7938e65-26db-4bf0-9cdd-eb340fba0ba7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9" Jul 23 14:10:43.655793 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:43.655622 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 14:10:43.655793 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:43.655699 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-metrics-tls podName:d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b nodeName:}" failed. No retries permitted until 2026-07-23 14:10:47.655676944 +0000 UTC m=+43.215505275 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-metrics-tls") pod "dns-default-6c44f" (UID: "d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b") : secret "dns-default-metrics-tls" not found Jul 23 14:10:43.655793 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:43.655726 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9e8f751-c4aa-4c3b-a110-de695a817c76-service-ca-bundle\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:43.655793 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:43.655756 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 14:10:43.655793 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:43.655767 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4ff440c-7a41-4adf-956d-8f2d35b0889f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dtqtx\" (UID: \"a4ff440c-7a41-4adf-956d-8f2d35b0889f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtqtx" Jul 23 14:10:43.656025 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:43.655811 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-cluster-monitoring-operator-tls podName:b7938e65-26db-4bf0-9cdd-eb340fba0ba7 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:47.65580143 +0000 UTC m=+43.215629763 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2cxf9" (UID: "b7938e65-26db-4bf0-9cdd-eb340fba0ba7") : secret "cluster-monitoring-operator-tls" not found Jul 23 14:10:43.656025 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:43.655868 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9e8f751-c4aa-4c3b-a110-de695a817c76-service-ca-bundle podName:e9e8f751-c4aa-4c3b-a110-de695a817c76 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:47.655853412 +0000 UTC m=+43.215681732 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e9e8f751-c4aa-4c3b-a110-de695a817c76-service-ca-bundle") pod "router-default-695b7bcf8d-qtpwr" (UID: "e9e8f751-c4aa-4c3b-a110-de695a817c76") : configmap references non-existent config key: service-ca.crt Jul 23 14:10:43.656025 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:43.655887 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 14:10:43.656025 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:43.655915 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4ff440c-7a41-4adf-956d-8f2d35b0889f-networking-console-plugin-cert podName:a4ff440c-7a41-4adf-956d-8f2d35b0889f nodeName:}" failed. No retries permitted until 2026-07-23 14:10:47.655908492 +0000 UTC m=+43.215736812 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a4ff440c-7a41-4adf-956d-8f2d35b0889f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dtqtx" (UID: "a4ff440c-7a41-4adf-956d-8f2d35b0889f") : secret "networking-console-plugin-cert" not found Jul 23 14:10:43.656025 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:43.655932 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-metrics-certs\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:43.656025 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:43.656001 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 23 14:10:43.656340 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:43.656031 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-metrics-certs podName:e9e8f751-c4aa-4c3b-a110-de695a817c76 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:47.656022014 +0000 UTC m=+43.215850336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-metrics-certs") pod "router-default-695b7bcf8d-qtpwr" (UID: "e9e8f751-c4aa-4c3b-a110-de695a817c76") : secret "router-metrics-certs-default" not found Jul 23 14:10:43.979468 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:43.979383 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:44.164580 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:44.164531 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:47.593351 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:47.593313 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b0bbf318-4828-4843-867e-438dbf40fae0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-l4sls\" (UID: \"b0bbf318-4828-4843-867e-438dbf40fae0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-l4sls" Jul 23 14:10:47.593351 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:47.593357 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:47.593738 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:47.593488 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 14:10:47.593738 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:47.593551 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0bbf318-4828-4843-867e-438dbf40fae0-samples-operator-tls podName:b0bbf318-4828-4843-867e-438dbf40fae0 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:55.593537075 +0000 UTC m=+51.153365399 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b0bbf318-4828-4843-867e-438dbf40fae0-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-l4sls" (UID: "b0bbf318-4828-4843-867e-438dbf40fae0") : secret "samples-operator-tls" not found Jul 23 14:10:47.593738 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:47.593491 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 14:10:47.593738 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:47.593593 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c7487ddc-74nwt: secret "image-registry-tls" not found Jul 23 14:10:47.593738 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:47.593632 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls podName:26f702c8-73af-4693-95ac-2c03483b6116 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:55.593620522 +0000 UTC m=+51.153448847 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls") pod "image-registry-75c7487ddc-74nwt" (UID: "26f702c8-73af-4693-95ac-2c03483b6116") : secret "image-registry-tls" not found Jul 23 14:10:47.693831 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:47.693799 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-metrics-certs\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:47.693979 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:47.693849 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-metrics-tls\") pod \"dns-default-6c44f\" (UID: \"d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b\") " pod="openshift-dns/dns-default-6c44f" Jul 23 14:10:47.693979 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:47.693933 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 14:10:47.693979 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:47.693946 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 23 14:10:47.694077 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:47.693991 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-metrics-tls podName:d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b nodeName:}" failed. No retries permitted until 2026-07-23 14:10:55.693976454 +0000 UTC m=+51.253804808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-metrics-tls") pod "dns-default-6c44f" (UID: "d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b") : secret "dns-default-metrics-tls" not found Jul 23 14:10:47.694077 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:47.694005 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-metrics-certs podName:e9e8f751-c4aa-4c3b-a110-de695a817c76 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:55.693999169 +0000 UTC m=+51.253827488 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-metrics-certs") pod "router-default-695b7bcf8d-qtpwr" (UID: "e9e8f751-c4aa-4c3b-a110-de695a817c76") : secret "router-metrics-certs-default" not found Jul 23 14:10:47.694077 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:47.693984 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2cxf9\" (UID: \"b7938e65-26db-4bf0-9cdd-eb340fba0ba7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9" Jul 23 14:10:47.694169 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:47.694101 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9e8f751-c4aa-4c3b-a110-de695a817c76-service-ca-bundle\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:47.694169 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:47.694040 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 14:10:47.694169 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:47.694138 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4ff440c-7a41-4adf-956d-8f2d35b0889f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dtqtx\" (UID: \"a4ff440c-7a41-4adf-956d-8f2d35b0889f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtqtx" Jul 23 14:10:47.694273 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:47.694170 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-cluster-monitoring-operator-tls podName:b7938e65-26db-4bf0-9cdd-eb340fba0ba7 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:55.694153813 +0000 UTC m=+51.253982135 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2cxf9" (UID: "b7938e65-26db-4bf0-9cdd-eb340fba0ba7") : secret "cluster-monitoring-operator-tls" not found Jul 23 14:10:47.694273 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:47.694190 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9e8f751-c4aa-4c3b-a110-de695a817c76-service-ca-bundle podName:e9e8f751-c4aa-4c3b-a110-de695a817c76 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:55.694181155 +0000 UTC m=+51.254009478 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e9e8f751-c4aa-4c3b-a110-de695a817c76-service-ca-bundle") pod "router-default-695b7bcf8d-qtpwr" (UID: "e9e8f751-c4aa-4c3b-a110-de695a817c76") : configmap references non-existent config key: service-ca.crt Jul 23 14:10:47.694273 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:47.694256 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 14:10:47.694386 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:47.694321 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4ff440c-7a41-4adf-956d-8f2d35b0889f-networking-console-plugin-cert podName:a4ff440c-7a41-4adf-956d-8f2d35b0889f nodeName:}" failed. No retries permitted until 2026-07-23 14:10:55.694308533 +0000 UTC m=+51.254136852 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a4ff440c-7a41-4adf-956d-8f2d35b0889f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dtqtx" (UID: "a4ff440c-7a41-4adf-956d-8f2d35b0889f") : secret "networking-console-plugin-cert" not found Jul 23 14:10:47.784867 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:47.784834 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:51.147577 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:51.147536 2583 generic.go:356] "Generic (PLEG): container finished" podID="6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4" containerID="a40d1cd8286e3ac06e4a4ca703416f309d51b64ffc9dbeaa50fd87976b9c2880" exitCode=0 Jul 23 14:10:51.148075 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:51.147621 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlpcq" event={"ID":"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4","Type":"ContainerDied","Data":"a40d1cd8286e3ac06e4a4ca703416f309d51b64ffc9dbeaa50fd87976b9c2880"} Jul 23 14:10:51.149352 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:51.149319 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5bqgn" event={"ID":"0d1e7c79-7575-481a-af5b-b3371a5e317d","Type":"ContainerStarted","Data":"7048580385f06773c0f2df03af9323ae1f07604d169ab45e3b5caee4482899c5"} Jul 23 14:10:51.151355 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:51.151336 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-thrtj_368b9cb3-9200-489d-b70c-832898906791/console-operator/0.log" Jul 23 14:10:51.151455 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:51.151372 2583 generic.go:356] "Generic (PLEG): container finished" podID="368b9cb3-9200-489d-b70c-832898906791" containerID="6f8c4e4a2f79fad0536f1418c24d23795342fae8a0be2d4cdbc11d5d4345d990" exitCode=255 Jul 23 14:10:51.151521 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:51.151454 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-thrtj" event={"ID":"368b9cb3-9200-489d-b70c-832898906791","Type":"ContainerDied","Data":"6f8c4e4a2f79fad0536f1418c24d23795342fae8a0be2d4cdbc11d5d4345d990"} Jul 23 14:10:51.151638 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:51.151617 2583 scope.go:117] "RemoveContainer" containerID="6f8c4e4a2f79fad0536f1418c24d23795342fae8a0be2d4cdbc11d5d4345d990" Jul 23 14:10:51.154033 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:51.153600 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-kf559" event={"ID":"78668789-e865-4b71-a251-7a81549d1442","Type":"ContainerStarted","Data":"8528d670819f6cb4eec219afbca7c146c2800e17e8d97416e0d03f737079160b"} Jul 23 14:10:51.155853 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:51.155833 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n7bbn" event={"ID":"6fca46de-acd7-4911-8fc7-3dcefade899e","Type":"ContainerStarted","Data":"b1db4a55443f1a1364f58c1ac0d3898a8fcb570c14c93bf4b47a74119cb4984b"} Jul 23 14:10:51.157412 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:51.157382 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-fjlpb" event={"ID":"9922460a-be5a-46c1-a7dd-0c97f00db59d","Type":"ContainerStarted","Data":"bac89a3edc3e15d0548f760db75fc3d3e4b847eec800599ebc011e02c7ce76e8"} Jul 23 14:10:51.158845 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:51.158825 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gkbtz" event={"ID":"f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4","Type":"ContainerStarted","Data":"533214b466a6f77db4a81c085c1c17458a946fc9fb251bf3e624ed63c4e2d8cb"} Jul 23 14:10:51.172938 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:51.172683 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-ffmql" podStartSLOduration=25.999954406 podStartE2EDuration="28.172665863s" totalImagesPullingTime="2.172711457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:10:43.142555279 +0000 UTC m=+38.702383625" watchObservedRunningTime="2026-07-23 14:10:51.172665863 +0000 UTC m=+46.732494190" Jul 23 14:10:51.217051 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:51.216995 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-kf559" podStartSLOduration=18.341300191 podStartE2EDuration="28.216973185s" totalImagesPullingTime="9.875672994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:10:51.214230225 +0000 UTC m=+46.774058568" watchObservedRunningTime="2026-07-23 14:10:51.216973185 +0000 UTC m=+46.776801527" Jul 23 14:10:51.235161 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:51.235108 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5bqgn" podStartSLOduration=2.460369615 podStartE2EDuration="12.235088019s" totalImagesPullingTime="9.774718404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:10:51.233891882 +0000 UTC m=+46.793720225" watchObservedRunningTime="2026-07-23 14:10:51.235088019 +0000 UTC m=+46.794916361" Jul 23 14:10:51.255587 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:51.255533 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gkbtz" podStartSLOduration=18.386248695 podStartE2EDuration="28.255512573s" totalImagesPullingTime="9.869263878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:10:51.253558823 +0000 UTC m=+46.813387166" watchObservedRunningTime="2026-07-23 14:10:51.255512573 +0000 UTC m=+46.815340915" Jul 23 14:10:51.274594 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:51.272394 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n7bbn" podStartSLOduration=18.45998932 podStartE2EDuration="28.272372363s" totalImagesPullingTime="9.812383043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:10:51.271134184 +0000 UTC m=+46.830962527" watchObservedRunningTime="2026-07-23 14:10:51.272372363 +0000 UTC m=+46.832200706" Jul 23 14:10:51.303757 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:51.303540 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-fjlpb" podStartSLOduration=18.496899138 podStartE2EDuration="28.303519418s" totalImagesPullingTime="9.80662028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:10:51.290691398 +0000 UTC m=+46.850519742" watchObservedRunningTime="2026-07-23 14:10:51.303519418 +0000 UTC m=+46.863347761" Jul 23 14:10:51.841782 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:51.841745 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:51.938700 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:51.938665 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:52.165371 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.165289 2583 generic.go:356] "Generic (PLEG): container finished" podID="6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4" containerID="855446c044a685c89fa8ba4dce37c78267900e33801422f116c2e0b23cfbd609" exitCode=0 Jul 23 14:10:52.165793 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.165373 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlpcq" event={"ID":"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4","Type":"ContainerDied","Data":"855446c044a685c89fa8ba4dce37c78267900e33801422f116c2e0b23cfbd609"} Jul 23 14:10:52.167079 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.167061 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-thrtj_368b9cb3-9200-489d-b70c-832898906791/console-operator/1.log" Jul 23 14:10:52.167619 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.167602 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-thrtj_368b9cb3-9200-489d-b70c-832898906791/console-operator/0.log" Jul 23 14:10:52.167723 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.167638 2583 generic.go:356] "Generic (PLEG): container finished" podID="368b9cb3-9200-489d-b70c-832898906791" containerID="7e1a94ebc469e1cc6e11c367099a0370f9b4b7d624f8437469a70ea8a7af06b9" exitCode=255 Jul 23 14:10:52.167775 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.167722 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-thrtj" event={"ID":"368b9cb3-9200-489d-b70c-832898906791","Type":"ContainerDied","Data":"7e1a94ebc469e1cc6e11c367099a0370f9b4b7d624f8437469a70ea8a7af06b9"} Jul 23 14:10:52.167775 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.167762 2583 scope.go:117] "RemoveContainer" containerID="6f8c4e4a2f79fad0536f1418c24d23795342fae8a0be2d4cdbc11d5d4345d990" Jul 23 14:10:52.168015 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.167998 2583 scope.go:117] "RemoveContainer" containerID="7e1a94ebc469e1cc6e11c367099a0370f9b4b7d624f8437469a70ea8a7af06b9" Jul 23 14:10:52.168166 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:52.168147 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-thrtj_openshift-console-operator(368b9cb3-9200-489d-b70c-832898906791)\"" pod="openshift-console-operator/console-operator-565b7b569d-thrtj" podUID="368b9cb3-9200-489d-b70c-832898906791" Jul 23 14:10:52.317504 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.317473 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:52.404378 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.404348 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:52.478649 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.478566 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:52.583870 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.583826 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:52.691403 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.691365 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:52.736584 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.736502 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4xlxs"] Jul 23 14:10:52.758187 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.758158 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4xlxs"] Jul 23 14:10:52.758369 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.758301 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:10:52.762956 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.762940 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-89n5f\"" Jul 23 14:10:52.763056 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.762946 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 23 14:10:52.763200 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.763187 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 23 14:10:52.799180 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.799152 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:52.921821 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.921792 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:52.943970 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.943936 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed4d4a24-2777-4c57-918a-285294003836-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:10:52.944124 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.943975 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7jgl\" (UniqueName: \"kubernetes.io/projected/ed4d4a24-2777-4c57-918a-285294003836-kube-api-access-t7jgl\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:10:52.944124 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.944005 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed4d4a24-2777-4c57-918a-285294003836-data-volume\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:10:52.944124 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.944083 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed4d4a24-2777-4c57-918a-285294003836-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:10:52.944220 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:52.944125 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ed4d4a24-2777-4c57-918a-285294003836-crio-socket\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:10:53.020502 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:53.020471 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:53.044781 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:53.044749 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ed4d4a24-2777-4c57-918a-285294003836-crio-socket\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:10:53.044933 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:53.044868 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ed4d4a24-2777-4c57-918a-285294003836-crio-socket\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:10:53.044933 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:53.044875 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed4d4a24-2777-4c57-918a-285294003836-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:10:53.044933 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:53.044905 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7jgl\" (UniqueName: \"kubernetes.io/projected/ed4d4a24-2777-4c57-918a-285294003836-kube-api-access-t7jgl\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:10:53.044933 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:53.044926 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed4d4a24-2777-4c57-918a-285294003836-data-volume\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:10:53.045124 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:53.044951 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed4d4a24-2777-4c57-918a-285294003836-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:10:53.045124 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:53.044953 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 14:10:53.045124 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:53.045019 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 14:10:53.045124 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:53.045049 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed4d4a24-2777-4c57-918a-285294003836-insights-runtime-extractor-tls podName:ed4d4a24-2777-4c57-918a-285294003836 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:53.545032744 +0000 UTC m=+49.104861081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ed4d4a24-2777-4c57-918a-285294003836-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4xlxs" (UID: "ed4d4a24-2777-4c57-918a-285294003836") : secret "insights-runtime-extractor-tls" not found Jul 23 14:10:53.045124 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:53.045065 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed4d4a24-2777-4c57-918a-285294003836-kube-rbac-proxy-cm podName:ed4d4a24-2777-4c57-918a-285294003836 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:53.545057103 +0000 UTC m=+49.104885423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ed4d4a24-2777-4c57-918a-285294003836-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4xlxs" (UID: "ed4d4a24-2777-4c57-918a-285294003836") : configmap "kube-rbac-proxy" not found Jul 23 14:10:53.045338 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:53.045207 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed4d4a24-2777-4c57-918a-285294003836-data-volume\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:10:53.054950 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:53.054929 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7jgl\" (UniqueName: \"kubernetes.io/projected/ed4d4a24-2777-4c57-918a-285294003836-kube-api-access-t7jgl\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:10:53.178761 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:53.178727 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hlpcq" event={"ID":"6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4","Type":"ContainerStarted","Data":"a5498e0e80c293acf3de502450d17d8a452c892bad7db53633229a720c76bbf6"} Jul 23 14:10:53.180168 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:53.180152 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-thrtj_368b9cb3-9200-489d-b70c-832898906791/console-operator/1.log" Jul 23 14:10:53.180481 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:53.180463 2583 scope.go:117] "RemoveContainer" containerID="7e1a94ebc469e1cc6e11c367099a0370f9b4b7d624f8437469a70ea8a7af06b9" Jul 23 14:10:53.180639 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:53.180621 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-thrtj_openshift-console-operator(368b9cb3-9200-489d-b70c-832898906791)\"" pod="openshift-console-operator/console-operator-565b7b569d-thrtj" podUID="368b9cb3-9200-489d-b70c-832898906791" Jul 23 14:10:53.226661 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:53.226614 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hlpcq" podStartSLOduration=7.9183956680000005 podStartE2EDuration="48.226598186s" totalImagesPullingTime="40.308202518s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:10:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:10:53.223955352 +0000 UTC m=+48.783783694" watchObservedRunningTime="2026-07-23 14:10:53.226598186 +0000 UTC m=+48.786426564" Jul 23 14:10:53.550873 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:53.550831 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed4d4a24-2777-4c57-918a-285294003836-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:10:53.551061 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:53.550892 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed4d4a24-2777-4c57-918a-285294003836-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:10:53.551061 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:53.550975 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 14:10:53.551061 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:53.550986 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 14:10:53.551061 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:53.551043 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed4d4a24-2777-4c57-918a-285294003836-kube-rbac-proxy-cm podName:ed4d4a24-2777-4c57-918a-285294003836 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:54.55102476 +0000 UTC m=+50.110853097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ed4d4a24-2777-4c57-918a-285294003836-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4xlxs" (UID: "ed4d4a24-2777-4c57-918a-285294003836") : configmap "kube-rbac-proxy" not found Jul 23 14:10:53.551061 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:53.551060 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed4d4a24-2777-4c57-918a-285294003836-insights-runtime-extractor-tls podName:ed4d4a24-2777-4c57-918a-285294003836 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:54.551051409 +0000 UTC m=+50.110879728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ed4d4a24-2777-4c57-918a-285294003836-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4xlxs" (UID: "ed4d4a24-2777-4c57-918a-285294003836") : secret "insights-runtime-extractor-tls" not found Jul 23 14:10:53.614047 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:53.614010 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:53.716370 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:53.716333 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:54.235232 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:54.235196 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:54.371134 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:54.371100 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:54.559758 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:54.559722 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed4d4a24-2777-4c57-918a-285294003836-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:10:54.559921 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:54.559771 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed4d4a24-2777-4c57-918a-285294003836-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:10:54.559921 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:54.559833 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 14:10:54.559921 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:54.559853 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 14:10:54.559921 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:54.559898 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed4d4a24-2777-4c57-918a-285294003836-kube-rbac-proxy-cm podName:ed4d4a24-2777-4c57-918a-285294003836 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:56.559883723 +0000 UTC m=+52.119712042 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ed4d4a24-2777-4c57-918a-285294003836-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4xlxs" (UID: "ed4d4a24-2777-4c57-918a-285294003836") : configmap "kube-rbac-proxy" not found Jul 23 14:10:54.559921 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:54.559912 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed4d4a24-2777-4c57-918a-285294003836-insights-runtime-extractor-tls podName:ed4d4a24-2777-4c57-918a-285294003836 nodeName:}" failed. No retries permitted until 2026-07-23 14:10:56.559905927 +0000 UTC m=+52.119734246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ed4d4a24-2777-4c57-918a-285294003836-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4xlxs" (UID: "ed4d4a24-2777-4c57-918a-285294003836") : secret "insights-runtime-extractor-tls" not found Jul 23 14:10:55.262056 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:55.262015 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:55.333058 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:55.333032 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f97l5_f0d66bd7-7a9d-48d2-904b-621a1eacc15e/dns-node-resolver/0.log" Jul 23 14:10:55.378140 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:55.378110 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:55.669112 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:55.669076 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b0bbf318-4828-4843-867e-438dbf40fae0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-l4sls\" (UID: \"b0bbf318-4828-4843-867e-438dbf40fae0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-l4sls" Jul 23 14:10:55.669309 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:55.669122 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:10:55.669309 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:55.669252 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 14:10:55.669309 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:55.669298 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 14:10:55.669449 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:55.669318 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c7487ddc-74nwt: secret "image-registry-tls" not found Jul 23 14:10:55.669449 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:55.669325 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0bbf318-4828-4843-867e-438dbf40fae0-samples-operator-tls podName:b0bbf318-4828-4843-867e-438dbf40fae0 nodeName:}" failed. No retries permitted until 2026-07-23 14:11:11.669304866 +0000 UTC m=+67.229133209 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b0bbf318-4828-4843-867e-438dbf40fae0-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-l4sls" (UID: "b0bbf318-4828-4843-867e-438dbf40fae0") : secret "samples-operator-tls" not found Jul 23 14:10:55.669449 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:55.669358 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls podName:26f702c8-73af-4693-95ac-2c03483b6116 nodeName:}" failed. No retries permitted until 2026-07-23 14:11:11.669346377 +0000 UTC m=+67.229174697 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls") pod "image-registry-75c7487ddc-74nwt" (UID: "26f702c8-73af-4693-95ac-2c03483b6116") : secret "image-registry-tls" not found Jul 23 14:10:55.769752 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:55.769715 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2cxf9\" (UID: \"b7938e65-26db-4bf0-9cdd-eb340fba0ba7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9" Jul 23 14:10:55.769938 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:55.769766 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9e8f751-c4aa-4c3b-a110-de695a817c76-service-ca-bundle\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:55.769938 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:55.769787 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4ff440c-7a41-4adf-956d-8f2d35b0889f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dtqtx\" (UID: \"a4ff440c-7a41-4adf-956d-8f2d35b0889f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtqtx" Jul 23 14:10:55.769938 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:55.769848 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-metrics-certs\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:10:55.769938 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:55.769880 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 14:10:55.769938 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:55.769909 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9e8f751-c4aa-4c3b-a110-de695a817c76-service-ca-bundle podName:e9e8f751-c4aa-4c3b-a110-de695a817c76 nodeName:}" failed. No retries permitted until 2026-07-23 14:11:11.769889868 +0000 UTC m=+67.329718192 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e9e8f751-c4aa-4c3b-a110-de695a817c76-service-ca-bundle") pod "router-default-695b7bcf8d-qtpwr" (UID: "e9e8f751-c4aa-4c3b-a110-de695a817c76") : configmap references non-existent config key: service-ca.crt Jul 23 14:10:55.770132 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:55.769939 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 14:10:55.770132 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:55.769968 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 23 14:10:55.770132 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:55.769882 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-metrics-tls\") pod \"dns-default-6c44f\" (UID: \"d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b\") " pod="openshift-dns/dns-default-6c44f" Jul 23 14:10:55.770132 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:55.769940 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-cluster-monitoring-operator-tls podName:b7938e65-26db-4bf0-9cdd-eb340fba0ba7 nodeName:}" failed. No retries permitted until 2026-07-23 14:11:11.769923318 +0000 UTC m=+67.329751640 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2cxf9" (UID: "b7938e65-26db-4bf0-9cdd-eb340fba0ba7") : secret "cluster-monitoring-operator-tls" not found Jul 23 14:10:55.770132 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:55.769981 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 14:10:55.770132 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:55.770024 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4ff440c-7a41-4adf-956d-8f2d35b0889f-networking-console-plugin-cert podName:a4ff440c-7a41-4adf-956d-8f2d35b0889f nodeName:}" failed. No retries permitted until 2026-07-23 14:11:11.770012519 +0000 UTC m=+67.329840840 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a4ff440c-7a41-4adf-956d-8f2d35b0889f-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dtqtx" (UID: "a4ff440c-7a41-4adf-956d-8f2d35b0889f") : secret "networking-console-plugin-cert" not found Jul 23 14:10:55.770132 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:55.770035 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-metrics-certs podName:e9e8f751-c4aa-4c3b-a110-de695a817c76 nodeName:}" failed. No retries permitted until 2026-07-23 14:11:11.770029954 +0000 UTC m=+67.329858275 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-metrics-certs") pod "router-default-695b7bcf8d-qtpwr" (UID: "e9e8f751-c4aa-4c3b-a110-de695a817c76") : secret "router-metrics-certs-default" not found Jul 23 14:10:55.770132 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:55.770048 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-metrics-tls podName:d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b nodeName:}" failed. No retries permitted until 2026-07-23 14:11:11.770040277 +0000 UTC m=+67.329868597 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-metrics-tls") pod "dns-default-6c44f" (UID: "d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b") : secret "dns-default-metrics-tls" not found Jul 23 14:10:56.099899 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:56.099864 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:56.248181 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:56.248147 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:56.531496 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:56.531468 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nplv4_4d86c011-dcb3-4103-badd-9557cc53906a/node-ca/0.log" Jul 23 14:10:56.554490 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:56.554458 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:56.576965 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:56.576929 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed4d4a24-2777-4c57-918a-285294003836-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:10:56.577101 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:56.576988 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed4d4a24-2777-4c57-918a-285294003836-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:10:56.577101 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:56.577080 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 14:10:56.577175 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:10:56.577139 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed4d4a24-2777-4c57-918a-285294003836-insights-runtime-extractor-tls podName:ed4d4a24-2777-4c57-918a-285294003836 nodeName:}" failed. No retries permitted until 2026-07-23 14:11:00.577122952 +0000 UTC m=+56.136951296 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ed4d4a24-2777-4c57-918a-285294003836-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4xlxs" (UID: "ed4d4a24-2777-4c57-918a-285294003836") : secret "insights-runtime-extractor-tls" not found Jul 23 14:10:56.577529 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:56.577511 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed4d4a24-2777-4c57-918a-285294003836-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:10:56.662785 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:56.662752 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:57.331166 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:57.331136 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5bqgn_0d1e7c79-7575-481a-af5b-b3371a5e317d/serve-healthcheck-canary/0.log" Jul 23 14:10:58.129711 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:58.129676 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-n7bbn_6fca46de-acd7-4911-8fc7-3dcefade899e/kube-storage-version-migrator-operator/0.log" Jul 23 14:10:58.566195 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:58.566167 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:58.700503 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:58.700467 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:58.803008 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:58.802968 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:58.944669 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:58.944587 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:59.046790 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:59.046756 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:59.153832 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:59.153800 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:59.272909 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:59.272880 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:10:59.863308 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:10:59.863272 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:00.200551 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:00.200472 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-thrtj" Jul 23 14:11:00.200551 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:00.200529 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-thrtj" Jul 23 14:11:00.201011 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:00.200856 2583 scope.go:117] "RemoveContainer" containerID="7e1a94ebc469e1cc6e11c367099a0370f9b4b7d624f8437469a70ea8a7af06b9" Jul 23 14:11:00.201047 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:11:00.201001 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-thrtj_openshift-console-operator(368b9cb3-9200-489d-b70c-832898906791)\"" pod="openshift-console-operator/console-operator-565b7b569d-thrtj" podUID="368b9cb3-9200-489d-b70c-832898906791" Jul 23 14:11:00.458789 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:00.458698 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:00.609122 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:00.609085 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed4d4a24-2777-4c57-918a-285294003836-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:11:00.609320 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:11:00.609206 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 14:11:00.609320 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:11:00.609279 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed4d4a24-2777-4c57-918a-285294003836-insights-runtime-extractor-tls podName:ed4d4a24-2777-4c57-918a-285294003836 nodeName:}" failed. No retries permitted until 2026-07-23 14:11:08.609266039 +0000 UTC m=+64.169094359 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ed4d4a24-2777-4c57-918a-285294003836-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4xlxs" (UID: "ed4d4a24-2777-4c57-918a-285294003836") : secret "insights-runtime-extractor-tls" not found Jul 23 14:11:00.665867 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:00.665829 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:00.858190 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:00.858160 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:01.053297 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:01.053261 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:01.254278 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:01.254176 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:01.322460 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:01.322428 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:02.258077 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:02.258046 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:02.390073 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:02.390043 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:02.662574 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:02.662543 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:02.858707 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:02.858675 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:03.059029 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:03.058995 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:03.159829 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:03.159794 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:03.262731 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:03.262696 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:04.056192 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:04.056163 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:04.156075 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:04.156035 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:04.257753 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:04.257716 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:04.448774 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:04.448693 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:04.855812 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:04.855784 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:04.958209 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:04.958180 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:05.301157 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:05.301121 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:05.469825 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:05.469795 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:05.931752 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:05.931718 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:06.465988 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:06.465946 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:06.885741 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:06.885709 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:07.071506 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:07.071480 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cgj4x" Jul 23 14:11:07.264096 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:07.263990 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:07.502220 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:07.502160 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:07.885632 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:07.885601 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:08.010802 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:08.010771 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:08.274932 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:08.274903 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:08.686355 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:08.686271 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed4d4a24-2777-4c57-918a-285294003836-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:11:08.688554 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:08.688525 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed4d4a24-2777-4c57-918a-285294003836-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4xlxs\" (UID: \"ed4d4a24-2777-4c57-918a-285294003836\") " pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:11:08.723206 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:08.723182 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:08.969550 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:08.969473 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-89n5f\"" Jul 23 14:11:08.977828 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:08.977809 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4xlxs" Jul 23 14:11:09.074474 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:09.074420 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:09.117468 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:09.117438 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4xlxs"] Jul 23 14:11:09.120515 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:11:09.120495 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded4d4a24_2777_4c57_918a_285294003836.slice/crio-7401b59dc95b5543dd171c2feab128fb8418319c34a66df107f9a7375510dd06 WatchSource:0}: Error finding container 7401b59dc95b5543dd171c2feab128fb8418319c34a66df107f9a7375510dd06: Status 404 returned error can't find the container with id 7401b59dc95b5543dd171c2feab128fb8418319c34a66df107f9a7375510dd06 Jul 23 14:11:09.230230 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:09.230142 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4xlxs" event={"ID":"ed4d4a24-2777-4c57-918a-285294003836","Type":"ContainerStarted","Data":"7401b59dc95b5543dd171c2feab128fb8418319c34a66df107f9a7375510dd06"} Jul 23 14:11:09.295954 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:09.295922 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:10.511089 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:10.511046 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret\") pod \"global-pull-secret-syncer-9rmzs\" (UID: \"c33444eb-d4db-46c0-a1fe-23a9191cd4f5\") " pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:11:10.514290 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:10.514267 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 14:11:10.523895 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:10.523873 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c33444eb-d4db-46c0-a1fe-23a9191cd4f5-original-pull-secret\") pod \"global-pull-secret-syncer-9rmzs\" (UID: \"c33444eb-d4db-46c0-a1fe-23a9191cd4f5\") " pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:11:10.611011 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:10.610974 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9rmzs" Jul 23 14:11:10.612344 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:10.612314 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs\") pod \"network-metrics-daemon-hhx5z\" (UID: \"d96c127f-a6dd-40c9-8dab-1a64c2af3f75\") " pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:11:10.615392 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:10.615369 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 14:11:10.625212 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:10.625160 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d96c127f-a6dd-40c9-8dab-1a64c2af3f75-metrics-certs\") pod \"network-metrics-daemon-hhx5z\" (UID: \"d96c127f-a6dd-40c9-8dab-1a64c2af3f75\") " pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:11:10.713949 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:10.713912 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vsqx\" (UniqueName: \"kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx\") pod \"network-check-target-r8nkd\" (UID: \"45236e03-e24a-4cc3-a8a3-814bc70d6b01\") " pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:11:10.717452 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:10.717416 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vsqx\" (UniqueName: \"kubernetes.io/projected/45236e03-e24a-4cc3-a8a3-814bc70d6b01-kube-api-access-5vsqx\") pod \"network-check-target-r8nkd\" (UID: \"45236e03-e24a-4cc3-a8a3-814bc70d6b01\") " pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:11:10.762204 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:10.762134 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9rmzs"] Jul 23 14:11:10.765674 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:11:10.765644 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc33444eb_d4db_46c0_a1fe_23a9191cd4f5.slice/crio-fa95326254d5c0415d978cce955b7f1b1c1cd1ba7dcd0de1864a29b7af317b77 WatchSource:0}: Error finding container fa95326254d5c0415d978cce955b7f1b1c1cd1ba7dcd0de1864a29b7af317b77: Status 404 returned error can't find the container with id fa95326254d5c0415d978cce955b7f1b1c1cd1ba7dcd0de1864a29b7af317b77 Jul 23 14:11:10.898202 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:10.898176 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4kmz9\"" Jul 23 14:11:10.905565 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:10.905543 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:11:10.906363 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:10.906335 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6lvrs\"" Jul 23 14:11:10.913517 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:10.913494 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhx5z" Jul 23 14:11:11.055696 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.055665 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r8nkd"] Jul 23 14:11:11.060685 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:11:11.060654 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45236e03_e24a_4cc3_a8a3_814bc70d6b01.slice/crio-e25ae73ce184cb88c78bba986f54c850800331c00af74e1af6f2f1cf80b47628 WatchSource:0}: Error finding container e25ae73ce184cb88c78bba986f54c850800331c00af74e1af6f2f1cf80b47628: Status 404 returned error can't find the container with id e25ae73ce184cb88c78bba986f54c850800331c00af74e1af6f2f1cf80b47628 Jul 23 14:11:11.076670 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.076646 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hhx5z"] Jul 23 14:11:11.079312 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:11:11.079291 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd96c127f_a6dd_40c9_8dab_1a64c2af3f75.slice/crio-43f186a4e7e0e5dfdf0bff69b987448f277095341be6d7f9319a9af81d463da1 WatchSource:0}: Error finding container 43f186a4e7e0e5dfdf0bff69b987448f277095341be6d7f9319a9af81d463da1: Status 404 returned error can't find the container with id 43f186a4e7e0e5dfdf0bff69b987448f277095341be6d7f9319a9af81d463da1 Jul 23 14:11:11.238754 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.238710 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hhx5z" event={"ID":"d96c127f-a6dd-40c9-8dab-1a64c2af3f75","Type":"ContainerStarted","Data":"43f186a4e7e0e5dfdf0bff69b987448f277095341be6d7f9319a9af81d463da1"} Jul 23 14:11:11.240363 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.240336 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r8nkd" event={"ID":"45236e03-e24a-4cc3-a8a3-814bc70d6b01","Type":"ContainerStarted","Data":"dd2efdca79c7f50b512ad9383ecbb5b7af0db63df2a6b5d825f4cac2ca4a1099"} Jul 23 14:11:11.240497 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.240383 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r8nkd" event={"ID":"45236e03-e24a-4cc3-a8a3-814bc70d6b01","Type":"ContainerStarted","Data":"e25ae73ce184cb88c78bba986f54c850800331c00af74e1af6f2f1cf80b47628"} Jul 23 14:11:11.240497 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.240435 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:11:11.241797 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.241772 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9rmzs" event={"ID":"c33444eb-d4db-46c0-a1fe-23a9191cd4f5","Type":"ContainerStarted","Data":"fa95326254d5c0415d978cce955b7f1b1c1cd1ba7dcd0de1864a29b7af317b77"} Jul 23 14:11:11.262060 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.262019 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r8nkd" podStartSLOduration=66.262003242 podStartE2EDuration="1m6.262003242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:10:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:11:11.261908108 +0000 UTC m=+66.821736451" watchObservedRunningTime="2026-07-23 14:11:11.262003242 +0000 UTC m=+66.821831585" Jul 23 14:11:11.542679 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.542648 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:11.614609 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.614577 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:11.725119 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.725082 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b0bbf318-4828-4843-867e-438dbf40fae0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-l4sls\" (UID: \"b0bbf318-4828-4843-867e-438dbf40fae0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-l4sls" Jul 23 14:11:11.725315 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.725135 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:11:11.728209 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.728159 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b0bbf318-4828-4843-867e-438dbf40fae0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-l4sls\" (UID: \"b0bbf318-4828-4843-867e-438dbf40fae0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-l4sls" Jul 23 14:11:11.729194 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.729173 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls\") pod \"image-registry-75c7487ddc-74nwt\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:11:11.826686 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.826604 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-metrics-certs\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:11:11.826686 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.826666 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-metrics-tls\") pod \"dns-default-6c44f\" (UID: \"d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b\") " pod="openshift-dns/dns-default-6c44f" Jul 23 14:11:11.826903 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.826703 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2cxf9\" (UID: \"b7938e65-26db-4bf0-9cdd-eb340fba0ba7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9" Jul 23 14:11:11.826903 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.826743 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9e8f751-c4aa-4c3b-a110-de695a817c76-service-ca-bundle\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:11:11.826903 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.826776 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4ff440c-7a41-4adf-956d-8f2d35b0889f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dtqtx\" (UID: \"a4ff440c-7a41-4adf-956d-8f2d35b0889f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtqtx" Jul 23 14:11:11.827931 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.827879 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9e8f751-c4aa-4c3b-a110-de695a817c76-service-ca-bundle\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:11:11.829868 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.829843 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4ff440c-7a41-4adf-956d-8f2d35b0889f-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dtqtx\" (UID: \"a4ff440c-7a41-4adf-956d-8f2d35b0889f\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtqtx" Jul 23 14:11:11.830471 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.830448 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9e8f751-c4aa-4c3b-a110-de695a817c76-metrics-certs\") pod \"router-default-695b7bcf8d-qtpwr\" (UID: \"e9e8f751-c4aa-4c3b-a110-de695a817c76\") " pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:11:11.830638 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.830619 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b-metrics-tls\") pod \"dns-default-6c44f\" (UID: \"d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b\") " pod="openshift-dns/dns-default-6c44f" Jul 23 14:11:11.831290 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.831226 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7938e65-26db-4bf0-9cdd-eb340fba0ba7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2cxf9\" (UID: \"b7938e65-26db-4bf0-9cdd-eb340fba0ba7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9" Jul 23 14:11:11.929512 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.929481 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7876l\"" Jul 23 14:11:11.937608 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.937510 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:11:11.958426 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.958400 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lxrmg\"" Jul 23 14:11:11.966864 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.966844 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-l4sls" Jul 23 14:11:11.985530 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.985507 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8msz5\"" Jul 23 14:11:11.993258 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.993213 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9" Jul 23 14:11:11.993376 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:11.993313 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-99t4g\"" Jul 23 14:11:12.001475 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:12.001309 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:11:12.010793 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:12.010763 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wtwlc\"" Jul 23 14:11:12.018848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:12.018732 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6c44f" Jul 23 14:11:12.032094 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:12.032055 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-gvwtb\"" Jul 23 14:11:12.040055 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:12.040025 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtqtx" Jul 23 14:11:12.879617 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:12.879582 2583 scope.go:117] "RemoveContainer" containerID="7e1a94ebc469e1cc6e11c367099a0370f9b4b7d624f8437469a70ea8a7af06b9" Jul 23 14:11:15.204518 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:15.204480 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:15.318017 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:15.317981 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:15.826094 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:15.826070 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-l4sls"] Jul 23 14:11:15.848462 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:15.848428 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:15.918207 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:15.918178 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:16.191206 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:16.191114 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9"] Jul 23 14:11:16.195971 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:11:16.195936 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7938e65_26db_4bf0_9cdd_eb340fba0ba7.slice/crio-ac506b418652dff4ae6bf8a01669727bce01b9cb4e040e7f320254a64e8d55e2 WatchSource:0}: Error finding container ac506b418652dff4ae6bf8a01669727bce01b9cb4e040e7f320254a64e8d55e2: Status 404 returned error can't find the container with id ac506b418652dff4ae6bf8a01669727bce01b9cb4e040e7f320254a64e8d55e2 Jul 23 14:11:16.215635 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:16.215601 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6c44f"] Jul 23 14:11:16.222757 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:16.222734 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-dtqtx"] Jul 23 14:11:16.230017 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:11:16.229983 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4ff440c_7a41_4adf_956d_8f2d35b0889f.slice/crio-06b9f98aeaa5d10ad6214098ac5e1906b1c56d9d4e2f319eedad5e4a79d940b7 WatchSource:0}: Error finding container 06b9f98aeaa5d10ad6214098ac5e1906b1c56d9d4e2f319eedad5e4a79d940b7: Status 404 returned error can't find the container with id 06b9f98aeaa5d10ad6214098ac5e1906b1c56d9d4e2f319eedad5e4a79d940b7 Jul 23 14:11:16.241431 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:16.241352 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-695b7bcf8d-qtpwr"] Jul 23 14:11:16.267275 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:16.266003 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75c7487ddc-74nwt"] Jul 23 14:11:16.269151 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:16.269124 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" event={"ID":"e9e8f751-c4aa-4c3b-a110-de695a817c76","Type":"ContainerStarted","Data":"495b23beb5a31317d85fef63c3421f9d24d4fbc80fb2a2a40a68fc7d835a77fc"} Jul 23 14:11:16.271797 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:16.271774 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-thrtj_368b9cb3-9200-489d-b70c-832898906791/console-operator/1.log" Jul 23 14:11:16.271897 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:16.271872 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-thrtj" event={"ID":"368b9cb3-9200-489d-b70c-832898906791","Type":"ContainerStarted","Data":"6b718d02ae3d24ef477e6b9c7fe7ea16f776b222344f56b163f7ff97b420f458"} Jul 23 14:11:16.272724 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:16.272674 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-thrtj" Jul 23 14:11:16.276447 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:16.276398 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9rmzs" event={"ID":"c33444eb-d4db-46c0-a1fe-23a9191cd4f5","Type":"ContainerStarted","Data":"1bb7728341205403ffda584940adcc4b05641d0c5a0709f07194c58a5c1d858e"} Jul 23 14:11:16.277790 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:16.277767 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtqtx" event={"ID":"a4ff440c-7a41-4adf-956d-8f2d35b0889f","Type":"ContainerStarted","Data":"06b9f98aeaa5d10ad6214098ac5e1906b1c56d9d4e2f319eedad5e4a79d940b7"} Jul 23 14:11:16.280076 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:16.280049 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9" event={"ID":"b7938e65-26db-4bf0-9cdd-eb340fba0ba7","Type":"ContainerStarted","Data":"ac506b418652dff4ae6bf8a01669727bce01b9cb4e040e7f320254a64e8d55e2"} Jul 23 14:11:16.289916 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:16.289854 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6c44f" event={"ID":"d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b","Type":"ContainerStarted","Data":"74ebc330bad1c2b62aab6433af8ef198b4553a70263b3de60ae219ffa0eedfcf"} Jul 23 14:11:16.293366 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:16.293291 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-l4sls" event={"ID":"b0bbf318-4828-4843-867e-438dbf40fae0","Type":"ContainerStarted","Data":"15432d87b0a80ac914e075cc2027f47b540073f37d725a3727b3ba0b39c87356"} Jul 23 14:11:16.298824 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:16.298795 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4xlxs" event={"ID":"ed4d4a24-2777-4c57-918a-285294003836","Type":"ContainerStarted","Data":"361d2064c689f6f60eca7182f2b7a775eb3530623f52d2fb88eef0466e02a432"} Jul 23 14:11:16.303524 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:16.303502 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hhx5z" event={"ID":"d96c127f-a6dd-40c9-8dab-1a64c2af3f75","Type":"ContainerStarted","Data":"308291129d79e6272482f811798bc0e2e86277465db68f617f38835c315a6974"} Jul 23 14:11:16.318201 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:16.317809 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-thrtj" podStartSLOduration=43.481678501 podStartE2EDuration="53.317788828s" totalImagesPullingTime="9.836110327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:11:16.29768315 +0000 UTC m=+71.857511493" watchObservedRunningTime="2026-07-23 14:11:16.317788828 +0000 UTC m=+71.877617171" Jul 23 14:11:16.318424 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:16.318318 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9rmzs" podStartSLOduration=66.084980686 podStartE2EDuration="1m11.318308238s" totalImagesPullingTime="5.233327552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:11:16.31560112 +0000 UTC m=+71.875429463" watchObservedRunningTime="2026-07-23 14:11:16.318308238 +0000 UTC m=+71.878136581" Jul 23 14:11:17.086651 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:17.086399 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-thrtj" Jul 23 14:11:17.315413 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:17.315352 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hhx5z" event={"ID":"d96c127f-a6dd-40c9-8dab-1a64c2af3f75","Type":"ContainerStarted","Data":"6d561bccda062f4279c7a81d4c2213001b4ed272574613ab8275a8c6f96111dc"} Jul 23 14:11:17.321308 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:17.321280 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:17.321654 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:17.321597 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" event={"ID":"e9e8f751-c4aa-4c3b-a110-de695a817c76","Type":"ContainerStarted","Data":"4f08b82986b68eb74c466584b4f14ea932a7536099856c6d88c26bf162974ee5"} Jul 23 14:11:17.327904 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:17.327420 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" event={"ID":"26f702c8-73af-4693-95ac-2c03483b6116","Type":"ContainerStarted","Data":"2a0b1ae8261b48c83aae0a2524f6a984a3b50a96eef9f9fe3f6358ef76383b15"} Jul 23 14:11:17.327904 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:17.327461 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" event={"ID":"26f702c8-73af-4693-95ac-2c03483b6116","Type":"ContainerStarted","Data":"e5660d452a6bcb71cc7f7fae5222b9e18f83e443a3f4a0974bb1949c0788c207"} Jul 23 14:11:17.327904 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:17.327490 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:11:17.344552 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:17.344424 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hhx5z" podStartSLOduration=67.417326561 podStartE2EDuration="1m12.344404387s" totalImagesPullingTime="4.927077826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:11:17.343139456 +0000 UTC m=+72.902967798" watchObservedRunningTime="2026-07-23 14:11:17.344404387 +0000 UTC m=+72.904232731" Jul 23 14:11:17.371468 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:17.370427 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" podStartSLOduration=54.370406693 podStartE2EDuration="54.370406693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:10:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:11:17.369486891 +0000 UTC m=+72.929315234" watchObservedRunningTime="2026-07-23 14:11:17.370406693 +0000 UTC m=+72.930235037" Jul 23 14:11:17.397418 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:17.397366 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" podStartSLOduration=72.397344101 podStartE2EDuration="1m12.397344101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:10:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:11:17.394815067 +0000 UTC m=+72.954643423" watchObservedRunningTime="2026-07-23 14:11:17.397344101 +0000 UTC m=+72.957172444" Jul 23 14:11:17.409497 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:17.409467 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:17.509469 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:17.509367 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:17.608826 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:17.608710 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:17.679264 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:17.679166 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:17.764920 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:17.764884 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:17.955615 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:17.955532 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:18.002421 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:18.002342 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:11:18.005711 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:18.005504 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:11:18.046733 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:18.046697 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:18.331253 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:18.331184 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:11:18.332791 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:18.332767 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-695b7bcf8d-qtpwr" Jul 23 14:11:18.374833 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:18.374758 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:18.979982 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:18.979951 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:19.168493 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:19.168434 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:19.581289 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:19.581226 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:19.793443 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:19.793401 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:19.861930 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:19.861854 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:20.039153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:20.039117 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:20.103299 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:20.103259 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:20.926788 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:20.926755 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:21.028040 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:21.028000 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:21.103393 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:21.103369 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:23.349914 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:23.349874 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-l4sls" event={"ID":"b0bbf318-4828-4843-867e-438dbf40fae0","Type":"ContainerStarted","Data":"781817dff1ba2ccd58b0937f718ade956dbcd202a4214e08cc69924c42ee22cb"} Jul 23 14:11:23.351466 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:23.351443 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtqtx" event={"ID":"a4ff440c-7a41-4adf-956d-8f2d35b0889f","Type":"ContainerStarted","Data":"3b4b35e52aa9a9e2b91a3d166ad3e1fdefae947eb1219299eab02adf4c0314a5"} Jul 23 14:11:23.352811 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:23.352791 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9" event={"ID":"b7938e65-26db-4bf0-9cdd-eb340fba0ba7","Type":"ContainerStarted","Data":"88d35efc5e1699da12cf2b45d46638963e870a05dfaabc5cdacf5e7d646956f4"} Jul 23 14:11:23.475467 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:23.475404 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtqtx" podStartSLOduration=44.580031022 podStartE2EDuration="51.47536876s" totalImagesPullingTime="6.895337738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:11:23.473824438 +0000 UTC m=+79.033652781" watchObservedRunningTime="2026-07-23 14:11:23.47536876 +0000 UTC m=+79.035197096" Jul 23 14:11:23.518914 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:23.518869 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2cxf9" podStartSLOduration=53.59484119 podStartE2EDuration="1m0.518815914s" totalImagesPullingTime="6.923974724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:11:23.518298234 +0000 UTC m=+79.078126579" watchObservedRunningTime="2026-07-23 14:11:23.518815914 +0000 UTC m=+79.078644250" Jul 23 14:11:23.694660 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:23.694566 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:23.796112 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:23.796083 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:23.838936 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:23.838903 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xqkxj"] Jul 23 14:11:23.860586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:23.860561 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xqkxj"] Jul 23 14:11:23.860762 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:23.860649 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xqkxj" Jul 23 14:11:23.863511 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:23.863488 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 23 14:11:23.863622 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:23.863569 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-thrp9\"" Jul 23 14:11:23.962058 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:23.961963 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:24.034935 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:24.034903 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/46868454-2467-4d82-8783-0d86543beddf-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-xqkxj\" (UID: \"46868454-2467-4d82-8783-0d86543beddf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xqkxj" Jul 23 14:11:24.136260 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:24.136206 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/46868454-2467-4d82-8783-0d86543beddf-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-xqkxj\" (UID: \"46868454-2467-4d82-8783-0d86543beddf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xqkxj" Jul 23 14:11:24.136458 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:11:24.136366 2583 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 23 14:11:24.136458 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:11:24.136443 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46868454-2467-4d82-8783-0d86543beddf-tls-certificates podName:46868454-2467-4d82-8783-0d86543beddf nodeName:}" failed. No retries permitted until 2026-07-23 14:11:24.636425567 +0000 UTC m=+80.196253887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/46868454-2467-4d82-8783-0d86543beddf-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-xqkxj" (UID: "46868454-2467-4d82-8783-0d86543beddf") : secret "prometheus-operator-admission-webhook-tls" not found Jul 23 14:11:24.359793 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:24.359756 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6c44f" event={"ID":"d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b","Type":"ContainerStarted","Data":"ed5a6f6f801ccf9c3cfc262b2de078866b36837d092905a8ef0f1ac3fb540059"} Jul 23 14:11:24.360254 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:24.359818 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6c44f" event={"ID":"d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b","Type":"ContainerStarted","Data":"731eb2b6d1a0d696b1a1357ec0aeb8aa665fdc088fd73f5952c133df78b76d79"} Jul 23 14:11:24.360254 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:24.359849 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6c44f" Jul 23 14:11:24.362057 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:24.362030 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-l4sls" event={"ID":"b0bbf318-4828-4843-867e-438dbf40fae0","Type":"ContainerStarted","Data":"9184875b8d4ccff79aaaf10e449b1ceb9ef02072cfa8a6c149366ae8b33d7aa8"} Jul 23 14:11:24.364756 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:24.364727 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4xlxs" event={"ID":"ed4d4a24-2777-4c57-918a-285294003836","Type":"ContainerStarted","Data":"9be38a822121756d16b02b3258252dff0b9c5470f1f99f4603e84f279caf1806"} Jul 23 14:11:24.387580 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:24.387532 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6c44f" podStartSLOduration=38.477694794 podStartE2EDuration="45.387518654s" totalImagesPullingTime="6.90982386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:11:24.38731292 +0000 UTC m=+79.947141264" watchObservedRunningTime="2026-07-23 14:11:24.387518654 +0000 UTC m=+79.947346996" Jul 23 14:11:24.407428 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:24.407377 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-l4sls" podStartSLOduration=54.67656262 podStartE2EDuration="1m1.407361824s" totalImagesPullingTime="6.730799204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:11:24.405746625 +0000 UTC m=+79.965574995" watchObservedRunningTime="2026-07-23 14:11:24.407361824 +0000 UTC m=+79.967190239" Jul 23 14:11:24.503668 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:24.503636 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:24.641650 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:24.641560 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/46868454-2467-4d82-8783-0d86543beddf-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-xqkxj\" (UID: \"46868454-2467-4d82-8783-0d86543beddf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xqkxj" Jul 23 14:11:24.644477 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:24.644448 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/46868454-2467-4d82-8783-0d86543beddf-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-xqkxj\" (UID: \"46868454-2467-4d82-8783-0d86543beddf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xqkxj" Jul 23 14:11:24.770133 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:24.770098 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xqkxj" Jul 23 14:11:24.931318 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:24.931221 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xqkxj"] Jul 23 14:11:24.935408 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:11:24.935379 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46868454_2467_4d82_8783_0d86543beddf.slice/crio-661c37f691dba156a74cc39f2bd53ece38c08ea5eaaaf6ce043339060ca6be2d WatchSource:0}: Error finding container 661c37f691dba156a74cc39f2bd53ece38c08ea5eaaaf6ce043339060ca6be2d: Status 404 returned error can't find the container with id 661c37f691dba156a74cc39f2bd53ece38c08ea5eaaaf6ce043339060ca6be2d Jul 23 14:11:24.958009 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:24.957985 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:25.037902 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:25.037868 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:25.371486 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:25.371438 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xqkxj" event={"ID":"46868454-2467-4d82-8783-0d86543beddf","Type":"ContainerStarted","Data":"661c37f691dba156a74cc39f2bd53ece38c08ea5eaaaf6ce043339060ca6be2d"} Jul 23 14:11:26.656553 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:26.656414 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:26.758371 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:26.758332 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:28.384357 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:28.384318 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xqkxj" event={"ID":"46868454-2467-4d82-8783-0d86543beddf","Type":"ContainerStarted","Data":"746c3fbd743ea033e89857ead7f78a6a1ac02ab58ac1648408bbdaff5159ee2c"} Jul 23 14:11:28.384837 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:28.384409 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xqkxj" Jul 23 14:11:28.386532 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:28.386497 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4xlxs" event={"ID":"ed4d4a24-2777-4c57-918a-285294003836","Type":"ContainerStarted","Data":"f3909d369342411af451b7bb96d057daa1155c66c185adcdce4b109585a86d59"} Jul 23 14:11:28.389491 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:28.389464 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xqkxj" Jul 23 14:11:28.401343 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:28.401305 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xqkxj" podStartSLOduration=2.833618344 podStartE2EDuration="5.401293358s" totalImagesPullingTime="2.567675014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:11:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:11:28.400481136 +0000 UTC m=+83.960309479" watchObservedRunningTime="2026-07-23 14:11:28.401293358 +0000 UTC m=+83.961121700" Jul 23 14:11:28.421782 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:28.421744 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4xlxs" podStartSLOduration=18.391286288 podStartE2EDuration="36.421729978s" totalImagesPullingTime="18.03044369s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:10:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:11:28.42140217 +0000 UTC m=+83.981230513" watchObservedRunningTime="2026-07-23 14:11:28.421729978 +0000 UTC m=+83.981558320" Jul 23 14:11:28.876039 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:28.876007 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:28.963788 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:28.963754 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:29.099859 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.099831 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:29.608925 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.608885 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:29.710102 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.710071 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:29.784536 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.784507 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69cb95dc8d-xls7c"] Jul 23 14:11:29.787900 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.787881 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:29.790624 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.790599 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 23 14:11:29.790624 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.790621 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 23 14:11:29.790793 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.790625 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 23 14:11:29.792007 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.791984 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 23 14:11:29.792122 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.791988 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 23 14:11:29.792122 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.791997 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 23 14:11:29.792122 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.792034 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 23 14:11:29.792122 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.792035 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lvrll\"" Jul 23 14:11:29.797445 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.797428 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 23 14:11:29.800715 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.800695 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69cb95dc8d-xls7c"] Jul 23 14:11:29.887728 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.887655 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-console-config\") pod \"console-69cb95dc8d-xls7c\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:29.887728 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.887687 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-service-ca\") pod \"console-69cb95dc8d-xls7c\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:29.887728 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.887706 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2077d56-b214-4f3d-a129-b33076d38a41-console-serving-cert\") pod \"console-69cb95dc8d-xls7c\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:29.887728 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.887724 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phd8k\" (UniqueName: \"kubernetes.io/projected/e2077d56-b214-4f3d-a129-b33076d38a41-kube-api-access-phd8k\") pod \"console-69cb95dc8d-xls7c\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:29.887965 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.887747 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-trusted-ca-bundle\") pod \"console-69cb95dc8d-xls7c\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:29.887965 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.887808 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2077d56-b214-4f3d-a129-b33076d38a41-console-oauth-config\") pod \"console-69cb95dc8d-xls7c\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:29.887965 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.887824 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-oauth-serving-cert\") pod \"console-69cb95dc8d-xls7c\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:29.945983 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.945952 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:29.988885 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.988850 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2077d56-b214-4f3d-a129-b33076d38a41-console-oauth-config\") pod \"console-69cb95dc8d-xls7c\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:29.988885 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.988887 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-oauth-serving-cert\") pod \"console-69cb95dc8d-xls7c\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:29.989086 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.988938 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-console-config\") pod \"console-69cb95dc8d-xls7c\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:29.989086 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.988965 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-service-ca\") pod \"console-69cb95dc8d-xls7c\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:29.989086 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.988991 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2077d56-b214-4f3d-a129-b33076d38a41-console-serving-cert\") pod \"console-69cb95dc8d-xls7c\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:29.989086 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.989014 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phd8k\" (UniqueName: \"kubernetes.io/projected/e2077d56-b214-4f3d-a129-b33076d38a41-kube-api-access-phd8k\") pod \"console-69cb95dc8d-xls7c\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:29.989086 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.989042 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-trusted-ca-bundle\") pod \"console-69cb95dc8d-xls7c\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:29.989880 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.989852 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-service-ca\") pod \"console-69cb95dc8d-xls7c\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:29.989987 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.989880 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-console-config\") pod \"console-69cb95dc8d-xls7c\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:29.989987 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.989945 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-oauth-serving-cert\") pod \"console-69cb95dc8d-xls7c\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:29.990104 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.990086 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-trusted-ca-bundle\") pod \"console-69cb95dc8d-xls7c\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:29.991847 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.991826 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2077d56-b214-4f3d-a129-b33076d38a41-console-oauth-config\") pod \"console-69cb95dc8d-xls7c\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:29.991963 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:29.991944 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2077d56-b214-4f3d-a129-b33076d38a41-console-serving-cert\") pod \"console-69cb95dc8d-xls7c\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:30.000582 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:30.000557 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phd8k\" (UniqueName: \"kubernetes.io/projected/e2077d56-b214-4f3d-a129-b33076d38a41-kube-api-access-phd8k\") pod \"console-69cb95dc8d-xls7c\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:30.046899 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:30.046866 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:30.098024 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:30.098001 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:30.240109 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:30.239952 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69cb95dc8d-xls7c"] Jul 23 14:11:30.242508 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:11:30.242479 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2077d56_b214_4f3d_a129_b33076d38a41.slice/crio-75610287d43a7b43dd53471e310222a342cb9ee603d5bc09a9b20abc006ed35e WatchSource:0}: Error finding container 75610287d43a7b43dd53471e310222a342cb9ee603d5bc09a9b20abc006ed35e: Status 404 returned error can't find the container with id 75610287d43a7b43dd53471e310222a342cb9ee603d5bc09a9b20abc006ed35e Jul 23 14:11:30.395499 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:30.395465 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69cb95dc8d-xls7c" event={"ID":"e2077d56-b214-4f3d-a129-b33076d38a41","Type":"ContainerStarted","Data":"75610287d43a7b43dd53471e310222a342cb9ee603d5bc09a9b20abc006ed35e"} Jul 23 14:11:32.207034 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:32.206986 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:32.470707 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:32.470623 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:33.410223 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:33.410191 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69cb95dc8d-xls7c" event={"ID":"e2077d56-b214-4f3d-a129-b33076d38a41","Type":"ContainerStarted","Data":"37ef5ac290fa723dd380ba452cff865702be88ed9aae261ef9b3192a34eeea1f"} Jul 23 14:11:33.435437 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:33.435377 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69cb95dc8d-xls7c" podStartSLOduration=1.4725023799999999 podStartE2EDuration="4.435358825s" totalImagesPullingTime="2.962856445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:11:33.434672605 +0000 UTC m=+88.994500948" watchObservedRunningTime="2026-07-23 14:11:33.435358825 +0000 UTC m=+88.995187169" Jul 23 14:11:34.373651 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:34.373621 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6c44f" Jul 23 14:11:35.264368 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:35.264332 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:35.365424 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:35.365389 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:35.750253 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:35.750204 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:35.855064 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:35.855035 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:38.335227 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:38.335199 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:11:38.567171 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:38.567141 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:38.643590 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:38.643510 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:38.861430 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:38.861395 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75c7487ddc-74nwt"] Jul 23 14:11:38.943708 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:38.943606 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:39.012423 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:39.012391 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:40.003977 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:40.003932 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:40.099163 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:40.099126 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:40.099382 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:40.099206 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:40.105088 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:40.105064 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:40.148252 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:40.148216 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:40.252396 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:40.252362 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:40.440888 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:40.440858 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:11:40.551679 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:40.551644 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:40.652595 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:40.652554 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:40.719617 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:40.719525 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:40.856842 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:40.856813 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:40.940646 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:40.940574 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:42.250228 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:42.250193 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r8nkd" Jul 23 14:11:43.028804 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.028770 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:43.262912 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.262876 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:43.345256 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.345153 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mg9jf"] Jul 23 14:11:43.352583 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.352560 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.355920 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.355896 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 23 14:11:43.356024 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.355954 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 23 14:11:43.356170 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.356157 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8xrmm\"" Jul 23 14:11:43.357482 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.357463 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 23 14:11:43.357697 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.357680 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 23 14:11:43.368402 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.368366 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:43.388023 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.387996 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-node-exporter-accelerators-collector-config\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.388154 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.388031 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-node-exporter-tls\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.388154 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.388053 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-metrics-client-ca\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.388154 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.388087 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.388154 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.388108 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-root\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.388359 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.388181 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-node-exporter-wtmp\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.388359 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.388220 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-node-exporter-textfile\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.388359 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.388294 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qczn9\" (UniqueName: \"kubernetes.io/projected/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-kube-api-access-qczn9\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.388359 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.388342 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-sys\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.476554 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.476522 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:43.489678 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.489655 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-node-exporter-wtmp\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.489758 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.489688 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-node-exporter-textfile\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.489758 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.489708 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qczn9\" (UniqueName: \"kubernetes.io/projected/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-kube-api-access-qczn9\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.489758 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.489724 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-sys\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.489916 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.489760 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-node-exporter-accelerators-collector-config\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.489916 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.489807 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-node-exporter-tls\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.489916 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.489850 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-node-exporter-wtmp\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.489916 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.489860 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-metrics-client-ca\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.489916 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.489874 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-sys\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.489916 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.489890 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.490202 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:11:43.489958 2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 23 14:11:43.490202 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.489983 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-root\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.490202 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:11:43.490024 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-node-exporter-tls podName:5d3a689b-dfb6-48c0-986d-9cc1b57cccbc nodeName:}" failed. No retries permitted until 2026-07-23 14:11:43.990005251 +0000 UTC m=+99.549833583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-node-exporter-tls") pod "node-exporter-mg9jf" (UID: "5d3a689b-dfb6-48c0-986d-9cc1b57cccbc") : secret "node-exporter-tls" not found Jul 23 14:11:43.490202 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.490031 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-root\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.490202 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.490098 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-node-exporter-textfile\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.490424 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.490350 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-node-exporter-accelerators-collector-config\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.490472 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.490446 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-metrics-client-ca\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.492313 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.492286 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.510661 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.510633 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qczn9\" (UniqueName: \"kubernetes.io/projected/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-kube-api-access-qczn9\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.586807 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.586749 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:43.692137 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.692021 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:43.823341 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.823307 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:43.910802 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.910772 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:43.994360 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.994280 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-node-exporter-tls\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:43.996554 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:43.996522 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5d3a689b-dfb6-48c0-986d-9cc1b57cccbc-node-exporter-tls\") pod \"node-exporter-mg9jf\" (UID: \"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc\") " pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:44.026097 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:44.026064 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:44.179484 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:44.179446 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:44.261709 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:44.261623 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mg9jf" Jul 23 14:11:44.274218 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:11:44.274185 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d3a689b_dfb6_48c0_986d_9cc1b57cccbc.slice/crio-01b4c5b506851800d42b95b29dbf58a8e99babceb7df041eba68e22cf52635f1 WatchSource:0}: Error finding container 01b4c5b506851800d42b95b29dbf58a8e99babceb7df041eba68e22cf52635f1: Status 404 returned error can't find the container with id 01b4c5b506851800d42b95b29dbf58a8e99babceb7df041eba68e22cf52635f1 Jul 23 14:11:44.380944 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:44.380908 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:44.452495 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:44.452462 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mg9jf" event={"ID":"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc","Type":"ContainerStarted","Data":"01b4c5b506851800d42b95b29dbf58a8e99babceb7df041eba68e22cf52635f1"} Jul 23 14:11:44.537872 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:44.537839 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:44.683943 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:44.683905 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:45.344176 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.344135 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:45.449015 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.448937 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r"] Jul 23 14:11:45.452480 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.452463 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.456059 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.456036 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 23 14:11:45.456225 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.456212 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 23 14:11:45.456379 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.456364 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 23 14:11:45.456560 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.456533 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 23 14:11:45.456657 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.456601 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 23 14:11:45.456721 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.456712 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-9wfzn\"" Jul 23 14:11:45.456800 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.456783 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fb80hlgpkeng8\"" Jul 23 14:11:45.458390 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.458362 2583 generic.go:356] "Generic (PLEG): container finished" podID="5d3a689b-dfb6-48c0-986d-9cc1b57cccbc" containerID="e730326c5b0eb5fe0f6a65da6aeda05ca26bd9807b4257fd86d5056366e2a80c" exitCode=0 Jul 23 14:11:45.458472 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.458392 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mg9jf" event={"ID":"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc","Type":"ContainerDied","Data":"e730326c5b0eb5fe0f6a65da6aeda05ca26bd9807b4257fd86d5056366e2a80c"} Jul 23 14:11:45.472196 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.472174 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r"] Jul 23 14:11:45.509532 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.509504 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a003b114-b4a3-491f-ae08-05db6c12f6ee-secret-grpc-tls\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.509627 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.509542 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a003b114-b4a3-491f-ae08-05db6c12f6ee-secret-thanos-querier-tls\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.509627 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.509565 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a003b114-b4a3-491f-ae08-05db6c12f6ee-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.509627 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.509585 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a003b114-b4a3-491f-ae08-05db6c12f6ee-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.509779 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.509728 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a003b114-b4a3-491f-ae08-05db6c12f6ee-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.509779 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.509772 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tbgb\" (UniqueName: \"kubernetes.io/projected/a003b114-b4a3-491f-ae08-05db6c12f6ee-kube-api-access-2tbgb\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.509912 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.509890 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a003b114-b4a3-491f-ae08-05db6c12f6ee-metrics-client-ca\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.509993 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.509962 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a003b114-b4a3-491f-ae08-05db6c12f6ee-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.610753 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.610725 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a003b114-b4a3-491f-ae08-05db6c12f6ee-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.610875 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.610765 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tbgb\" (UniqueName: \"kubernetes.io/projected/a003b114-b4a3-491f-ae08-05db6c12f6ee-kube-api-access-2tbgb\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.610875 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.610819 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a003b114-b4a3-491f-ae08-05db6c12f6ee-metrics-client-ca\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.610942 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.610876 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a003b114-b4a3-491f-ae08-05db6c12f6ee-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.610942 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.610911 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a003b114-b4a3-491f-ae08-05db6c12f6ee-secret-grpc-tls\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.610942 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.610939 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a003b114-b4a3-491f-ae08-05db6c12f6ee-secret-thanos-querier-tls\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.611078 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.611055 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a003b114-b4a3-491f-ae08-05db6c12f6ee-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.611133 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.611101 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a003b114-b4a3-491f-ae08-05db6c12f6ee-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.611841 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.611815 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a003b114-b4a3-491f-ae08-05db6c12f6ee-metrics-client-ca\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.614000 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.613958 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a003b114-b4a3-491f-ae08-05db6c12f6ee-secret-grpc-tls\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.614170 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.614139 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a003b114-b4a3-491f-ae08-05db6c12f6ee-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.614469 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.614451 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a003b114-b4a3-491f-ae08-05db6c12f6ee-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.614553 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.614515 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a003b114-b4a3-491f-ae08-05db6c12f6ee-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.614618 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.614583 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a003b114-b4a3-491f-ae08-05db6c12f6ee-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.614671 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.614645 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a003b114-b4a3-491f-ae08-05db6c12f6ee-secret-thanos-querier-tls\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.622052 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.622029 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tbgb\" (UniqueName: \"kubernetes.io/projected/a003b114-b4a3-491f-ae08-05db6c12f6ee-kube-api-access-2tbgb\") pod \"thanos-querier-fdd76dc7c-ktp2r\" (UID: \"a003b114-b4a3-491f-ae08-05db6c12f6ee\") " pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.763204 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.763115 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:45.896260 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:45.896151 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r"] Jul 23 14:11:45.898736 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:11:45.898712 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda003b114_b4a3_491f_ae08_05db6c12f6ee.slice/crio-564d3a8ab3e09c8ba0af22ec0f379372be3c24437eabff43d661cc342746090d WatchSource:0}: Error finding container 564d3a8ab3e09c8ba0af22ec0f379372be3c24437eabff43d661cc342746090d: Status 404 returned error can't find the container with id 564d3a8ab3e09c8ba0af22ec0f379372be3c24437eabff43d661cc342746090d Jul 23 14:11:46.273053 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:46.273016 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:46.374277 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:46.374249 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:46.467017 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:46.466979 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" event={"ID":"a003b114-b4a3-491f-ae08-05db6c12f6ee","Type":"ContainerStarted","Data":"564d3a8ab3e09c8ba0af22ec0f379372be3c24437eabff43d661cc342746090d"} Jul 23 14:11:46.469027 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:46.469005 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mg9jf" event={"ID":"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc","Type":"ContainerStarted","Data":"b494b2bc7f5e06010a1889e03077669ad4e94ddbebd9f4d0d15ccf91d971a58e"} Jul 23 14:11:46.469093 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:46.469047 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mg9jf" event={"ID":"5d3a689b-dfb6-48c0-986d-9cc1b57cccbc","Type":"ContainerStarted","Data":"d6778d150d3d633890069c06712962628ec7c73eac5e5126f7deed5cf0c5e795"} Jul 23 14:11:46.495796 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:46.495747 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mg9jf" podStartSLOduration=2.580532638 podStartE2EDuration="3.495733727s" totalImagesPullingTime="851.30265ms" totalInitContainerRuntime="63.898439ms" isStatefulPod=true podCreationTimestamp="2026-07-23 14:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:11:46.495545449 +0000 UTC m=+102.055373791" watchObservedRunningTime="2026-07-23 14:11:46.495733727 +0000 UTC m=+102.055562068" Jul 23 14:11:46.708024 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:46.707936 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:46.810105 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:46.810072 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:47.890710 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:47.890675 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-77d784bc-52b88"] Jul 23 14:11:47.911071 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:47.911043 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-77d784bc-52b88"] Jul 23 14:11:47.911224 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:47.911145 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:47.913880 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:47.913856 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 23 14:11:47.914967 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:47.914946 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 23 14:11:47.915105 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:47.914966 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 23 14:11:47.915105 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:47.915029 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 23 14:11:47.915105 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:47.914968 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-frfs7\"" Jul 23 14:11:47.915105 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:47.914966 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4ouq781j69g5s\"" Jul 23 14:11:48.031412 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.031381 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48998f3b-1ecc-418c-a8a3-646d73728030-client-ca-bundle\") pod \"metrics-server-77d784bc-52b88\" (UID: \"48998f3b-1ecc-418c-a8a3-646d73728030\") " pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:48.031573 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.031449 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/48998f3b-1ecc-418c-a8a3-646d73728030-secret-metrics-server-tls\") pod \"metrics-server-77d784bc-52b88\" (UID: \"48998f3b-1ecc-418c-a8a3-646d73728030\") " pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:48.031573 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.031505 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/48998f3b-1ecc-418c-a8a3-646d73728030-audit-log\") pod \"metrics-server-77d784bc-52b88\" (UID: \"48998f3b-1ecc-418c-a8a3-646d73728030\") " pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:48.031573 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.031541 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48998f3b-1ecc-418c-a8a3-646d73728030-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77d784bc-52b88\" (UID: \"48998f3b-1ecc-418c-a8a3-646d73728030\") " pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:48.031573 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.031565 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/48998f3b-1ecc-418c-a8a3-646d73728030-secret-metrics-server-client-certs\") pod \"metrics-server-77d784bc-52b88\" (UID: \"48998f3b-1ecc-418c-a8a3-646d73728030\") " pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:48.031762 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.031586 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/48998f3b-1ecc-418c-a8a3-646d73728030-metrics-server-audit-profiles\") pod \"metrics-server-77d784bc-52b88\" (UID: \"48998f3b-1ecc-418c-a8a3-646d73728030\") " pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:48.031762 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.031653 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvhgx\" (UniqueName: \"kubernetes.io/projected/48998f3b-1ecc-418c-a8a3-646d73728030-kube-api-access-jvhgx\") pod \"metrics-server-77d784bc-52b88\" (UID: \"48998f3b-1ecc-418c-a8a3-646d73728030\") " pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:48.118088 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.118057 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:48.125219 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.125192 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bc65c46c8-w8p98"] Jul 23 14:11:48.132696 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.132675 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/48998f3b-1ecc-418c-a8a3-646d73728030-audit-log\") pod \"metrics-server-77d784bc-52b88\" (UID: \"48998f3b-1ecc-418c-a8a3-646d73728030\") " pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:48.132822 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.132709 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48998f3b-1ecc-418c-a8a3-646d73728030-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77d784bc-52b88\" (UID: \"48998f3b-1ecc-418c-a8a3-646d73728030\") " pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:48.132822 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.132734 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/48998f3b-1ecc-418c-a8a3-646d73728030-secret-metrics-server-client-certs\") pod \"metrics-server-77d784bc-52b88\" (UID: \"48998f3b-1ecc-418c-a8a3-646d73728030\") " pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:48.132822 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.132753 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/48998f3b-1ecc-418c-a8a3-646d73728030-metrics-server-audit-profiles\") pod \"metrics-server-77d784bc-52b88\" (UID: \"48998f3b-1ecc-418c-a8a3-646d73728030\") " pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:48.132822 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.132784 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvhgx\" (UniqueName: \"kubernetes.io/projected/48998f3b-1ecc-418c-a8a3-646d73728030-kube-api-access-jvhgx\") pod \"metrics-server-77d784bc-52b88\" (UID: \"48998f3b-1ecc-418c-a8a3-646d73728030\") " pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:48.132822 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.132813 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48998f3b-1ecc-418c-a8a3-646d73728030-client-ca-bundle\") pod \"metrics-server-77d784bc-52b88\" (UID: \"48998f3b-1ecc-418c-a8a3-646d73728030\") " pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:48.133061 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.133033 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/48998f3b-1ecc-418c-a8a3-646d73728030-secret-metrics-server-tls\") pod \"metrics-server-77d784bc-52b88\" (UID: \"48998f3b-1ecc-418c-a8a3-646d73728030\") " pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:48.133116 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.133086 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/48998f3b-1ecc-418c-a8a3-646d73728030-audit-log\") pod \"metrics-server-77d784bc-52b88\" (UID: \"48998f3b-1ecc-418c-a8a3-646d73728030\") " pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:48.133507 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.133482 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48998f3b-1ecc-418c-a8a3-646d73728030-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77d784bc-52b88\" (UID: \"48998f3b-1ecc-418c-a8a3-646d73728030\") " pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:48.133713 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.133696 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/48998f3b-1ecc-418c-a8a3-646d73728030-metrics-server-audit-profiles\") pod \"metrics-server-77d784bc-52b88\" (UID: \"48998f3b-1ecc-418c-a8a3-646d73728030\") " pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:48.135314 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.135286 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/48998f3b-1ecc-418c-a8a3-646d73728030-secret-metrics-server-client-certs\") pod \"metrics-server-77d784bc-52b88\" (UID: \"48998f3b-1ecc-418c-a8a3-646d73728030\") " pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:48.135398 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.135347 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/48998f3b-1ecc-418c-a8a3-646d73728030-secret-metrics-server-tls\") pod \"metrics-server-77d784bc-52b88\" (UID: \"48998f3b-1ecc-418c-a8a3-646d73728030\") " pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:48.135558 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.135538 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48998f3b-1ecc-418c-a8a3-646d73728030-client-ca-bundle\") pod \"metrics-server-77d784bc-52b88\" (UID: \"48998f3b-1ecc-418c-a8a3-646d73728030\") " pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:48.145675 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.145619 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvhgx\" (UniqueName: \"kubernetes.io/projected/48998f3b-1ecc-418c-a8a3-646d73728030-kube-api-access-jvhgx\") pod \"metrics-server-77d784bc-52b88\" (UID: \"48998f3b-1ecc-418c-a8a3-646d73728030\") " pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:48.153323 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.153303 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bc65c46c8-w8p98"] Jul 23 14:11:48.153434 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.153392 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.214593 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.214560 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:48.220533 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.220502 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:11:48.234084 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.234059 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-trusted-ca-bundle\") pod \"console-7bc65c46c8-w8p98\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.234182 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.234092 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-service-ca\") pod \"console-7bc65c46c8-w8p98\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.234182 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.234122 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j69kn\" (UniqueName: \"kubernetes.io/projected/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-kube-api-access-j69kn\") pod \"console-7bc65c46c8-w8p98\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.234263 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.234197 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-console-serving-cert\") pod \"console-7bc65c46c8-w8p98\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.234296 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.234273 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-console-oauth-config\") pod \"console-7bc65c46c8-w8p98\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.234334 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.234298 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-oauth-serving-cert\") pod \"console-7bc65c46c8-w8p98\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.234334 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.234324 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-console-config\") pod \"console-7bc65c46c8-w8p98\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.325470 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.325423 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:48.335206 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.335159 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-console-config\") pod \"console-7bc65c46c8-w8p98\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.335335 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.335275 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-trusted-ca-bundle\") pod \"console-7bc65c46c8-w8p98\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.335335 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.335306 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-service-ca\") pod \"console-7bc65c46c8-w8p98\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.335436 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.335366 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j69kn\" (UniqueName: \"kubernetes.io/projected/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-kube-api-access-j69kn\") pod \"console-7bc65c46c8-w8p98\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.335436 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.335425 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-console-serving-cert\") pod \"console-7bc65c46c8-w8p98\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.335659 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.335597 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-console-oauth-config\") pod \"console-7bc65c46c8-w8p98\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.335926 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.335831 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-oauth-serving-cert\") pod \"console-7bc65c46c8-w8p98\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.336184 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.336094 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-service-ca\") pod \"console-7bc65c46c8-w8p98\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.336827 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.336535 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-trusted-ca-bundle\") pod \"console-7bc65c46c8-w8p98\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.337342 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.337317 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-console-config\") pod \"console-7bc65c46c8-w8p98\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.337676 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.337624 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-oauth-serving-cert\") pod \"console-7bc65c46c8-w8p98\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.338966 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.338947 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-console-serving-cert\") pod \"console-7bc65c46c8-w8p98\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.339334 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.339308 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-console-oauth-config\") pod \"console-7bc65c46c8-w8p98\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.351025 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.350994 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j69kn\" (UniqueName: \"kubernetes.io/projected/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-kube-api-access-j69kn\") pod \"console-7bc65c46c8-w8p98\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.383485 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.383449 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-77d784bc-52b88"] Jul 23 14:11:48.386716 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:11:48.386687 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48998f3b_1ecc_418c_a8a3_646d73728030.slice/crio-01eb7149078c956e7fbe50a86541900337af025bb8421c1fb14ed48d540d6b80 WatchSource:0}: Error finding container 01eb7149078c956e7fbe50a86541900337af025bb8421c1fb14ed48d540d6b80: Status 404 returned error can't find the container with id 01eb7149078c956e7fbe50a86541900337af025bb8421c1fb14ed48d540d6b80 Jul 23 14:11:48.425537 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.425470 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:48.462592 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.462569 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:11:48.478731 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.478694 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-77d784bc-52b88" event={"ID":"48998f3b-1ecc-418c-a8a3-646d73728030","Type":"ContainerStarted","Data":"01eb7149078c956e7fbe50a86541900337af025bb8421c1fb14ed48d540d6b80"} Jul 23 14:11:48.480855 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.480831 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" event={"ID":"a003b114-b4a3-491f-ae08-05db6c12f6ee","Type":"ContainerStarted","Data":"cfdf6c4eee5c8145115bf8259f3e16ac0d47d2ac84eced84665ddf1606b5077d"} Jul 23 14:11:48.480972 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.480889 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" event={"ID":"a003b114-b4a3-491f-ae08-05db6c12f6ee","Type":"ContainerStarted","Data":"505e016f11b6d1562d943ba50c604167767ec2a5905da4c5261b2ca6c7024d75"} Jul 23 14:11:48.594413 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.594381 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-685765f8bd-ns8dj"] Jul 23 14:11:48.616061 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.616020 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-685765f8bd-ns8dj"] Jul 23 14:11:48.616406 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.616216 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.618990 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.618934 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bc65c46c8-w8p98"] Jul 23 14:11:48.619085 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.618996 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 23 14:11:48.619153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.619121 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 23 14:11:48.619524 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.619502 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6vzqj\"" Jul 23 14:11:48.619619 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.619545 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 23 14:11:48.619619 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.619558 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 23 14:11:48.620101 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.620054 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 23 14:11:48.642198 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.642167 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 23 14:11:48.739970 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.739941 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aacc8e2-5a64-413d-aeb7-1d50688afa06-telemeter-trusted-ca-bundle\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.740107 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.739978 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhf6h\" (UniqueName: \"kubernetes.io/projected/6aacc8e2-5a64-413d-aeb7-1d50688afa06-kube-api-access-mhf6h\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.740107 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.740017 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6aacc8e2-5a64-413d-aeb7-1d50688afa06-metrics-client-ca\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.740107 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.740067 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6aacc8e2-5a64-413d-aeb7-1d50688afa06-telemeter-client-tls\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.740107 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.740095 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6aacc8e2-5a64-413d-aeb7-1d50688afa06-secret-telemeter-client\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.740381 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.740120 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aacc8e2-5a64-413d-aeb7-1d50688afa06-serving-certs-ca-bundle\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.740381 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.740156 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6aacc8e2-5a64-413d-aeb7-1d50688afa06-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.740381 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.740205 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6aacc8e2-5a64-413d-aeb7-1d50688afa06-federate-client-tls\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.840898 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.840859 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6aacc8e2-5a64-413d-aeb7-1d50688afa06-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.841075 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.840913 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6aacc8e2-5a64-413d-aeb7-1d50688afa06-federate-client-tls\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.841075 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.840968 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aacc8e2-5a64-413d-aeb7-1d50688afa06-telemeter-trusted-ca-bundle\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.841075 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.840986 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhf6h\" (UniqueName: \"kubernetes.io/projected/6aacc8e2-5a64-413d-aeb7-1d50688afa06-kube-api-access-mhf6h\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.841075 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.841020 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6aacc8e2-5a64-413d-aeb7-1d50688afa06-metrics-client-ca\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.841271 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.841158 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6aacc8e2-5a64-413d-aeb7-1d50688afa06-telemeter-client-tls\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.841271 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.841215 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6aacc8e2-5a64-413d-aeb7-1d50688afa06-secret-telemeter-client\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.841271 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.841265 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aacc8e2-5a64-413d-aeb7-1d50688afa06-serving-certs-ca-bundle\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.841955 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.841924 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aacc8e2-5a64-413d-aeb7-1d50688afa06-serving-certs-ca-bundle\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.842064 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.841967 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6aacc8e2-5a64-413d-aeb7-1d50688afa06-telemeter-trusted-ca-bundle\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.842064 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.841981 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6aacc8e2-5a64-413d-aeb7-1d50688afa06-metrics-client-ca\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.844022 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.844001 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6aacc8e2-5a64-413d-aeb7-1d50688afa06-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.844096 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.844080 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6aacc8e2-5a64-413d-aeb7-1d50688afa06-federate-client-tls\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.844140 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.844087 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6aacc8e2-5a64-413d-aeb7-1d50688afa06-telemeter-client-tls\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.844189 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.844143 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6aacc8e2-5a64-413d-aeb7-1d50688afa06-secret-telemeter-client\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.852516 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.852498 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhf6h\" (UniqueName: \"kubernetes.io/projected/6aacc8e2-5a64-413d-aeb7-1d50688afa06-kube-api-access-mhf6h\") pod \"telemeter-client-685765f8bd-ns8dj\" (UID: \"6aacc8e2-5a64-413d-aeb7-1d50688afa06\") " pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:48.933830 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:48.933760 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" Jul 23 14:11:49.107006 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:49.106981 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-685765f8bd-ns8dj"] Jul 23 14:11:49.109253 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:11:49.109214 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aacc8e2_5a64_413d_aeb7_1d50688afa06.slice/crio-e0351b90f9ce7bb1e927c2860afb34603832904f1a8c8dd0897bb5eed2dbc9fd WatchSource:0}: Error finding container e0351b90f9ce7bb1e927c2860afb34603832904f1a8c8dd0897bb5eed2dbc9fd: Status 404 returned error can't find the container with id e0351b90f9ce7bb1e927c2860afb34603832904f1a8c8dd0897bb5eed2dbc9fd Jul 23 14:11:49.488680 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:49.488637 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" event={"ID":"a003b114-b4a3-491f-ae08-05db6c12f6ee","Type":"ContainerStarted","Data":"158396abc37e9500073d859669cdacb112268ef5e9f91ee7a2b181d8fe083935"} Jul 23 14:11:49.489916 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:49.489886 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" event={"ID":"6aacc8e2-5a64-413d-aeb7-1d50688afa06","Type":"ContainerStarted","Data":"e0351b90f9ce7bb1e927c2860afb34603832904f1a8c8dd0897bb5eed2dbc9fd"} Jul 23 14:11:49.491504 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:49.491477 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc65c46c8-w8p98" event={"ID":"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1","Type":"ContainerStarted","Data":"4ac971ae4d66f316c048d850d5d431db6fe8c8cbe021bfa03f6d673f1bf271b8"} Jul 23 14:11:49.491604 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:49.491522 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc65c46c8-w8p98" event={"ID":"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1","Type":"ContainerStarted","Data":"a4fefb25fdd7b762142907e65cacbbd831f0abd05141f549664053e0eb37b408"} Jul 23 14:11:49.516532 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:49.516480 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bc65c46c8-w8p98" podStartSLOduration=1.516461916 podStartE2EDuration="1.516461916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:11:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:11:49.514828533 +0000 UTC m=+105.074656885" watchObservedRunningTime="2026-07-23 14:11:49.516461916 +0000 UTC m=+105.076290257" Jul 23 14:11:49.558500 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:49.558472 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:51.508681 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:51.508643 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" event={"ID":"a003b114-b4a3-491f-ae08-05db6c12f6ee","Type":"ContainerStarted","Data":"c744f17f79e7f2492cb07607bf8c731bff277618b92330e057f8558295177353"} Jul 23 14:11:51.509078 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:51.508745 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" event={"ID":"a003b114-b4a3-491f-ae08-05db6c12f6ee","Type":"ContainerStarted","Data":"3cb728d587e4ce5e2c87359e595ef4638987d152552cd56604405cad032b6b17"} Jul 23 14:11:51.510805 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:51.510778 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-77d784bc-52b88" event={"ID":"48998f3b-1ecc-418c-a8a3-646d73728030","Type":"ContainerStarted","Data":"7cf52a315bcc2776dce7360979107a522e2fdecfa17d2c4dd8d68f4fa2a17fde"} Jul 23 14:11:51.537981 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:51.537923 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-77d784bc-52b88" podStartSLOduration=1.654120668 podStartE2EDuration="4.537908829s" totalImagesPullingTime="2.883788161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:11:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:11:51.535144263 +0000 UTC m=+107.094972604" watchObservedRunningTime="2026-07-23 14:11:51.537908829 +0000 UTC m=+107.097737171" Jul 23 14:11:52.520159 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:52.520123 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" event={"ID":"a003b114-b4a3-491f-ae08-05db6c12f6ee","Type":"ContainerStarted","Data":"96fdbe47da51a0dc5b243d8cbc73245aec138564245cec0d835d81f86c365d97"} Jul 23 14:11:52.520660 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:52.520296 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:52.521848 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:52.521818 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" event={"ID":"6aacc8e2-5a64-413d-aeb7-1d50688afa06","Type":"ContainerStarted","Data":"b14ce8092c2607860e85642149599f3de95aba48ace6a2c3a738ca28bf0c68ba"} Jul 23 14:11:52.546743 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:52.546580 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" podStartSLOduration=2.544060763 podStartE2EDuration="7.546560759s" totalImagesPullingTime="5.002499996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:11:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:11:52.545531724 +0000 UTC m=+108.105360059" watchObservedRunningTime="2026-07-23 14:11:52.546560759 +0000 UTC m=+108.106389113" Jul 23 14:11:52.547761 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:52.547732 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:52.644500 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:52.644458 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:53.529066 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:53.529028 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" event={"ID":"6aacc8e2-5a64-413d-aeb7-1d50688afa06","Type":"ContainerStarted","Data":"393b0dcf467592edc5e75ea3e5d40edca66d7bccc35c6580b65ef434ce7b7c90"} Jul 23 14:11:53.529529 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:53.529097 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" event={"ID":"6aacc8e2-5a64-413d-aeb7-1d50688afa06","Type":"ContainerStarted","Data":"98e3191944f9209c3ffee8f00643405fecec0106c93607fee3ee0f976caeaf29"} Jul 23 14:11:53.535101 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:53.535075 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-fdd76dc7c-ktp2r" Jul 23 14:11:53.555592 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:53.555537 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-685765f8bd-ns8dj" podStartSLOduration=1.8810936379999998 podStartE2EDuration="5.555514711s" totalImagesPullingTime="3.674421073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:11:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:11:53.553442964 +0000 UTC m=+109.113271302" watchObservedRunningTime="2026-07-23 14:11:53.555514711 +0000 UTC m=+109.115343053" Jul 23 14:11:54.281585 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:54.281548 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bc65c46c8-w8p98"] Jul 23 14:11:54.691618 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:54.691516 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:54.791855 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:54.791811 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:55.276433 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:55.276398 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:55.358601 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:55.358563 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:56.534813 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:56.534774 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:56.634523 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:56.634467 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:11:58.463605 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:11:58.463571 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:12:03.881223 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:03.881162 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" podUID="26f702c8-73af-4693-95ac-2c03483b6116" containerName="registry" containerID="cri-o://2a0b1ae8261b48c83aae0a2524f6a984a3b50a96eef9f9fe3f6358ef76383b15" gracePeriod=30 Jul 23 14:12:04.117399 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.117374 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:12:04.188939 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.188853 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-bound-sa-token\") pod \"26f702c8-73af-4693-95ac-2c03483b6116\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " Jul 23 14:12:04.188939 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.188896 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/26f702c8-73af-4693-95ac-2c03483b6116-installation-pull-secrets\") pod \"26f702c8-73af-4693-95ac-2c03483b6116\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " Jul 23 14:12:04.188939 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.188913 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls\") pod \"26f702c8-73af-4693-95ac-2c03483b6116\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " Jul 23 14:12:04.188939 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.188934 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/26f702c8-73af-4693-95ac-2c03483b6116-image-registry-private-configuration\") pod \"26f702c8-73af-4693-95ac-2c03483b6116\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " Jul 23 14:12:04.189294 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.188998 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/26f702c8-73af-4693-95ac-2c03483b6116-ca-trust-extracted\") pod \"26f702c8-73af-4693-95ac-2c03483b6116\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " Jul 23 14:12:04.189294 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.189061 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/26f702c8-73af-4693-95ac-2c03483b6116-trusted-ca\") pod \"26f702c8-73af-4693-95ac-2c03483b6116\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " Jul 23 14:12:04.189294 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.189114 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgmqg\" (UniqueName: \"kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-kube-api-access-hgmqg\") pod \"26f702c8-73af-4693-95ac-2c03483b6116\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " Jul 23 14:12:04.189294 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.189139 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/26f702c8-73af-4693-95ac-2c03483b6116-registry-certificates\") pod \"26f702c8-73af-4693-95ac-2c03483b6116\" (UID: \"26f702c8-73af-4693-95ac-2c03483b6116\") " Jul 23 14:12:04.189591 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.189510 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26f702c8-73af-4693-95ac-2c03483b6116-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "26f702c8-73af-4693-95ac-2c03483b6116" (UID: "26f702c8-73af-4693-95ac-2c03483b6116"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 14:12:04.189898 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.189871 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26f702c8-73af-4693-95ac-2c03483b6116-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "26f702c8-73af-4693-95ac-2c03483b6116" (UID: "26f702c8-73af-4693-95ac-2c03483b6116"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 14:12:04.191614 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.191550 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26f702c8-73af-4693-95ac-2c03483b6116-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "26f702c8-73af-4693-95ac-2c03483b6116" (UID: "26f702c8-73af-4693-95ac-2c03483b6116"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 14:12:04.191721 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.191620 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "26f702c8-73af-4693-95ac-2c03483b6116" (UID: "26f702c8-73af-4693-95ac-2c03483b6116"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 14:12:04.191721 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.191653 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26f702c8-73af-4693-95ac-2c03483b6116-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "26f702c8-73af-4693-95ac-2c03483b6116" (UID: "26f702c8-73af-4693-95ac-2c03483b6116"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 14:12:04.191721 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.191687 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-kube-api-access-hgmqg" (OuterVolumeSpecName: "kube-api-access-hgmqg") pod "26f702c8-73af-4693-95ac-2c03483b6116" (UID: "26f702c8-73af-4693-95ac-2c03483b6116"). InnerVolumeSpecName "kube-api-access-hgmqg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 14:12:04.191862 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.191805 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "26f702c8-73af-4693-95ac-2c03483b6116" (UID: "26f702c8-73af-4693-95ac-2c03483b6116"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 14:12:04.197890 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.197866 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26f702c8-73af-4693-95ac-2c03483b6116-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "26f702c8-73af-4693-95ac-2c03483b6116" (UID: "26f702c8-73af-4693-95ac-2c03483b6116"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 14:12:04.290444 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.290391 2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-bound-sa-token\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:12:04.290444 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.290437 2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/26f702c8-73af-4693-95ac-2c03483b6116-installation-pull-secrets\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:12:04.290444 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.290452 2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-registry-tls\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:12:04.290734 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.290465 2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/26f702c8-73af-4693-95ac-2c03483b6116-image-registry-private-configuration\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:12:04.290734 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.290478 2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/26f702c8-73af-4693-95ac-2c03483b6116-ca-trust-extracted\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:12:04.290734 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.290488 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/26f702c8-73af-4693-95ac-2c03483b6116-trusted-ca\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:12:04.290734 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.290501 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgmqg\" (UniqueName: \"kubernetes.io/projected/26f702c8-73af-4693-95ac-2c03483b6116-kube-api-access-hgmqg\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:12:04.290734 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.290511 2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/26f702c8-73af-4693-95ac-2c03483b6116-registry-certificates\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:12:04.577416 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.577381 2583 generic.go:356] "Generic (PLEG): container finished" podID="26f702c8-73af-4693-95ac-2c03483b6116" containerID="2a0b1ae8261b48c83aae0a2524f6a984a3b50a96eef9f9fe3f6358ef76383b15" exitCode=0 Jul 23 14:12:04.577588 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.577441 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" Jul 23 14:12:04.577588 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.577454 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" event={"ID":"26f702c8-73af-4693-95ac-2c03483b6116","Type":"ContainerDied","Data":"2a0b1ae8261b48c83aae0a2524f6a984a3b50a96eef9f9fe3f6358ef76383b15"} Jul 23 14:12:04.577588 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.577517 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c7487ddc-74nwt" event={"ID":"26f702c8-73af-4693-95ac-2c03483b6116","Type":"ContainerDied","Data":"e5660d452a6bcb71cc7f7fae5222b9e18f83e443a3f4a0974bb1949c0788c207"} Jul 23 14:12:04.577588 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.577545 2583 scope.go:117] "RemoveContainer" containerID="2a0b1ae8261b48c83aae0a2524f6a984a3b50a96eef9f9fe3f6358ef76383b15" Jul 23 14:12:04.586072 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.586055 2583 scope.go:117] "RemoveContainer" containerID="2a0b1ae8261b48c83aae0a2524f6a984a3b50a96eef9f9fe3f6358ef76383b15" Jul 23 14:12:04.586316 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:12:04.586298 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a0b1ae8261b48c83aae0a2524f6a984a3b50a96eef9f9fe3f6358ef76383b15\": container with ID starting with 2a0b1ae8261b48c83aae0a2524f6a984a3b50a96eef9f9fe3f6358ef76383b15 not found: ID does not exist" containerID="2a0b1ae8261b48c83aae0a2524f6a984a3b50a96eef9f9fe3f6358ef76383b15" Jul 23 14:12:04.586372 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.586323 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a0b1ae8261b48c83aae0a2524f6a984a3b50a96eef9f9fe3f6358ef76383b15"} err="failed to get container status \"2a0b1ae8261b48c83aae0a2524f6a984a3b50a96eef9f9fe3f6358ef76383b15\": rpc error: code = NotFound desc = could not find container \"2a0b1ae8261b48c83aae0a2524f6a984a3b50a96eef9f9fe3f6358ef76383b15\": container with ID starting with 2a0b1ae8261b48c83aae0a2524f6a984a3b50a96eef9f9fe3f6358ef76383b15 not found: ID does not exist" Jul 23 14:12:04.602577 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.602545 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75c7487ddc-74nwt"] Jul 23 14:12:04.605373 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.605350 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-75c7487ddc-74nwt"] Jul 23 14:12:04.884133 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:04.884064 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26f702c8-73af-4693-95ac-2c03483b6116" path="/var/lib/kubelet/pods/26f702c8-73af-4693-95ac-2c03483b6116/volumes" Jul 23 14:12:05.155038 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:05.154966 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69cb95dc8d-xls7c"] Jul 23 14:12:05.375044 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:05.375011 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:12:05.532427 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:05.532384 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:12:08.221013 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:08.220975 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:12:08.221531 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:08.221052 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:12:11.573390 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:11.573359 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:12:11.677474 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:11.677441 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:12:17.630229 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:17.630195 2583 generic.go:356] "Generic (PLEG): container finished" podID="78668789-e865-4b71-a251-7a81549d1442" containerID="8528d670819f6cb4eec219afbca7c146c2800e17e8d97416e0d03f737079160b" exitCode=0 Jul 23 14:12:17.630591 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:17.630268 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-kf559" event={"ID":"78668789-e865-4b71-a251-7a81549d1442","Type":"ContainerDied","Data":"8528d670819f6cb4eec219afbca7c146c2800e17e8d97416e0d03f737079160b"} Jul 23 14:12:17.630627 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:17.630590 2583 scope.go:117] "RemoveContainer" containerID="8528d670819f6cb4eec219afbca7c146c2800e17e8d97416e0d03f737079160b" Jul 23 14:12:18.416653 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:18.416616 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-695b7bcf8d-qtpwr_e9e8f751-c4aa-4c3b-a110-de695a817c76/router/0.log" Jul 23 14:12:18.438472 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:18.438432 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5bqgn_0d1e7c79-7575-481a-af5b-b3371a5e317d/serve-healthcheck-canary/0.log" Jul 23 14:12:18.635578 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:18.635535 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-kf559" event={"ID":"78668789-e865-4b71-a251-7a81549d1442","Type":"ContainerStarted","Data":"27c96416fdcd26394227456313ad2869f4d1fa581383d542bfc31e1f684c7107"} Jul 23 14:12:19.145402 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.145371 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:12:19.262680 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.262648 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:12:19.303663 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.303613 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bc65c46c8-w8p98" podUID="9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1" containerName="console" containerID="cri-o://4ac971ae4d66f316c048d850d5d431db6fe8c8cbe021bfa03f6d673f1bf271b8" gracePeriod=15 Jul 23 14:12:19.357914 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.357889 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:12:19.557700 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.557677 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:12:19.623524 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.623494 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-console-oauth-config\") pod \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " Jul 23 14:12:19.623524 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.623527 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-service-ca\") pod \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " Jul 23 14:12:19.623737 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.623557 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-trusted-ca-bundle\") pod \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " Jul 23 14:12:19.623737 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.623580 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j69kn\" (UniqueName: \"kubernetes.io/projected/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-kube-api-access-j69kn\") pod \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " Jul 23 14:12:19.623737 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.623604 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-console-config\") pod \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " Jul 23 14:12:19.623737 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.623634 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-console-serving-cert\") pod \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " Jul 23 14:12:19.623737 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.623667 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-oauth-serving-cert\") pod \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\" (UID: \"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1\") " Jul 23 14:12:19.623980 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.623858 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-service-ca" (OuterVolumeSpecName: "service-ca") pod "9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1" (UID: "9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 14:12:19.624048 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.623987 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1" (UID: "9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 14:12:19.624097 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.624055 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1" (UID: "9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 14:12:19.624097 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.624075 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-console-config" (OuterVolumeSpecName: "console-config") pod "9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1" (UID: "9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 14:12:19.625861 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.625839 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-kube-api-access-j69kn" (OuterVolumeSpecName: "kube-api-access-j69kn") pod "9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1" (UID: "9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1"). InnerVolumeSpecName "kube-api-access-j69kn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 14:12:19.625966 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.625866 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1" (UID: "9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 14:12:19.625966 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.625880 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1" (UID: "9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 14:12:19.640403 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.640380 2583 generic.go:356] "Generic (PLEG): container finished" podID="9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1" containerID="4ac971ae4d66f316c048d850d5d431db6fe8c8cbe021bfa03f6d673f1bf271b8" exitCode=0 Jul 23 14:12:19.640761 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.640424 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc65c46c8-w8p98" Jul 23 14:12:19.640761 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.640470 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc65c46c8-w8p98" event={"ID":"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1","Type":"ContainerDied","Data":"4ac971ae4d66f316c048d850d5d431db6fe8c8cbe021bfa03f6d673f1bf271b8"} Jul 23 14:12:19.640761 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.640531 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc65c46c8-w8p98" event={"ID":"9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1","Type":"ContainerDied","Data":"a4fefb25fdd7b762142907e65cacbbd831f0abd05141f549664053e0eb37b408"} Jul 23 14:12:19.640761 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.640560 2583 scope.go:117] "RemoveContainer" containerID="4ac971ae4d66f316c048d850d5d431db6fe8c8cbe021bfa03f6d673f1bf271b8" Jul 23 14:12:19.648989 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.648969 2583 scope.go:117] "RemoveContainer" containerID="4ac971ae4d66f316c048d850d5d431db6fe8c8cbe021bfa03f6d673f1bf271b8" Jul 23 14:12:19.649267 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:12:19.649231 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ac971ae4d66f316c048d850d5d431db6fe8c8cbe021bfa03f6d673f1bf271b8\": container with ID starting with 4ac971ae4d66f316c048d850d5d431db6fe8c8cbe021bfa03f6d673f1bf271b8 not found: ID does not exist" containerID="4ac971ae4d66f316c048d850d5d431db6fe8c8cbe021bfa03f6d673f1bf271b8" Jul 23 14:12:19.649343 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.649280 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ac971ae4d66f316c048d850d5d431db6fe8c8cbe021bfa03f6d673f1bf271b8"} err="failed to get container status \"4ac971ae4d66f316c048d850d5d431db6fe8c8cbe021bfa03f6d673f1bf271b8\": rpc error: code = NotFound desc = could not find container \"4ac971ae4d66f316c048d850d5d431db6fe8c8cbe021bfa03f6d673f1bf271b8\": container with ID starting with 4ac971ae4d66f316c048d850d5d431db6fe8c8cbe021bfa03f6d673f1bf271b8 not found: ID does not exist" Jul 23 14:12:19.689126 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.689056 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bc65c46c8-w8p98"] Jul 23 14:12:19.705869 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.705842 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bc65c46c8-w8p98"] Jul 23 14:12:19.724735 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.724713 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-trusted-ca-bundle\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:12:19.724800 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.724734 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j69kn\" (UniqueName: \"kubernetes.io/projected/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-kube-api-access-j69kn\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:12:19.724800 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.724746 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-console-config\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:12:19.724800 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.724754 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-console-serving-cert\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:12:19.724800 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.724762 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-oauth-serving-cert\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:12:19.724800 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.724771 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-console-oauth-config\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:12:19.724800 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:19.724779 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1-service-ca\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:12:20.883465 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:20.883434 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1" path="/var/lib/kubelet/pods/9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1/volumes" Jul 23 14:12:21.650282 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:21.650231 2583 generic.go:356] "Generic (PLEG): container finished" podID="f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4" containerID="533214b466a6f77db4a81c085c1c17458a946fc9fb251bf3e624ed63c4e2d8cb" exitCode=0 Jul 23 14:12:21.650437 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:21.650304 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gkbtz" event={"ID":"f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4","Type":"ContainerDied","Data":"533214b466a6f77db4a81c085c1c17458a946fc9fb251bf3e624ed63c4e2d8cb"} Jul 23 14:12:21.650658 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:21.650633 2583 scope.go:117] "RemoveContainer" containerID="533214b466a6f77db4a81c085c1c17458a946fc9fb251bf3e624ed63c4e2d8cb" Jul 23 14:12:21.651838 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:21.651815 2583 generic.go:356] "Generic (PLEG): container finished" podID="6fca46de-acd7-4911-8fc7-3dcefade899e" containerID="b1db4a55443f1a1364f58c1ac0d3898a8fcb570c14c93bf4b47a74119cb4984b" exitCode=0 Jul 23 14:12:21.651940 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:21.651882 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n7bbn" event={"ID":"6fca46de-acd7-4911-8fc7-3dcefade899e","Type":"ContainerDied","Data":"b1db4a55443f1a1364f58c1ac0d3898a8fcb570c14c93bf4b47a74119cb4984b"} Jul 23 14:12:21.652188 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:21.652156 2583 scope.go:117] "RemoveContainer" containerID="b1db4a55443f1a1364f58c1ac0d3898a8fcb570c14c93bf4b47a74119cb4984b" Jul 23 14:12:22.657535 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:22.657494 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gkbtz" event={"ID":"f0e8d61e-6c11-4a3b-9a97-3e8f043f4bf4","Type":"ContainerStarted","Data":"5599b19fae572bd23f0219378e827348d4d0f33f098ac6e90f10f5703bea0cef"} Jul 23 14:12:22.659407 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:22.659381 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n7bbn" event={"ID":"6fca46de-acd7-4911-8fc7-3dcefade899e","Type":"ContainerStarted","Data":"dd4351382d45b38075535a6c89cb48f9c8a6562234b4e6fe09432aa10f56f128"} Jul 23 14:12:28.226929 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:28.226899 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:12:28.230705 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:28.230678 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-77d784bc-52b88" Jul 23 14:12:30.174337 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.174298 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69cb95dc8d-xls7c" podUID="e2077d56-b214-4f3d-a129-b33076d38a41" containerName="console" containerID="cri-o://37ef5ac290fa723dd380ba452cff865702be88ed9aae261ef9b3192a34eeea1f" gracePeriod=15 Jul 23 14:12:30.454169 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.453855 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:12:30.517601 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.517563 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-trusted-ca-bundle\") pod \"e2077d56-b214-4f3d-a129-b33076d38a41\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " Jul 23 14:12:30.517822 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.517614 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-service-ca\") pod \"e2077d56-b214-4f3d-a129-b33076d38a41\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " Jul 23 14:12:30.517822 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.517648 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2077d56-b214-4f3d-a129-b33076d38a41-console-serving-cert\") pod \"e2077d56-b214-4f3d-a129-b33076d38a41\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " Jul 23 14:12:30.517822 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.517690 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-console-config\") pod \"e2077d56-b214-4f3d-a129-b33076d38a41\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " Jul 23 14:12:30.517822 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.517717 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phd8k\" (UniqueName: \"kubernetes.io/projected/e2077d56-b214-4f3d-a129-b33076d38a41-kube-api-access-phd8k\") pod \"e2077d56-b214-4f3d-a129-b33076d38a41\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " Jul 23 14:12:30.517822 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.517761 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-oauth-serving-cert\") pod \"e2077d56-b214-4f3d-a129-b33076d38a41\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " Jul 23 14:12:30.517822 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.517784 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2077d56-b214-4f3d-a129-b33076d38a41-console-oauth-config\") pod \"e2077d56-b214-4f3d-a129-b33076d38a41\" (UID: \"e2077d56-b214-4f3d-a129-b33076d38a41\") " Jul 23 14:12:30.518129 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.517949 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-service-ca" (OuterVolumeSpecName: "service-ca") pod "e2077d56-b214-4f3d-a129-b33076d38a41" (UID: "e2077d56-b214-4f3d-a129-b33076d38a41"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 14:12:30.518129 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.518020 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e2077d56-b214-4f3d-a129-b33076d38a41" (UID: "e2077d56-b214-4f3d-a129-b33076d38a41"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 14:12:30.518129 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.518076 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-console-config" (OuterVolumeSpecName: "console-config") pod "e2077d56-b214-4f3d-a129-b33076d38a41" (UID: "e2077d56-b214-4f3d-a129-b33076d38a41"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 14:12:30.518129 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.518097 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-trusted-ca-bundle\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:12:30.518129 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.518117 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-service-ca\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:12:30.518415 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.518326 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e2077d56-b214-4f3d-a129-b33076d38a41" (UID: "e2077d56-b214-4f3d-a129-b33076d38a41"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 14:12:30.519923 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.519889 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2077d56-b214-4f3d-a129-b33076d38a41-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e2077d56-b214-4f3d-a129-b33076d38a41" (UID: "e2077d56-b214-4f3d-a129-b33076d38a41"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 14:12:30.520043 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.519934 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2077d56-b214-4f3d-a129-b33076d38a41-kube-api-access-phd8k" (OuterVolumeSpecName: "kube-api-access-phd8k") pod "e2077d56-b214-4f3d-a129-b33076d38a41" (UID: "e2077d56-b214-4f3d-a129-b33076d38a41"). InnerVolumeSpecName "kube-api-access-phd8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 14:12:30.520043 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.519990 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2077d56-b214-4f3d-a129-b33076d38a41-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e2077d56-b214-4f3d-a129-b33076d38a41" (UID: "e2077d56-b214-4f3d-a129-b33076d38a41"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 14:12:30.618931 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.618893 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2077d56-b214-4f3d-a129-b33076d38a41-console-serving-cert\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:12:30.618931 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.618923 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-console-config\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:12:30.618931 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.618935 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phd8k\" (UniqueName: \"kubernetes.io/projected/e2077d56-b214-4f3d-a129-b33076d38a41-kube-api-access-phd8k\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:12:30.619312 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.618950 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2077d56-b214-4f3d-a129-b33076d38a41-oauth-serving-cert\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:12:30.619312 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.618961 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2077d56-b214-4f3d-a129-b33076d38a41-console-oauth-config\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:12:30.692658 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.692563 2583 generic.go:356] "Generic (PLEG): container finished" podID="e2077d56-b214-4f3d-a129-b33076d38a41" containerID="37ef5ac290fa723dd380ba452cff865702be88ed9aae261ef9b3192a34eeea1f" exitCode=0 Jul 23 14:12:30.692816 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.692673 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69cb95dc8d-xls7c" event={"ID":"e2077d56-b214-4f3d-a129-b33076d38a41","Type":"ContainerDied","Data":"37ef5ac290fa723dd380ba452cff865702be88ed9aae261ef9b3192a34eeea1f"} Jul 23 14:12:30.692816 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.692724 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69cb95dc8d-xls7c" event={"ID":"e2077d56-b214-4f3d-a129-b33076d38a41","Type":"ContainerDied","Data":"75610287d43a7b43dd53471e310222a342cb9ee603d5bc09a9b20abc006ed35e"} Jul 23 14:12:30.692816 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.692756 2583 scope.go:117] "RemoveContainer" containerID="37ef5ac290fa723dd380ba452cff865702be88ed9aae261ef9b3192a34eeea1f" Jul 23 14:12:30.692957 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.692938 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69cb95dc8d-xls7c" Jul 23 14:12:30.708288 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.707851 2583 scope.go:117] "RemoveContainer" containerID="37ef5ac290fa723dd380ba452cff865702be88ed9aae261ef9b3192a34eeea1f" Jul 23 14:12:30.708288 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:12:30.708208 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37ef5ac290fa723dd380ba452cff865702be88ed9aae261ef9b3192a34eeea1f\": container with ID starting with 37ef5ac290fa723dd380ba452cff865702be88ed9aae261ef9b3192a34eeea1f not found: ID does not exist" containerID="37ef5ac290fa723dd380ba452cff865702be88ed9aae261ef9b3192a34eeea1f" Jul 23 14:12:30.708288 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.708268 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37ef5ac290fa723dd380ba452cff865702be88ed9aae261ef9b3192a34eeea1f"} err="failed to get container status \"37ef5ac290fa723dd380ba452cff865702be88ed9aae261ef9b3192a34eeea1f\": rpc error: code = NotFound desc = could not find container \"37ef5ac290fa723dd380ba452cff865702be88ed9aae261ef9b3192a34eeea1f\": container with ID starting with 37ef5ac290fa723dd380ba452cff865702be88ed9aae261ef9b3192a34eeea1f not found: ID does not exist" Jul 23 14:12:30.721330 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.721301 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69cb95dc8d-xls7c"] Jul 23 14:12:30.724081 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.724056 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69cb95dc8d-xls7c"] Jul 23 14:12:30.890337 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:30.890304 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2077d56-b214-4f3d-a129-b33076d38a41" path="/var/lib/kubelet/pods/e2077d56-b214-4f3d-a129-b33076d38a41/volumes" Jul 23 14:12:31.438503 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:31.438451 2583 patch_prober.go:28] interesting pod/console-69cb95dc8d-xls7c container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.21:8443/health\": context deadline exceeded" start-of-body= Jul 23 14:12:31.438933 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:31.438533 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-69cb95dc8d-xls7c" podUID="e2077d56-b214-4f3d-a129-b33076d38a41" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": context deadline exceeded" Jul 23 14:12:59.447547 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:59.447467 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:12:59.507198 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:12:59.507167 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:13:10.818852 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.818817 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57b84745b8-8q8w6"] Jul 23 14:13:10.819321 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.819282 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26f702c8-73af-4693-95ac-2c03483b6116" containerName="registry" Jul 23 14:13:10.819321 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.819301 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="26f702c8-73af-4693-95ac-2c03483b6116" containerName="registry" Jul 23 14:13:10.819321 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.819321 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1" containerName="console" Jul 23 14:13:10.819494 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.819329 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1" containerName="console" Jul 23 14:13:10.819494 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.819347 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2077d56-b214-4f3d-a129-b33076d38a41" containerName="console" Jul 23 14:13:10.819494 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.819356 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2077d56-b214-4f3d-a129-b33076d38a41" containerName="console" Jul 23 14:13:10.819494 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.819438 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="26f702c8-73af-4693-95ac-2c03483b6116" containerName="registry" Jul 23 14:13:10.819494 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.819449 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b7ea709-fbfe-4c25-9d9a-96e5482fcbc1" containerName="console" Jul 23 14:13:10.819494 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.819462 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2077d56-b214-4f3d-a129-b33076d38a41" containerName="console" Jul 23 14:13:10.823690 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.823667 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:10.826998 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.826973 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 23 14:13:10.827943 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.827916 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 23 14:13:10.828063 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.827963 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 23 14:13:10.828292 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.828276 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lvrll\"" Jul 23 14:13:10.828398 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.828300 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 23 14:13:10.828906 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.828885 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 23 14:13:10.833085 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.833064 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 23 14:13:10.833181 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.833109 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 23 14:13:10.837402 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.837384 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 23 14:13:10.838594 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.838572 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57b84745b8-8q8w6"] Jul 23 14:13:10.864144 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.864112 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-service-ca\") pod \"console-57b84745b8-8q8w6\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:10.864144 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.864145 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-trusted-ca-bundle\") pod \"console-57b84745b8-8q8w6\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:10.864429 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.864182 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09e078af-22b8-4e02-a5b1-4917fd9a37e9-console-oauth-config\") pod \"console-57b84745b8-8q8w6\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:10.864429 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.864321 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-oauth-serving-cert\") pod \"console-57b84745b8-8q8w6\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:10.864429 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.864351 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09e078af-22b8-4e02-a5b1-4917fd9a37e9-console-serving-cert\") pod \"console-57b84745b8-8q8w6\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:10.864429 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.864368 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxxqt\" (UniqueName: \"kubernetes.io/projected/09e078af-22b8-4e02-a5b1-4917fd9a37e9-kube-api-access-hxxqt\") pod \"console-57b84745b8-8q8w6\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:10.864429 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.864409 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-console-config\") pod \"console-57b84745b8-8q8w6\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:10.898958 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.898928 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:13:10.965525 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.965484 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09e078af-22b8-4e02-a5b1-4917fd9a37e9-console-oauth-config\") pod \"console-57b84745b8-8q8w6\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:10.965712 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.965557 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-oauth-serving-cert\") pod \"console-57b84745b8-8q8w6\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:10.965712 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.965585 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09e078af-22b8-4e02-a5b1-4917fd9a37e9-console-serving-cert\") pod \"console-57b84745b8-8q8w6\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:10.965712 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.965603 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxxqt\" (UniqueName: \"kubernetes.io/projected/09e078af-22b8-4e02-a5b1-4917fd9a37e9-kube-api-access-hxxqt\") pod \"console-57b84745b8-8q8w6\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:10.965712 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.965629 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-console-config\") pod \"console-57b84745b8-8q8w6\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:10.965712 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.965654 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-service-ca\") pod \"console-57b84745b8-8q8w6\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:10.965712 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.965684 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-trusted-ca-bundle\") pod \"console-57b84745b8-8q8w6\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:10.966457 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.966427 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-oauth-serving-cert\") pod \"console-57b84745b8-8q8w6\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:10.966571 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.966476 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-console-config\") pod \"console-57b84745b8-8q8w6\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:10.966571 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.966536 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-trusted-ca-bundle\") pod \"console-57b84745b8-8q8w6\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:10.966571 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.966544 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-service-ca\") pod \"console-57b84745b8-8q8w6\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:10.968054 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.968022 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:13:10.968178 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.968101 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09e078af-22b8-4e02-a5b1-4917fd9a37e9-console-oauth-config\") pod \"console-57b84745b8-8q8w6\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:10.968444 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.968407 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09e078af-22b8-4e02-a5b1-4917fd9a37e9-console-serving-cert\") pod \"console-57b84745b8-8q8w6\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:10.974763 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:10.974740 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxxqt\" (UniqueName: \"kubernetes.io/projected/09e078af-22b8-4e02-a5b1-4917fd9a37e9-kube-api-access-hxxqt\") pod \"console-57b84745b8-8q8w6\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:11.135370 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:11.135275 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:11.265884 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:11.265853 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57b84745b8-8q8w6"] Jul 23 14:13:11.268851 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:13:11.268825 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09e078af_22b8_4e02_a5b1_4917fd9a37e9.slice/crio-59edef67c7aebd5cbeae79e5fda10b3c835e21e9a7ae27096b2252c0fc8003e7 WatchSource:0}: Error finding container 59edef67c7aebd5cbeae79e5fda10b3c835e21e9a7ae27096b2252c0fc8003e7: Status 404 returned error can't find the container with id 59edef67c7aebd5cbeae79e5fda10b3c835e21e9a7ae27096b2252c0fc8003e7 Jul 23 14:13:11.489805 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:11.489715 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:13:11.590987 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:11.590953 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:13:11.864628 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:11.864589 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b84745b8-8q8w6" event={"ID":"09e078af-22b8-4e02-a5b1-4917fd9a37e9","Type":"ContainerStarted","Data":"fe83b2c192480055560a17c7db6e9646dab5d7c92d994a8499dbb1d67af118f6"} Jul 23 14:13:11.865010 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:11.864645 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b84745b8-8q8w6" event={"ID":"09e078af-22b8-4e02-a5b1-4917fd9a37e9","Type":"ContainerStarted","Data":"59edef67c7aebd5cbeae79e5fda10b3c835e21e9a7ae27096b2252c0fc8003e7"} Jul 23 14:13:11.883453 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:11.883404 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57b84745b8-8q8w6" podStartSLOduration=1.883389417 podStartE2EDuration="1.883389417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:13:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:13:11.882264745 +0000 UTC m=+187.442093089" watchObservedRunningTime="2026-07-23 14:13:11.883389417 +0000 UTC m=+187.443217758" Jul 23 14:13:16.768016 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:16.767981 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:13:21.135806 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:21.135758 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:21.135806 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:21.135826 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:21.140611 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:21.140590 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:21.906381 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:21.906352 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:13:22.062468 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:22.062435 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:13:22.163594 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:22.163508 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:13:22.224619 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:22.224584 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:13:26.542590 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:26.542554 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:13:26.644216 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:26.644180 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:13:48.506485 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:48.506448 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:13:48.558718 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:13:48.558684 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:14:03.610690 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:03.610653 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:14:03.709289 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:03.709224 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:14:04.268535 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:04.268500 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq"] Jul 23 14:14:04.271847 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:04.271814 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq" Jul 23 14:14:04.274314 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:04.274291 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 23 14:14:04.274398 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:04.274328 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rxbx5\"" Jul 23 14:14:04.275207 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:04.275192 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 23 14:14:04.280054 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:04.280029 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq"] Jul 23 14:14:04.419497 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:04.419462 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ecaad4f-90bd-4ee2-a7da-2453786e3fe7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq\" (UID: \"6ecaad4f-90bd-4ee2-a7da-2453786e3fe7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq" Jul 23 14:14:04.419674 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:04.419502 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ecaad4f-90bd-4ee2-a7da-2453786e3fe7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq\" (UID: \"6ecaad4f-90bd-4ee2-a7da-2453786e3fe7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq" Jul 23 14:14:04.419674 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:04.419629 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn9kr\" (UniqueName: \"kubernetes.io/projected/6ecaad4f-90bd-4ee2-a7da-2453786e3fe7-kube-api-access-nn9kr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq\" (UID: \"6ecaad4f-90bd-4ee2-a7da-2453786e3fe7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq" Jul 23 14:14:04.520209 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:04.520128 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn9kr\" (UniqueName: \"kubernetes.io/projected/6ecaad4f-90bd-4ee2-a7da-2453786e3fe7-kube-api-access-nn9kr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq\" (UID: \"6ecaad4f-90bd-4ee2-a7da-2453786e3fe7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq" Jul 23 14:14:04.520209 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:04.520172 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ecaad4f-90bd-4ee2-a7da-2453786e3fe7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq\" (UID: \"6ecaad4f-90bd-4ee2-a7da-2453786e3fe7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq" Jul 23 14:14:04.520209 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:04.520192 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ecaad4f-90bd-4ee2-a7da-2453786e3fe7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq\" (UID: \"6ecaad4f-90bd-4ee2-a7da-2453786e3fe7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq" Jul 23 14:14:04.520613 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:04.520591 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ecaad4f-90bd-4ee2-a7da-2453786e3fe7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq\" (UID: \"6ecaad4f-90bd-4ee2-a7da-2453786e3fe7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq" Jul 23 14:14:04.520613 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:04.520605 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ecaad4f-90bd-4ee2-a7da-2453786e3fe7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq\" (UID: \"6ecaad4f-90bd-4ee2-a7da-2453786e3fe7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq" Jul 23 14:14:04.528647 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:04.528627 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn9kr\" (UniqueName: \"kubernetes.io/projected/6ecaad4f-90bd-4ee2-a7da-2453786e3fe7-kube-api-access-nn9kr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq\" (UID: \"6ecaad4f-90bd-4ee2-a7da-2453786e3fe7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq" Jul 23 14:14:04.582009 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:04.581972 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq" Jul 23 14:14:04.709710 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:04.709644 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq"] Jul 23 14:14:04.712040 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:14:04.712016 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ecaad4f_90bd_4ee2_a7da_2453786e3fe7.slice/crio-8efbb2584a13761e02e36aff16fd73f7e53b42e3ed3eec6ee06e28baa6fbd8fe WatchSource:0}: Error finding container 8efbb2584a13761e02e36aff16fd73f7e53b42e3ed3eec6ee06e28baa6fbd8fe: Status 404 returned error can't find the container with id 8efbb2584a13761e02e36aff16fd73f7e53b42e3ed3eec6ee06e28baa6fbd8fe Jul 23 14:14:05.071614 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:05.071579 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq" event={"ID":"6ecaad4f-90bd-4ee2-a7da-2453786e3fe7","Type":"ContainerStarted","Data":"8efbb2584a13761e02e36aff16fd73f7e53b42e3ed3eec6ee06e28baa6fbd8fe"} Jul 23 14:14:11.028996 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:11.028958 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:14:12.102671 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:12.102640 2583 generic.go:356] "Generic (PLEG): container finished" podID="6ecaad4f-90bd-4ee2-a7da-2453786e3fe7" containerID="04bb7516b90744aeebbb97b6727e17ac0cc812e0260d816b4bd4b1120e623561" exitCode=0 Jul 23 14:14:12.103061 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:12.102705 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq" event={"ID":"6ecaad4f-90bd-4ee2-a7da-2453786e3fe7","Type":"ContainerDied","Data":"04bb7516b90744aeebbb97b6727e17ac0cc812e0260d816b4bd4b1120e623561"} Jul 23 14:14:15.119106 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:15.119065 2583 generic.go:356] "Generic (PLEG): container finished" podID="6ecaad4f-90bd-4ee2-a7da-2453786e3fe7" containerID="e63e0d6eb6f0d4cf65f7d68458e5018d9e04eda02ce66c3058ec80b9440dfbd4" exitCode=0 Jul 23 14:14:15.119506 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:15.119148 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq" event={"ID":"6ecaad4f-90bd-4ee2-a7da-2453786e3fe7","Type":"ContainerDied","Data":"e63e0d6eb6f0d4cf65f7d68458e5018d9e04eda02ce66c3058ec80b9440dfbd4"} Jul 23 14:14:22.151145 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:22.151109 2583 generic.go:356] "Generic (PLEG): container finished" podID="6ecaad4f-90bd-4ee2-a7da-2453786e3fe7" containerID="cde7dc910f29c16d45ea37f4d2e6da122b15162c4de617fc5142ad23a2ea295d" exitCode=0 Jul 23 14:14:22.151548 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:22.151172 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq" event={"ID":"6ecaad4f-90bd-4ee2-a7da-2453786e3fe7","Type":"ContainerDied","Data":"cde7dc910f29c16d45ea37f4d2e6da122b15162c4de617fc5142ad23a2ea295d"} Jul 23 14:14:22.447228 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:22.447147 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:14:22.503150 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:22.503111 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:14:23.284626 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:23.284604 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq" Jul 23 14:14:23.387193 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:23.387159 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nn9kr\" (UniqueName: \"kubernetes.io/projected/6ecaad4f-90bd-4ee2-a7da-2453786e3fe7-kube-api-access-nn9kr\") pod \"6ecaad4f-90bd-4ee2-a7da-2453786e3fe7\" (UID: \"6ecaad4f-90bd-4ee2-a7da-2453786e3fe7\") " Jul 23 14:14:23.387371 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:23.387257 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ecaad4f-90bd-4ee2-a7da-2453786e3fe7-bundle\") pod \"6ecaad4f-90bd-4ee2-a7da-2453786e3fe7\" (UID: \"6ecaad4f-90bd-4ee2-a7da-2453786e3fe7\") " Jul 23 14:14:23.387371 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:23.387279 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ecaad4f-90bd-4ee2-a7da-2453786e3fe7-util\") pod \"6ecaad4f-90bd-4ee2-a7da-2453786e3fe7\" (UID: \"6ecaad4f-90bd-4ee2-a7da-2453786e3fe7\") " Jul 23 14:14:23.387936 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:23.387910 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ecaad4f-90bd-4ee2-a7da-2453786e3fe7-bundle" (OuterVolumeSpecName: "bundle") pod "6ecaad4f-90bd-4ee2-a7da-2453786e3fe7" (UID: "6ecaad4f-90bd-4ee2-a7da-2453786e3fe7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 14:14:23.389335 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:23.389307 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ecaad4f-90bd-4ee2-a7da-2453786e3fe7-kube-api-access-nn9kr" (OuterVolumeSpecName: "kube-api-access-nn9kr") pod "6ecaad4f-90bd-4ee2-a7da-2453786e3fe7" (UID: "6ecaad4f-90bd-4ee2-a7da-2453786e3fe7"). InnerVolumeSpecName "kube-api-access-nn9kr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 14:14:23.392357 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:23.392331 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ecaad4f-90bd-4ee2-a7da-2453786e3fe7-util" (OuterVolumeSpecName: "util") pod "6ecaad4f-90bd-4ee2-a7da-2453786e3fe7" (UID: "6ecaad4f-90bd-4ee2-a7da-2453786e3fe7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 14:14:23.488370 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:23.488302 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ecaad4f-90bd-4ee2-a7da-2453786e3fe7-bundle\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:14:23.488370 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:23.488326 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ecaad4f-90bd-4ee2-a7da-2453786e3fe7-util\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:14:23.488370 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:23.488335 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nn9kr\" (UniqueName: \"kubernetes.io/projected/6ecaad4f-90bd-4ee2-a7da-2453786e3fe7-kube-api-access-nn9kr\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:14:24.162468 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:24.162439 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq" Jul 23 14:14:24.162468 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:24.162454 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ss4lq" event={"ID":"6ecaad4f-90bd-4ee2-a7da-2453786e3fe7","Type":"ContainerDied","Data":"8efbb2584a13761e02e36aff16fd73f7e53b42e3ed3eec6ee06e28baa6fbd8fe"} Jul 23 14:14:24.162662 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:24.162524 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8efbb2584a13761e02e36aff16fd73f7e53b42e3ed3eec6ee06e28baa6fbd8fe" Jul 23 14:14:25.241941 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:25.241899 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:14:26.082332 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:26.082300 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:14:27.285369 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:27.285295 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-r8p9z"] Jul 23 14:14:27.285721 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:27.285614 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ecaad4f-90bd-4ee2-a7da-2453786e3fe7" containerName="pull" Jul 23 14:14:27.285721 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:27.285625 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ecaad4f-90bd-4ee2-a7da-2453786e3fe7" containerName="pull" Jul 23 14:14:27.285721 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:27.285640 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ecaad4f-90bd-4ee2-a7da-2453786e3fe7" containerName="util" Jul 23 14:14:27.285721 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:27.285645 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ecaad4f-90bd-4ee2-a7da-2453786e3fe7" containerName="util" Jul 23 14:14:27.285721 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:27.285653 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ecaad4f-90bd-4ee2-a7da-2453786e3fe7" containerName="extract" Jul 23 14:14:27.285721 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:27.285658 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ecaad4f-90bd-4ee2-a7da-2453786e3fe7" containerName="extract" Jul 23 14:14:27.285721 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:27.285703 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ecaad4f-90bd-4ee2-a7da-2453786e3fe7" containerName="extract" Jul 23 14:14:27.288472 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:27.288456 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-r8p9z" Jul 23 14:14:27.290870 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:27.290852 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-shgtk\"" Jul 23 14:14:27.291002 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:27.290987 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 23 14:14:27.291422 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:27.291403 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 23 14:14:27.302942 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:27.302919 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-r8p9z"] Jul 23 14:14:27.419616 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:27.419582 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c49c2c4-3d32-47ca-bc7a-3db9e021b1b9-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-r8p9z\" (UID: \"2c49c2c4-3d32-47ca-bc7a-3db9e021b1b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-r8p9z" Jul 23 14:14:27.419783 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:27.419681 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xg8r\" (UniqueName: \"kubernetes.io/projected/2c49c2c4-3d32-47ca-bc7a-3db9e021b1b9-kube-api-access-4xg8r\") pod \"cert-manager-operator-controller-manager-56b4598547-r8p9z\" (UID: \"2c49c2c4-3d32-47ca-bc7a-3db9e021b1b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-r8p9z" Jul 23 14:14:27.521046 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:27.521007 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xg8r\" (UniqueName: \"kubernetes.io/projected/2c49c2c4-3d32-47ca-bc7a-3db9e021b1b9-kube-api-access-4xg8r\") pod \"cert-manager-operator-controller-manager-56b4598547-r8p9z\" (UID: \"2c49c2c4-3d32-47ca-bc7a-3db9e021b1b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-r8p9z" Jul 23 14:14:27.521207 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:27.521078 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c49c2c4-3d32-47ca-bc7a-3db9e021b1b9-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-r8p9z\" (UID: \"2c49c2c4-3d32-47ca-bc7a-3db9e021b1b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-r8p9z" Jul 23 14:14:27.521447 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:27.521431 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c49c2c4-3d32-47ca-bc7a-3db9e021b1b9-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-r8p9z\" (UID: \"2c49c2c4-3d32-47ca-bc7a-3db9e021b1b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-r8p9z" Jul 23 14:14:27.529675 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:27.529653 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xg8r\" (UniqueName: \"kubernetes.io/projected/2c49c2c4-3d32-47ca-bc7a-3db9e021b1b9-kube-api-access-4xg8r\") pod \"cert-manager-operator-controller-manager-56b4598547-r8p9z\" (UID: \"2c49c2c4-3d32-47ca-bc7a-3db9e021b1b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-r8p9z" Jul 23 14:14:27.597040 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:27.596965 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-r8p9z" Jul 23 14:14:27.726396 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:27.726369 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-r8p9z"] Jul 23 14:14:27.728102 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:14:27.728076 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c49c2c4_3d32_47ca_bc7a_3db9e021b1b9.slice/crio-5bcc79345c492a5dc6dcf89fac0b5b7647b54b9ce58693dabd454ba47d84f66f WatchSource:0}: Error finding container 5bcc79345c492a5dc6dcf89fac0b5b7647b54b9ce58693dabd454ba47d84f66f: Status 404 returned error can't find the container with id 5bcc79345c492a5dc6dcf89fac0b5b7647b54b9ce58693dabd454ba47d84f66f Jul 23 14:14:28.181570 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:28.181535 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-r8p9z" event={"ID":"2c49c2c4-3d32-47ca-bc7a-3db9e021b1b9","Type":"ContainerStarted","Data":"5bcc79345c492a5dc6dcf89fac0b5b7647b54b9ce58693dabd454ba47d84f66f"} Jul 23 14:14:28.845293 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:28.845227 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:14:28.900825 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:28.900797 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:14:30.191900 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:30.191864 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-r8p9z" event={"ID":"2c49c2c4-3d32-47ca-bc7a-3db9e021b1b9","Type":"ContainerStarted","Data":"8a9c75537b1525d0d89cc78d8643e0040c1e19ce46242e85605f3646211e83a8"} Jul 23 14:14:30.213303 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:30.213254 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-r8p9z" podStartSLOduration=1.59005486 podStartE2EDuration="3.213226449s" totalImagesPullingTime="1.623171589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:14:30.211215344 +0000 UTC m=+265.771043686" watchObservedRunningTime="2026-07-23 14:14:30.213226449 +0000 UTC m=+265.773054791" Jul 23 14:14:31.136182 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:31.136142 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:14:31.249028 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:31.248978 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:14:31.259881 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:31.259855 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-l784b"] Jul 23 14:14:31.263288 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:31.263265 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-l784b" Jul 23 14:14:31.266420 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:31.266400 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 23 14:14:31.267299 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:31.267278 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-kctn9\"" Jul 23 14:14:31.267389 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:31.267304 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 23 14:14:31.271864 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:31.271841 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-l784b"] Jul 23 14:14:31.351415 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:31.351370 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ababe6f-4699-4676-b1e1-9c1c4a090eb3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-l784b\" (UID: \"4ababe6f-4699-4676-b1e1-9c1c4a090eb3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l784b" Jul 23 14:14:31.351563 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:31.351437 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg6zz\" (UniqueName: \"kubernetes.io/projected/4ababe6f-4699-4676-b1e1-9c1c4a090eb3-kube-api-access-vg6zz\") pod \"cert-manager-webhook-6486ffd997-l784b\" (UID: \"4ababe6f-4699-4676-b1e1-9c1c4a090eb3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l784b" Jul 23 14:14:31.452518 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:31.452426 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ababe6f-4699-4676-b1e1-9c1c4a090eb3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-l784b\" (UID: \"4ababe6f-4699-4676-b1e1-9c1c4a090eb3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l784b" Jul 23 14:14:31.452518 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:31.452493 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg6zz\" (UniqueName: \"kubernetes.io/projected/4ababe6f-4699-4676-b1e1-9c1c4a090eb3-kube-api-access-vg6zz\") pod \"cert-manager-webhook-6486ffd997-l784b\" (UID: \"4ababe6f-4699-4676-b1e1-9c1c4a090eb3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l784b" Jul 23 14:14:31.461184 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:31.461159 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ababe6f-4699-4676-b1e1-9c1c4a090eb3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-l784b\" (UID: \"4ababe6f-4699-4676-b1e1-9c1c4a090eb3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l784b" Jul 23 14:14:31.461362 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:31.461341 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg6zz\" (UniqueName: \"kubernetes.io/projected/4ababe6f-4699-4676-b1e1-9c1c4a090eb3-kube-api-access-vg6zz\") pod \"cert-manager-webhook-6486ffd997-l784b\" (UID: \"4ababe6f-4699-4676-b1e1-9c1c4a090eb3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l784b" Jul 23 14:14:31.583030 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:31.582995 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-l784b" Jul 23 14:14:31.709082 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:31.709007 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-l784b"] Jul 23 14:14:31.711704 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:14:31.711677 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ababe6f_4699_4676_b1e1_9c1c4a090eb3.slice/crio-980c3a67d422d74263f9d43ed1876914921fb82b23a205902329596950c71fd3 WatchSource:0}: Error finding container 980c3a67d422d74263f9d43ed1876914921fb82b23a205902329596950c71fd3: Status 404 returned error can't find the container with id 980c3a67d422d74263f9d43ed1876914921fb82b23a205902329596950c71fd3 Jul 23 14:14:32.201806 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:32.201774 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-l784b" event={"ID":"4ababe6f-4699-4676-b1e1-9c1c4a090eb3","Type":"ContainerStarted","Data":"980c3a67d422d74263f9d43ed1876914921fb82b23a205902329596950c71fd3"} Jul 23 14:14:33.379995 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:33.379955 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:14:33.574574 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:33.574541 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:14:33.854739 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:33.854708 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:14:33.954644 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:33.954610 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:14:35.217364 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:35.217326 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-l784b" event={"ID":"4ababe6f-4699-4676-b1e1-9c1c4a090eb3","Type":"ContainerStarted","Data":"400e040292b242f0135e3e70c2aec4a1c94a97212e9292499aa1944000c13239"} Jul 23 14:14:35.217808 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:35.217455 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-l784b" Jul 23 14:14:35.232912 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:35.232860 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-l784b" podStartSLOduration=1.3563051179999999 podStartE2EDuration="4.232848311s" totalImagesPullingTime="2.876543193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:14:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:14:35.232397726 +0000 UTC m=+270.792226079" watchObservedRunningTime="2026-07-23 14:14:35.232848311 +0000 UTC m=+270.792676653" Jul 23 14:14:38.333672 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:38.333641 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:14:38.391269 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:38.391207 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:14:41.224041 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:41.224007 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-l784b" Jul 23 14:14:41.551655 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:41.551613 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:14:43.931035 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:43.930998 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nhph5"] Jul 23 14:14:43.933867 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:43.933850 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nhph5" Jul 23 14:14:43.935966 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:43.935941 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-rt47l\"" Jul 23 14:14:43.944144 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:43.944120 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nhph5"] Jul 23 14:14:44.062524 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:44.062488 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0184a9a-fef8-4991-9e99-246361bf64b3-bound-sa-token\") pod \"cert-manager-55b4d954d5-nhph5\" (UID: \"f0184a9a-fef8-4991-9e99-246361bf64b3\") " pod="cert-manager/cert-manager-55b4d954d5-nhph5" Jul 23 14:14:44.062679 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:44.062569 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btbqr\" (UniqueName: \"kubernetes.io/projected/f0184a9a-fef8-4991-9e99-246361bf64b3-kube-api-access-btbqr\") pod \"cert-manager-55b4d954d5-nhph5\" (UID: \"f0184a9a-fef8-4991-9e99-246361bf64b3\") " pod="cert-manager/cert-manager-55b4d954d5-nhph5" Jul 23 14:14:44.163510 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:44.163468 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btbqr\" (UniqueName: \"kubernetes.io/projected/f0184a9a-fef8-4991-9e99-246361bf64b3-kube-api-access-btbqr\") pod \"cert-manager-55b4d954d5-nhph5\" (UID: \"f0184a9a-fef8-4991-9e99-246361bf64b3\") " pod="cert-manager/cert-manager-55b4d954d5-nhph5" Jul 23 14:14:44.163653 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:44.163533 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0184a9a-fef8-4991-9e99-246361bf64b3-bound-sa-token\") pod \"cert-manager-55b4d954d5-nhph5\" (UID: \"f0184a9a-fef8-4991-9e99-246361bf64b3\") " pod="cert-manager/cert-manager-55b4d954d5-nhph5" Jul 23 14:14:44.171938 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:44.171907 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0184a9a-fef8-4991-9e99-246361bf64b3-bound-sa-token\") pod \"cert-manager-55b4d954d5-nhph5\" (UID: \"f0184a9a-fef8-4991-9e99-246361bf64b3\") " pod="cert-manager/cert-manager-55b4d954d5-nhph5" Jul 23 14:14:44.172032 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:44.171992 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btbqr\" (UniqueName: \"kubernetes.io/projected/f0184a9a-fef8-4991-9e99-246361bf64b3-kube-api-access-btbqr\") pod \"cert-manager-55b4d954d5-nhph5\" (UID: \"f0184a9a-fef8-4991-9e99-246361bf64b3\") " pod="cert-manager/cert-manager-55b4d954d5-nhph5" Jul 23 14:14:44.242877 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:44.242790 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nhph5" Jul 23 14:14:44.374126 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:44.374099 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nhph5"] Jul 23 14:14:44.376189 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:14:44.376164 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0184a9a_fef8_4991_9e99_246361bf64b3.slice/crio-5676358208efa5fdc50f08bba4786329c865e4c2a045ebb396630d2e16e9ae27 WatchSource:0}: Error finding container 5676358208efa5fdc50f08bba4786329c865e4c2a045ebb396630d2e16e9ae27: Status 404 returned error can't find the container with id 5676358208efa5fdc50f08bba4786329c865e4c2a045ebb396630d2e16e9ae27 Jul 23 14:14:45.267889 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:45.267861 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nhph5" event={"ID":"f0184a9a-fef8-4991-9e99-246361bf64b3","Type":"ContainerStarted","Data":"4d3bf4f82f70d5774e6cbd899ff0e08aa255d5fd296de3b17cb9f19b1a429bfd"} Jul 23 14:14:45.268273 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:45.267901 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nhph5" event={"ID":"f0184a9a-fef8-4991-9e99-246361bf64b3","Type":"ContainerStarted","Data":"5676358208efa5fdc50f08bba4786329c865e4c2a045ebb396630d2e16e9ae27"} Jul 23 14:14:45.283845 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:45.283796 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-nhph5" podStartSLOduration=2.283779376 podStartE2EDuration="2.283779376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:14:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:14:45.283078859 +0000 UTC m=+280.842907201" watchObservedRunningTime="2026-07-23 14:14:45.283779376 +0000 UTC m=+280.843607717" Jul 23 14:14:45.475390 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:45.475358 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:14:45.572565 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:45.572481 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:14:46.460968 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:46.460933 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9"] Jul 23 14:14:46.463972 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:46.463955 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9" Jul 23 14:14:46.466165 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:46.466145 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 23 14:14:46.466296 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:46.466252 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rxbx5\"" Jul 23 14:14:46.466296 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:46.466269 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 23 14:14:46.472926 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:46.472898 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9"] Jul 23 14:14:46.583479 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:46.583437 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7403d0b-c5cc-4059-94ca-91585102c59e-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9\" (UID: \"e7403d0b-c5cc-4059-94ca-91585102c59e\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9" Jul 23 14:14:46.583479 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:46.583481 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7403d0b-c5cc-4059-94ca-91585102c59e-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9\" (UID: \"e7403d0b-c5cc-4059-94ca-91585102c59e\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9" Jul 23 14:14:46.583692 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:46.583509 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvfnv\" (UniqueName: \"kubernetes.io/projected/e7403d0b-c5cc-4059-94ca-91585102c59e-kube-api-access-dvfnv\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9\" (UID: \"e7403d0b-c5cc-4059-94ca-91585102c59e\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9" Jul 23 14:14:46.684429 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:46.684386 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7403d0b-c5cc-4059-94ca-91585102c59e-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9\" (UID: \"e7403d0b-c5cc-4059-94ca-91585102c59e\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9" Jul 23 14:14:46.684429 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:46.684431 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7403d0b-c5cc-4059-94ca-91585102c59e-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9\" (UID: \"e7403d0b-c5cc-4059-94ca-91585102c59e\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9" Jul 23 14:14:46.684628 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:46.684555 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvfnv\" (UniqueName: \"kubernetes.io/projected/e7403d0b-c5cc-4059-94ca-91585102c59e-kube-api-access-dvfnv\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9\" (UID: \"e7403d0b-c5cc-4059-94ca-91585102c59e\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9" Jul 23 14:14:46.684784 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:46.684770 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7403d0b-c5cc-4059-94ca-91585102c59e-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9\" (UID: \"e7403d0b-c5cc-4059-94ca-91585102c59e\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9" Jul 23 14:14:46.684818 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:46.684796 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7403d0b-c5cc-4059-94ca-91585102c59e-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9\" (UID: \"e7403d0b-c5cc-4059-94ca-91585102c59e\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9" Jul 23 14:14:46.693104 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:46.693069 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvfnv\" (UniqueName: \"kubernetes.io/projected/e7403d0b-c5cc-4059-94ca-91585102c59e-kube-api-access-dvfnv\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9\" (UID: \"e7403d0b-c5cc-4059-94ca-91585102c59e\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9" Jul 23 14:14:46.782596 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:46.782562 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9" Jul 23 14:14:46.909964 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:46.909937 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9"] Jul 23 14:14:46.912150 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:14:46.912123 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7403d0b_c5cc_4059_94ca_91585102c59e.slice/crio-d9d65b0d876bee6727da3fd06b7a40b7415b25cfb842d5e5aa360e65fa701c7e WatchSource:0}: Error finding container d9d65b0d876bee6727da3fd06b7a40b7415b25cfb842d5e5aa360e65fa701c7e: Status 404 returned error can't find the container with id d9d65b0d876bee6727da3fd06b7a40b7415b25cfb842d5e5aa360e65fa701c7e Jul 23 14:14:47.278864 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:47.278828 2583 generic.go:356] "Generic (PLEG): container finished" podID="e7403d0b-c5cc-4059-94ca-91585102c59e" containerID="f2af333cf33d7e97671981016d8a81ca4f598b07c4fdbd430966461e710937b9" exitCode=0 Jul 23 14:14:47.279046 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:47.278918 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9" event={"ID":"e7403d0b-c5cc-4059-94ca-91585102c59e","Type":"ContainerDied","Data":"f2af333cf33d7e97671981016d8a81ca4f598b07c4fdbd430966461e710937b9"} Jul 23 14:14:47.279046 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:47.278979 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9" event={"ID":"e7403d0b-c5cc-4059-94ca-91585102c59e","Type":"ContainerStarted","Data":"d9d65b0d876bee6727da3fd06b7a40b7415b25cfb842d5e5aa360e65fa701c7e"} Jul 23 14:14:50.296176 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:50.296144 2583 generic.go:356] "Generic (PLEG): container finished" podID="e7403d0b-c5cc-4059-94ca-91585102c59e" containerID="e98671703d37197aae4067445f0ff5057d69ab0dedadd758d35d99ee9231f550" exitCode=0 Jul 23 14:14:50.296647 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:50.296223 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9" event={"ID":"e7403d0b-c5cc-4059-94ca-91585102c59e","Type":"ContainerDied","Data":"e98671703d37197aae4067445f0ff5057d69ab0dedadd758d35d99ee9231f550"} Jul 23 14:14:51.302899 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:51.302869 2583 generic.go:356] "Generic (PLEG): container finished" podID="e7403d0b-c5cc-4059-94ca-91585102c59e" containerID="7e659ab19fb6b04d019f435b129fcc81eed7cb8b62753074dc8a18a43c8e07dc" exitCode=0 Jul 23 14:14:51.303313 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:51.302937 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9" event={"ID":"e7403d0b-c5cc-4059-94ca-91585102c59e","Type":"ContainerDied","Data":"7e659ab19fb6b04d019f435b129fcc81eed7cb8b62753074dc8a18a43c8e07dc"} Jul 23 14:14:52.436777 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:52.436746 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9" Jul 23 14:14:52.537433 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:52.537400 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7403d0b-c5cc-4059-94ca-91585102c59e-bundle\") pod \"e7403d0b-c5cc-4059-94ca-91585102c59e\" (UID: \"e7403d0b-c5cc-4059-94ca-91585102c59e\") " Jul 23 14:14:52.537587 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:52.537445 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7403d0b-c5cc-4059-94ca-91585102c59e-util\") pod \"e7403d0b-c5cc-4059-94ca-91585102c59e\" (UID: \"e7403d0b-c5cc-4059-94ca-91585102c59e\") " Jul 23 14:14:52.537587 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:52.537469 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvfnv\" (UniqueName: \"kubernetes.io/projected/e7403d0b-c5cc-4059-94ca-91585102c59e-kube-api-access-dvfnv\") pod \"e7403d0b-c5cc-4059-94ca-91585102c59e\" (UID: \"e7403d0b-c5cc-4059-94ca-91585102c59e\") " Jul 23 14:14:52.537803 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:52.537779 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7403d0b-c5cc-4059-94ca-91585102c59e-bundle" (OuterVolumeSpecName: "bundle") pod "e7403d0b-c5cc-4059-94ca-91585102c59e" (UID: "e7403d0b-c5cc-4059-94ca-91585102c59e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 14:14:52.539582 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:52.539554 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7403d0b-c5cc-4059-94ca-91585102c59e-kube-api-access-dvfnv" (OuterVolumeSpecName: "kube-api-access-dvfnv") pod "e7403d0b-c5cc-4059-94ca-91585102c59e" (UID: "e7403d0b-c5cc-4059-94ca-91585102c59e"). InnerVolumeSpecName "kube-api-access-dvfnv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 14:14:52.542707 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:52.542688 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7403d0b-c5cc-4059-94ca-91585102c59e-util" (OuterVolumeSpecName: "util") pod "e7403d0b-c5cc-4059-94ca-91585102c59e" (UID: "e7403d0b-c5cc-4059-94ca-91585102c59e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 14:14:52.638219 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:52.638127 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvfnv\" (UniqueName: \"kubernetes.io/projected/e7403d0b-c5cc-4059-94ca-91585102c59e-kube-api-access-dvfnv\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:14:52.638219 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:52.638162 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7403d0b-c5cc-4059-94ca-91585102c59e-bundle\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:14:52.638219 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:52.638172 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7403d0b-c5cc-4059-94ca-91585102c59e-util\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:14:53.313266 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:53.313218 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9" Jul 23 14:14:53.313437 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:53.313215 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e2x8k9" event={"ID":"e7403d0b-c5cc-4059-94ca-91585102c59e","Type":"ContainerDied","Data":"d9d65b0d876bee6727da3fd06b7a40b7415b25cfb842d5e5aa360e65fa701c7e"} Jul 23 14:14:53.313437 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:53.313361 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9d65b0d876bee6727da3fd06b7a40b7415b25cfb842d5e5aa360e65fa701c7e" Jul 23 14:14:56.860956 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:56.860918 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:14:56.958764 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:14:56.958730 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:15:04.754906 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:04.754878 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-thrtj_368b9cb3-9200-489d-b70c-832898906791/console-operator/1.log" Jul 23 14:15:04.758045 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:04.758018 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-thrtj_368b9cb3-9200-489d-b70c-832898906791/console-operator/1.log" Jul 23 14:15:04.766895 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:04.766874 2583 kubelet.go:1648] "Image garbage collection succeeded" Jul 23 14:15:06.747520 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:06.747488 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:15:08.270067 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:08.270036 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:15:16.626833 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:16.626800 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:15:16.726955 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:16.726914 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:15:16.992102 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:16.992014 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-6fcf7dc845-brgb5"] Jul 23 14:15:16.992442 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:16.992424 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7403d0b-c5cc-4059-94ca-91585102c59e" containerName="pull" Jul 23 14:15:16.992541 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:16.992463 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7403d0b-c5cc-4059-94ca-91585102c59e" containerName="pull" Jul 23 14:15:16.992541 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:16.992494 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7403d0b-c5cc-4059-94ca-91585102c59e" containerName="extract" Jul 23 14:15:16.992541 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:16.992503 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7403d0b-c5cc-4059-94ca-91585102c59e" containerName="extract" Jul 23 14:15:16.992541 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:16.992526 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7403d0b-c5cc-4059-94ca-91585102c59e" containerName="util" Jul 23 14:15:16.992541 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:16.992534 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7403d0b-c5cc-4059-94ca-91585102c59e" containerName="util" Jul 23 14:15:16.992775 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:16.992642 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7403d0b-c5cc-4059-94ca-91585102c59e" containerName="extract" Jul 23 14:15:16.995489 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:16.995469 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-6fcf7dc845-brgb5" Jul 23 14:15:16.998582 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:16.998563 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jul 23 14:15:16.999579 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:16.999539 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jul 23 14:15:16.999579 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:16.999550 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\"" Jul 23 14:15:16.999579 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:16.999571 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-2qt8b\"" Jul 23 14:15:16.999801 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:16.999592 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\"" Jul 23 14:15:16.999801 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:16.999622 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\"" Jul 23 14:15:17.004724 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:17.004702 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-6fcf7dc845-brgb5"] Jul 23 14:15:17.043455 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:17.043421 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1028a298-45fe-46ac-b395-f7ea9eedf253-cert\") pod \"jobset-controller-manager-6fcf7dc845-brgb5\" (UID: \"1028a298-45fe-46ac-b395-f7ea9eedf253\") " pod="openshift-jobset-operator/jobset-controller-manager-6fcf7dc845-brgb5" Jul 23 14:15:17.043606 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:17.043464 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1028a298-45fe-46ac-b395-f7ea9eedf253-metrics-certs\") pod \"jobset-controller-manager-6fcf7dc845-brgb5\" (UID: \"1028a298-45fe-46ac-b395-f7ea9eedf253\") " pod="openshift-jobset-operator/jobset-controller-manager-6fcf7dc845-brgb5" Jul 23 14:15:17.043606 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:17.043534 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1028a298-45fe-46ac-b395-f7ea9eedf253-manager-config\") pod \"jobset-controller-manager-6fcf7dc845-brgb5\" (UID: \"1028a298-45fe-46ac-b395-f7ea9eedf253\") " pod="openshift-jobset-operator/jobset-controller-manager-6fcf7dc845-brgb5" Jul 23 14:15:17.043606 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:17.043560 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rm7z\" (UniqueName: \"kubernetes.io/projected/1028a298-45fe-46ac-b395-f7ea9eedf253-kube-api-access-4rm7z\") pod \"jobset-controller-manager-6fcf7dc845-brgb5\" (UID: \"1028a298-45fe-46ac-b395-f7ea9eedf253\") " pod="openshift-jobset-operator/jobset-controller-manager-6fcf7dc845-brgb5" Jul 23 14:15:17.144790 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:17.144753 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1028a298-45fe-46ac-b395-f7ea9eedf253-cert\") pod \"jobset-controller-manager-6fcf7dc845-brgb5\" (UID: \"1028a298-45fe-46ac-b395-f7ea9eedf253\") " pod="openshift-jobset-operator/jobset-controller-manager-6fcf7dc845-brgb5" Jul 23 14:15:17.144790 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:17.144796 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1028a298-45fe-46ac-b395-f7ea9eedf253-metrics-certs\") pod \"jobset-controller-manager-6fcf7dc845-brgb5\" (UID: \"1028a298-45fe-46ac-b395-f7ea9eedf253\") " pod="openshift-jobset-operator/jobset-controller-manager-6fcf7dc845-brgb5" Jul 23 14:15:17.144997 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:17.144824 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1028a298-45fe-46ac-b395-f7ea9eedf253-manager-config\") pod \"jobset-controller-manager-6fcf7dc845-brgb5\" (UID: \"1028a298-45fe-46ac-b395-f7ea9eedf253\") " pod="openshift-jobset-operator/jobset-controller-manager-6fcf7dc845-brgb5" Jul 23 14:15:17.144997 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:17.144847 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rm7z\" (UniqueName: \"kubernetes.io/projected/1028a298-45fe-46ac-b395-f7ea9eedf253-kube-api-access-4rm7z\") pod \"jobset-controller-manager-6fcf7dc845-brgb5\" (UID: \"1028a298-45fe-46ac-b395-f7ea9eedf253\") " pod="openshift-jobset-operator/jobset-controller-manager-6fcf7dc845-brgb5" Jul 23 14:15:17.145523 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:17.145491 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1028a298-45fe-46ac-b395-f7ea9eedf253-manager-config\") pod \"jobset-controller-manager-6fcf7dc845-brgb5\" (UID: \"1028a298-45fe-46ac-b395-f7ea9eedf253\") " pod="openshift-jobset-operator/jobset-controller-manager-6fcf7dc845-brgb5" Jul 23 14:15:17.147337 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:17.147307 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1028a298-45fe-46ac-b395-f7ea9eedf253-metrics-certs\") pod \"jobset-controller-manager-6fcf7dc845-brgb5\" (UID: \"1028a298-45fe-46ac-b395-f7ea9eedf253\") " pod="openshift-jobset-operator/jobset-controller-manager-6fcf7dc845-brgb5" Jul 23 14:15:17.147445 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:17.147411 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1028a298-45fe-46ac-b395-f7ea9eedf253-cert\") pod \"jobset-controller-manager-6fcf7dc845-brgb5\" (UID: \"1028a298-45fe-46ac-b395-f7ea9eedf253\") " pod="openshift-jobset-operator/jobset-controller-manager-6fcf7dc845-brgb5" Jul 23 14:15:17.152586 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:17.152566 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rm7z\" (UniqueName: \"kubernetes.io/projected/1028a298-45fe-46ac-b395-f7ea9eedf253-kube-api-access-4rm7z\") pod \"jobset-controller-manager-6fcf7dc845-brgb5\" (UID: \"1028a298-45fe-46ac-b395-f7ea9eedf253\") " pod="openshift-jobset-operator/jobset-controller-manager-6fcf7dc845-brgb5" Jul 23 14:15:17.305515 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:17.305456 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-6fcf7dc845-brgb5" Jul 23 14:15:17.451975 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:17.451952 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-6fcf7dc845-brgb5"] Jul 23 14:15:17.453982 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:15:17.453955 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1028a298_45fe_46ac_b395_f7ea9eedf253.slice/crio-e3d7337d12909cc74f37cc841d75a5e57ab9da6d0c262f8de666303b74b5fd8a WatchSource:0}: Error finding container e3d7337d12909cc74f37cc841d75a5e57ab9da6d0c262f8de666303b74b5fd8a: Status 404 returned error can't find the container with id e3d7337d12909cc74f37cc841d75a5e57ab9da6d0c262f8de666303b74b5fd8a Jul 23 14:15:17.455885 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:17.455868 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 14:15:18.434132 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:18.434089 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-6fcf7dc845-brgb5" event={"ID":"1028a298-45fe-46ac-b395-f7ea9eedf253","Type":"ContainerStarted","Data":"e3d7337d12909cc74f37cc841d75a5e57ab9da6d0c262f8de666303b74b5fd8a"} Jul 23 14:15:20.445152 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:20.445117 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-6fcf7dc845-brgb5" event={"ID":"1028a298-45fe-46ac-b395-f7ea9eedf253","Type":"ContainerStarted","Data":"13d895c3ac4c660b064da5580d6d033e744f76eb993b0710be4c0623c4237ec2"} Jul 23 14:15:20.445618 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:20.445219 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-6fcf7dc845-brgb5" Jul 23 14:15:20.461750 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:20.461681 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-6fcf7dc845-brgb5" podStartSLOduration=1.648299441 podStartE2EDuration="4.461664659s" totalImagesPullingTime="2.813365218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:15:20.460911535 +0000 UTC m=+316.020739881" watchObservedRunningTime="2026-07-23 14:15:20.461664659 +0000 UTC m=+316.021493001" Jul 23 14:15:25.044553 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:25.044512 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:15:31.454831 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:15:31.454801 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-6fcf7dc845-brgb5" Jul 23 14:16:11.172693 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:16:11.172609 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:16:11.262899 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:16:11.262862 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:16:11.336147 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:16:11.336112 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:16:20.099120 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:16:20.099084 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:16:59.828455 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:16:59.828413 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:16:59.920350 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:16:59.920316 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:17:02.186535 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:02.186501 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:17:02.518858 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:02.518827 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:17:06.259806 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:06.259772 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:17:14.484282 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:14.484217 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:17:14.562181 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:14.562149 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:17:25.249038 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:25.249005 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57b84745b8-8q8w6"] Jul 23 14:17:25.362706 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:25.362677 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:17:26.233460 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:26.233429 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:17:26.292259 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:26.292199 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:17:26.860105 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:26.860020 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:17:50.272454 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.272387 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57b84745b8-8q8w6" podUID="09e078af-22b8-4e02-a5b1-4917fd9a37e9" containerName="console" containerID="cri-o://fe83b2c192480055560a17c7db6e9646dab5d7c92d994a8499dbb1d67af118f6" gracePeriod=15 Jul 23 14:17:50.523784 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.523725 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:17:50.615654 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.615616 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-oauth-serving-cert\") pod \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " Jul 23 14:17:50.615654 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.615657 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxxqt\" (UniqueName: \"kubernetes.io/projected/09e078af-22b8-4e02-a5b1-4917fd9a37e9-kube-api-access-hxxqt\") pod \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " Jul 23 14:17:50.615906 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.615848 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-trusted-ca-bundle\") pod \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " Jul 23 14:17:50.615966 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.615914 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-service-ca\") pod \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " Jul 23 14:17:50.615966 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.615954 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09e078af-22b8-4e02-a5b1-4917fd9a37e9-console-oauth-config\") pod \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " Jul 23 14:17:50.616064 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.615993 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-console-config\") pod \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " Jul 23 14:17:50.616064 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.616020 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "09e078af-22b8-4e02-a5b1-4917fd9a37e9" (UID: "09e078af-22b8-4e02-a5b1-4917fd9a37e9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 14:17:50.616064 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.616032 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09e078af-22b8-4e02-a5b1-4917fd9a37e9-console-serving-cert\") pod \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\" (UID: \"09e078af-22b8-4e02-a5b1-4917fd9a37e9\") " Jul 23 14:17:50.616353 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.616229 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "09e078af-22b8-4e02-a5b1-4917fd9a37e9" (UID: "09e078af-22b8-4e02-a5b1-4917fd9a37e9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 14:17:50.616353 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.616328 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-service-ca" (OuterVolumeSpecName: "service-ca") pod "09e078af-22b8-4e02-a5b1-4917fd9a37e9" (UID: "09e078af-22b8-4e02-a5b1-4917fd9a37e9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 14:17:50.616541 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.616400 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-console-config" (OuterVolumeSpecName: "console-config") pod "09e078af-22b8-4e02-a5b1-4917fd9a37e9" (UID: "09e078af-22b8-4e02-a5b1-4917fd9a37e9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 14:17:50.616541 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.616506 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-service-ca\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:17:50.616541 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.616527 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-console-config\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:17:50.616541 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.616541 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-oauth-serving-cert\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:17:50.616684 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.616555 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09e078af-22b8-4e02-a5b1-4917fd9a37e9-trusted-ca-bundle\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:17:50.617926 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.617897 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09e078af-22b8-4e02-a5b1-4917fd9a37e9-kube-api-access-hxxqt" (OuterVolumeSpecName: "kube-api-access-hxxqt") pod "09e078af-22b8-4e02-a5b1-4917fd9a37e9" (UID: "09e078af-22b8-4e02-a5b1-4917fd9a37e9"). InnerVolumeSpecName "kube-api-access-hxxqt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 14:17:50.618065 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.618045 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09e078af-22b8-4e02-a5b1-4917fd9a37e9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "09e078af-22b8-4e02-a5b1-4917fd9a37e9" (UID: "09e078af-22b8-4e02-a5b1-4917fd9a37e9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 14:17:50.618110 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.618088 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09e078af-22b8-4e02-a5b1-4917fd9a37e9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "09e078af-22b8-4e02-a5b1-4917fd9a37e9" (UID: "09e078af-22b8-4e02-a5b1-4917fd9a37e9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 14:17:50.717029 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.716981 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09e078af-22b8-4e02-a5b1-4917fd9a37e9-console-serving-cert\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:17:50.717029 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.717026 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxxqt\" (UniqueName: \"kubernetes.io/projected/09e078af-22b8-4e02-a5b1-4917fd9a37e9-kube-api-access-hxxqt\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:17:50.717029 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:50.717040 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09e078af-22b8-4e02-a5b1-4917fd9a37e9-console-oauth-config\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\"" Jul 23 14:17:51.132469 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:51.132438 2583 generic.go:356] "Generic (PLEG): container finished" podID="09e078af-22b8-4e02-a5b1-4917fd9a37e9" containerID="fe83b2c192480055560a17c7db6e9646dab5d7c92d994a8499dbb1d67af118f6" exitCode=0 Jul 23 14:17:51.132612 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:51.132482 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b84745b8-8q8w6" Jul 23 14:17:51.132612 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:51.132492 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b84745b8-8q8w6" event={"ID":"09e078af-22b8-4e02-a5b1-4917fd9a37e9","Type":"ContainerDied","Data":"fe83b2c192480055560a17c7db6e9646dab5d7c92d994a8499dbb1d67af118f6"} Jul 23 14:17:51.132612 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:51.132533 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b84745b8-8q8w6" event={"ID":"09e078af-22b8-4e02-a5b1-4917fd9a37e9","Type":"ContainerDied","Data":"59edef67c7aebd5cbeae79e5fda10b3c835e21e9a7ae27096b2252c0fc8003e7"} Jul 23 14:17:51.132612 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:51.132554 2583 scope.go:117] "RemoveContainer" containerID="fe83b2c192480055560a17c7db6e9646dab5d7c92d994a8499dbb1d67af118f6" Jul 23 14:17:51.141075 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:51.141058 2583 scope.go:117] "RemoveContainer" containerID="fe83b2c192480055560a17c7db6e9646dab5d7c92d994a8499dbb1d67af118f6" Jul 23 14:17:51.141410 ip-10-0-138-123 kubenswrapper[2583]: E0723 14:17:51.141388 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe83b2c192480055560a17c7db6e9646dab5d7c92d994a8499dbb1d67af118f6\": container with ID starting with fe83b2c192480055560a17c7db6e9646dab5d7c92d994a8499dbb1d67af118f6 not found: ID does not exist" containerID="fe83b2c192480055560a17c7db6e9646dab5d7c92d994a8499dbb1d67af118f6" Jul 23 14:17:51.141465 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:51.141418 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe83b2c192480055560a17c7db6e9646dab5d7c92d994a8499dbb1d67af118f6"} err="failed to get container status \"fe83b2c192480055560a17c7db6e9646dab5d7c92d994a8499dbb1d67af118f6\": rpc error: code = NotFound desc = could not find container \"fe83b2c192480055560a17c7db6e9646dab5d7c92d994a8499dbb1d67af118f6\": container with ID starting with fe83b2c192480055560a17c7db6e9646dab5d7c92d994a8499dbb1d67af118f6 not found: ID does not exist" Jul 23 14:17:51.158153 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:51.158103 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57b84745b8-8q8w6"] Jul 23 14:17:51.159622 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:51.159604 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57b84745b8-8q8w6"] Jul 23 14:17:52.884126 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:17:52.884091 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09e078af-22b8-4e02-a5b1-4917fd9a37e9" path="/var/lib/kubelet/pods/09e078af-22b8-4e02-a5b1-4917fd9a37e9/volumes" Jul 23 14:18:36.247978 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:18:36.247945 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:18:36.351124 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:18:36.351094 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:18:38.220074 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:18:38.220037 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:18:38.322887 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:18:38.322853 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:18:39.471864 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:18:39.471831 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:18:39.573700 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:18:39.573664 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:18:57.054422 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:18:57.054328 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:19:33.092483 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:33.092446 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:19:33.231227 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:33.231178 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:19:33.310060 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:33.310022 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:19:36.142786 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:36.142760 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9rmzs_c33444eb-d4db-46c0-a1fe-23a9191cd4f5/global-pull-secret-syncer/0.log" Jul 23 14:19:36.287749 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:36.287715 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" Jul 23 14:19:36.373023 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:36.372991 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-123.ec2.internal_02af97281464b2933292233b4d9f32de/haproxy/0.log" Jul 23 14:19:38.511675 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:38.511572 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:19:38.610467 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:38.610435 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4gxs4_e648ed66-32b8-4ff9-8b04-fb537b96da10/konnectivity-agent/0.log" limit=1024 Jul 23 14:19:40.484620 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:40.484547 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-2cxf9_b7938e65-26db-4bf0-9cdd-eb340fba0ba7/cluster-monitoring-operator/0.log" Jul 23 14:19:40.597155 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:40.597125 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-77d784bc-52b88_48998f3b-1ecc-418c-a8a3-646d73728030/metrics-server/0.log" Jul 23 14:19:40.741543 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:40.741456 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mg9jf_5d3a689b-dfb6-48c0-986d-9cc1b57cccbc/node-exporter/0.log" Jul 23 14:19:40.762113 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:40.762085 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mg9jf_5d3a689b-dfb6-48c0-986d-9cc1b57cccbc/kube-rbac-proxy/0.log" Jul 23 14:19:40.781453 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:40.781429 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mg9jf_5d3a689b-dfb6-48c0-986d-9cc1b57cccbc/init-textfile/0.log" Jul 23 14:19:41.260394 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:41.260360 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-xqkxj_46868454-2467-4d82-8783-0d86543beddf/prometheus-operator-admission-webhook/0.log" Jul 23 14:19:41.292296 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:41.292264 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-685765f8bd-ns8dj_6aacc8e2-5a64-413d-aeb7-1d50688afa06/telemeter-client/0.log" Jul 23 14:19:41.316015 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:41.315985 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-685765f8bd-ns8dj_6aacc8e2-5a64-413d-aeb7-1d50688afa06/reload/0.log" Jul 23 14:19:41.338428 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:41.338405 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-685765f8bd-ns8dj_6aacc8e2-5a64-413d-aeb7-1d50688afa06/kube-rbac-proxy/0.log" Jul 23 14:19:41.366471 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:41.366444 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-fdd76dc7c-ktp2r_a003b114-b4a3-491f-ae08-05db6c12f6ee/thanos-query/0.log" Jul 23 14:19:41.388348 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:41.388322 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-fdd76dc7c-ktp2r_a003b114-b4a3-491f-ae08-05db6c12f6ee/kube-rbac-proxy-web/0.log" Jul 23 14:19:41.411791 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:41.411761 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-fdd76dc7c-ktp2r_a003b114-b4a3-491f-ae08-05db6c12f6ee/kube-rbac-proxy/0.log" Jul 23 14:19:41.433180 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:41.433153 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-fdd76dc7c-ktp2r_a003b114-b4a3-491f-ae08-05db6c12f6ee/prom-label-proxy/0.log" Jul 23 14:19:41.461971 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:41.461939 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-fdd76dc7c-ktp2r_a003b114-b4a3-491f-ae08-05db6c12f6ee/kube-rbac-proxy-rules/0.log" Jul 23 14:19:41.485374 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:41.485345 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-fdd76dc7c-ktp2r_a003b114-b4a3-491f-ae08-05db6c12f6ee/kube-rbac-proxy-metrics/0.log" Jul 23 14:19:42.773120 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:42.773091 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-dtqtx_a4ff440c-7a41-4adf-956d-8f2d35b0889f/networking-console-plugin/0.log" Jul 23 14:19:43.216016 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:43.215938 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-thrtj_368b9cb3-9200-489d-b70c-832898906791/console-operator/1.log" Jul 23 14:19:43.220363 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:43.220320 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-thrtj_368b9cb3-9200-489d-b70c-832898906791/console-operator/2.log" Jul 23 14:19:43.863515 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:43.863476 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx"] Jul 23 14:19:43.863893 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:43.863802 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09e078af-22b8-4e02-a5b1-4917fd9a37e9" containerName="console" Jul 23 14:19:43.863893 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:43.863812 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="09e078af-22b8-4e02-a5b1-4917fd9a37e9" containerName="console" Jul 23 14:19:43.863893 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:43.863875 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="09e078af-22b8-4e02-a5b1-4917fd9a37e9" containerName="console" Jul 23 14:19:43.866902 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:43.866881 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx" Jul 23 14:19:43.870150 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:43.870120 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nvwjt\"/\"default-dockercfg-nr2bx\"" Jul 23 14:19:43.870955 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:43.870939 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nvwjt\"/\"kube-root-ca.crt\"" Jul 23 14:19:43.874355 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:43.874335 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nvwjt\"/\"openshift-service-ca.crt\"" Jul 23 14:19:43.885297 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:43.885272 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx"] Jul 23 14:19:43.956728 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:43.956693 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6eed480-6574-460e-8a0d-ffbd27a9db6b-lib-modules\") pod \"perf-node-gather-daemonset-55vxx\" (UID: \"f6eed480-6574-460e-8a0d-ffbd27a9db6b\") " pod="openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx" Jul 23 14:19:43.956912 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:43.956750 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6eed480-6574-460e-8a0d-ffbd27a9db6b-sys\") pod \"perf-node-gather-daemonset-55vxx\" (UID: \"f6eed480-6574-460e-8a0d-ffbd27a9db6b\") " pod="openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx" Jul 23 14:19:43.956912 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:43.956776 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk49t\" (UniqueName: \"kubernetes.io/projected/f6eed480-6574-460e-8a0d-ffbd27a9db6b-kube-api-access-tk49t\") pod \"perf-node-gather-daemonset-55vxx\" (UID: \"f6eed480-6574-460e-8a0d-ffbd27a9db6b\") " pod="openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx" Jul 23 14:19:43.956912 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:43.956823 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6eed480-6574-460e-8a0d-ffbd27a9db6b-proc\") pod \"perf-node-gather-daemonset-55vxx\" (UID: \"f6eed480-6574-460e-8a0d-ffbd27a9db6b\") " pod="openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx" Jul 23 14:19:43.956912 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:43.956885 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6eed480-6574-460e-8a0d-ffbd27a9db6b-podres\") pod \"perf-node-gather-daemonset-55vxx\" (UID: \"f6eed480-6574-460e-8a0d-ffbd27a9db6b\") " pod="openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx" Jul 23 14:19:44.057794 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:44.057757 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6eed480-6574-460e-8a0d-ffbd27a9db6b-lib-modules\") pod \"perf-node-gather-daemonset-55vxx\" (UID: \"f6eed480-6574-460e-8a0d-ffbd27a9db6b\") " pod="openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx" Jul 23 14:19:44.057968 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:44.057810 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6eed480-6574-460e-8a0d-ffbd27a9db6b-sys\") pod \"perf-node-gather-daemonset-55vxx\" (UID: \"f6eed480-6574-460e-8a0d-ffbd27a9db6b\") " pod="openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx" Jul 23 14:19:44.057968 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:44.057839 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk49t\" (UniqueName: \"kubernetes.io/projected/f6eed480-6574-460e-8a0d-ffbd27a9db6b-kube-api-access-tk49t\") pod \"perf-node-gather-daemonset-55vxx\" (UID: \"f6eed480-6574-460e-8a0d-ffbd27a9db6b\") " pod="openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx" Jul 23 14:19:44.057968 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:44.057875 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6eed480-6574-460e-8a0d-ffbd27a9db6b-proc\") pod \"perf-node-gather-daemonset-55vxx\" (UID: \"f6eed480-6574-460e-8a0d-ffbd27a9db6b\") " pod="openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx" Jul 23 14:19:44.057968 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:44.057893 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6eed480-6574-460e-8a0d-ffbd27a9db6b-podres\") pod \"perf-node-gather-daemonset-55vxx\" (UID: \"f6eed480-6574-460e-8a0d-ffbd27a9db6b\") " pod="openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx" Jul 23 14:19:44.057968 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:44.057952 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6eed480-6574-460e-8a0d-ffbd27a9db6b-lib-modules\") pod \"perf-node-gather-daemonset-55vxx\" (UID: \"f6eed480-6574-460e-8a0d-ffbd27a9db6b\") " pod="openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx" Jul 23 14:19:44.058157 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:44.057971 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6eed480-6574-460e-8a0d-ffbd27a9db6b-proc\") pod \"perf-node-gather-daemonset-55vxx\" (UID: \"f6eed480-6574-460e-8a0d-ffbd27a9db6b\") " pod="openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx" Jul 23 14:19:44.058157 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:44.058016 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6eed480-6574-460e-8a0d-ffbd27a9db6b-sys\") pod \"perf-node-gather-daemonset-55vxx\" (UID: \"f6eed480-6574-460e-8a0d-ffbd27a9db6b\") " pod="openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx" Jul 23 14:19:44.058157 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:44.058033 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6eed480-6574-460e-8a0d-ffbd27a9db6b-podres\") pod \"perf-node-gather-daemonset-55vxx\" (UID: \"f6eed480-6574-460e-8a0d-ffbd27a9db6b\") " pod="openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx" Jul 23 14:19:44.067164 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:44.067136 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk49t\" (UniqueName: \"kubernetes.io/projected/f6eed480-6574-460e-8a0d-ffbd27a9db6b-kube-api-access-tk49t\") pod \"perf-node-gather-daemonset-55vxx\" (UID: \"f6eed480-6574-460e-8a0d-ffbd27a9db6b\") " pod="openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx" Jul 23 14:19:44.176718 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:44.176623 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx" Jul 23 14:19:44.281770 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:44.281738 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-ffmql_7605d097-5e0f-4270-a9f9-50e11e897253/volume-data-source-validator/0.log" Jul 23 14:19:44.325214 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:44.325166 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx"] Jul 23 14:19:44.328259 ip-10-0-138-123 kubenswrapper[2583]: W0723 14:19:44.328200 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf6eed480_6574_460e_8a0d_ffbd27a9db6b.slice/crio-89b884ac031f9ba9be969fd74c655ba9dd944c742fb122f7021506d51e26f541 WatchSource:0}: Error finding container 89b884ac031f9ba9be969fd74c655ba9dd944c742fb122f7021506d51e26f541: Status 404 returned error can't find the container with id 89b884ac031f9ba9be969fd74c655ba9dd944c742fb122f7021506d51e26f541 Jul 23 14:19:44.658956 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:44.658916 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx" event={"ID":"f6eed480-6574-460e-8a0d-ffbd27a9db6b","Type":"ContainerStarted","Data":"d22df63a34e15d58492e8e56d441dd81e8d125e279194626aa1d5392510cd574"} Jul 23 14:19:44.659124 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:44.658968 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx" event={"ID":"f6eed480-6574-460e-8a0d-ffbd27a9db6b","Type":"ContainerStarted","Data":"89b884ac031f9ba9be969fd74c655ba9dd944c742fb122f7021506d51e26f541"} Jul 23 14:19:44.659124 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:44.659021 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx" Jul 23 14:19:44.676650 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:44.676590 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx" podStartSLOduration=1.676572695 podStartE2EDuration="1.676572695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:19:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:19:44.674676104 +0000 UTC m=+580.234504449" watchObservedRunningTime="2026-07-23 14:19:44.676572695 +0000 UTC m=+580.236401037" Jul 23 14:19:45.058117 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:45.058091 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6c44f_d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b/dns/0.log" Jul 23 14:19:45.078659 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:45.078631 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6c44f_d5cdfc7d-95d8-4cae-bdb5-3ac491aa387b/kube-rbac-proxy/0.log" Jul 23 14:19:45.193905 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:45.193876 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f97l5_f0d66bd7-7a9d-48d2-904b-621a1eacc15e/dns-node-resolver/0.log" Jul 23 14:19:45.649247 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:45.649218 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nplv4_4d86c011-dcb3-4103-badd-9557cc53906a/node-ca/0.log" Jul 23 14:19:46.362036 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:46.362006 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-695b7bcf8d-qtpwr_e9e8f751-c4aa-4c3b-a110-de695a817c76/router/0.log" Jul 23 14:19:46.703976 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:46.703900 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5bqgn_0d1e7c79-7575-481a-af5b-b3371a5e317d/serve-healthcheck-canary/0.log" Jul 23 14:19:47.056928 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:47.056897 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-kf559_78668789-e865-4b71-a251-7a81549d1442/insights-operator/1.log" Jul 23 14:19:47.057208 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:47.057190 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-kf559_78668789-e865-4b71-a251-7a81549d1442/insights-operator/0.log" Jul 23 14:19:47.113592 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:47.113558 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4xlxs_ed4d4a24-2777-4c57-918a-285294003836/kube-rbac-proxy/0.log" Jul 23 14:19:47.132927 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:47.132900 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4xlxs_ed4d4a24-2777-4c57-918a-285294003836/exporter/0.log" Jul 23 14:19:47.154753 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:47.154724 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4xlxs_ed4d4a24-2777-4c57-918a-285294003836/extractor/0.log" Jul 23 14:19:48.914709 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:48.914668 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-6fcf7dc845-brgb5_1028a298-45fe-46ac-b395-f7ea9eedf253/manager/0.log" Jul 23 14:19:50.673079 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:50.673048 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nvwjt/perf-node-gather-daemonset-55vxx" Jul 23 14:19:52.396366 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:52.396328 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-n7bbn_6fca46de-acd7-4911-8fc7-3dcefade899e/kube-storage-version-migrator-operator/1.log" Jul 23 14:19:52.397563 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:52.397540 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-n7bbn_6fca46de-acd7-4911-8fc7-3dcefade899e/kube-storage-version-migrator-operator/0.log" Jul 23 14:19:53.580792 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:53.580761 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlpcq_6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4/kube-multus-additional-cni-plugins/0.log" Jul 23 14:19:53.599774 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:53.599745 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlpcq_6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4/egress-router-binary-copy/0.log" Jul 23 14:19:53.618947 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:53.618914 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlpcq_6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4/cni-plugins/0.log" Jul 23 14:19:53.637296 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:53.637269 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlpcq_6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4/bond-cni-plugin/0.log" Jul 23 14:19:53.658375 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:53.658347 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlpcq_6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4/routeoverride-cni/0.log" Jul 23 14:19:53.678957 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:53.678930 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlpcq_6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4/whereabouts-cni-bincopy/0.log" Jul 23 14:19:53.699193 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:53.699160 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hlpcq_6e6cdb35-6f1c-4d3b-b81b-fd615bafa8e4/whereabouts-cni/0.log" Jul 23 14:19:53.870953 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:53.870923 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-g4sv7_13c16f90-fca6-420e-a294-6c75ba13ffa9/kube-multus/0.log" Jul 23 14:19:53.999716 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:53.999686 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hhx5z_d96c127f-a6dd-40c9-8dab-1a64c2af3f75/network-metrics-daemon/0.log" Jul 23 14:19:54.018575 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:54.018547 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hhx5z_d96c127f-a6dd-40c9-8dab-1a64c2af3f75/kube-rbac-proxy/0.log" Jul 23 14:19:54.769937 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:54.769907 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cgj4x_973616e7-c535-4446-ab85-b5c397fa3601/ovn-controller/0.log" Jul 23 14:19:54.787464 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:54.787429 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cgj4x_973616e7-c535-4446-ab85-b5c397fa3601/ovn-acl-logging/0.log" Jul 23 14:19:54.813696 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:54.813665 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cgj4x_973616e7-c535-4446-ab85-b5c397fa3601/kube-rbac-proxy-node/0.log" Jul 23 14:19:54.835680 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:54.835653 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cgj4x_973616e7-c535-4446-ab85-b5c397fa3601/kube-rbac-proxy-ovn-metrics/0.log" Jul 23 14:19:54.853079 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:54.853055 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cgj4x_973616e7-c535-4446-ab85-b5c397fa3601/northd/0.log" Jul 23 14:19:54.871638 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:54.871605 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cgj4x_973616e7-c535-4446-ab85-b5c397fa3601/nbdb/0.log" Jul 23 14:19:54.891498 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:54.891472 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cgj4x_973616e7-c535-4446-ab85-b5c397fa3601/sbdb/0.log" Jul 23 14:19:54.928157 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:54.928126 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cgj4x_973616e7-c535-4446-ab85-b5c397fa3601/ovnkube-controller/0.log" Jul 23 14:19:56.296083 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:56.296052 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7bc5b6bf85-fjlpb_9922460a-be5a-46c1-a7dd-0c97f00db59d/check-endpoints/0.log" Jul 23 14:19:56.347591 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:56.347562 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-r8nkd_45236e03-e24a-4cc3-a8a3-814bc70d6b01/network-check-target-container/0.log" Jul 23 14:19:57.237128 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:57.237098 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-4wft5_22c3acf1-51b9-4a51-87f0-0e3266a2bf21/iptables-alerter/0.log" Jul 23 14:19:57.935701 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:57.935668 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-s9k8r_2b5cc372-ff28-4b28-bd97-119a983da3da/tuned/0.log" Jul 23 14:19:59.554627 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:59.554594 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-79b7c55f87-l4sls_b0bbf318-4828-4843-867e-438dbf40fae0/cluster-samples-operator/0.log" Jul 23 14:19:59.569987 ip-10-0-138-123 kubenswrapper[2583]: I0723 14:19:59.569959 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-79b7c55f87-l4sls_b0bbf318-4828-4843-867e-438dbf40fae0/cluster-samples-operator-watch/0.log"