Jul 28 00:01:13.529293 ip-10-0-130-253 systemd[1]: Starting Kubernetes Kubelet... Jul 28 00:01:13.978075 ip-10-0-130-253 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 00:01:13.978075 ip-10-0-130-253 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 00:01:13.978075 ip-10-0-130-253 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 00:01:13.978075 ip-10-0-130-253 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 00:01:13.978075 ip-10-0-130-253 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 00:01:13.979464 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.979366 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 00:01:13.984300 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984282 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:01:13.984300 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984299 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:01:13.984367 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984303 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:01:13.984367 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984307 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:01:13.984367 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984310 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:01:13.984367 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984313 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:01:13.984367 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984316 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:01:13.984367 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984320 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:01:13.984367 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984323 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:01:13.984367 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984326 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:01:13.984367 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984328 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:01:13.984367 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984331 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:01:13.984367 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984338 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:01:13.984367 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984340 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:01:13.984367 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984343 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:01:13.984367 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984346 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:01:13.984367 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984349 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:01:13.984367 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984352 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:01:13.984367 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984356 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:01:13.984367 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984360 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:01:13.984367 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984363 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:01:13.984367 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984365 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:01:13.984846 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984368 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:01:13.984846 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984371 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:01:13.984846 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984374 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:01:13.984846 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984377 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:01:13.984846 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984380 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:01:13.984846 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984383 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:01:13.984846 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984386 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:01:13.984846 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984390 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:01:13.984846 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984394 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:01:13.984846 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984397 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:01:13.984846 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984401 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:01:13.984846 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984403 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:01:13.984846 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984406 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:01:13.984846 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984410 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:01:13.984846 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984412 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:01:13.984846 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984415 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:01:13.984846 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984419 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:01:13.984846 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984422 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:01:13.984846 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984424 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:01:13.985350 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984427 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:01:13.985350 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984429 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:01:13.985350 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984432 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:01:13.985350 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984442 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:01:13.985350 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984444 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:01:13.985350 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984447 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:01:13.985350 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984449 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:01:13.985350 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984452 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:01:13.985350 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984454 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:01:13.985350 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984457 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:01:13.985350 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984459 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:01:13.985350 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984461 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:01:13.985350 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984464 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:01:13.985350 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984467 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:01:13.985350 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984470 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:01:13.985350 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984473 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:01:13.985350 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984476 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:01:13.985350 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984479 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:01:13.985350 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984482 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:01:13.985350 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984484 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:01:13.985836 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984487 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:01:13.985836 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984489 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:01:13.985836 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984492 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:01:13.985836 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984495 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:01:13.985836 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984497 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:01:13.985836 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984501 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:01:13.985836 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984503 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:01:13.985836 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984505 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:01:13.985836 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984508 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:01:13.985836 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984511 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:01:13.985836 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984519 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:01:13.985836 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984521 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:01:13.985836 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984524 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:01:13.985836 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984526 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:01:13.985836 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984530 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:01:13.985836 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984533 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:01:13.985836 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984536 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:01:13.985836 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984538 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:01:13.985836 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984541 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:01:13.986306 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984544 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:01:13.986306 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984546 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:01:13.986306 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984549 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:01:13.986306 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984552 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:01:13.986306 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984555 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:01:13.986306 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984558 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:01:13.986306 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984560 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:01:13.986306 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984563 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:01:13.986306 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984566 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:01:13.986306 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984568 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:01:13.986306 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984571 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:01:13.986306 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984574 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:01:13.986306 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984576 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:01:13.986306 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984579 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:01:13.986306 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984581 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:01:13.986306 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984584 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:01:13.986306 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984587 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:01:13.986306 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984589 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:01:13.986306 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.984592 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:01:13.986763 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985351 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:01:13.986763 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985358 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:01:13.986763 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985361 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:01:13.986763 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985365 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:01:13.986763 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985368 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:01:13.986763 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985372 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:01:13.986763 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985375 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:01:13.986763 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985378 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:01:13.986763 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985382 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:01:13.986763 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985387 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:01:13.986763 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985390 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:01:13.986763 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985393 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:01:13.986763 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985396 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:01:13.986763 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985398 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:01:13.986763 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985401 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:01:13.986763 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985403 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:01:13.986763 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985406 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:01:13.986763 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985409 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:01:13.986763 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985412 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:01:13.987255 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985414 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:01:13.987255 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985417 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:01:13.987255 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985420 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:01:13.987255 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985423 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:01:13.987255 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985426 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:01:13.987255 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985428 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:01:13.987255 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985431 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:01:13.987255 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985434 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:01:13.987255 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985436 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:01:13.987255 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985438 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:01:13.987255 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985441 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:01:13.987255 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985444 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:01:13.987255 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985446 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:01:13.987255 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985448 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:01:13.987255 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985451 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:01:13.987255 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985454 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:01:13.987255 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985456 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:01:13.987255 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985460 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:01:13.987255 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985463 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:01:13.987255 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985466 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:01:13.987733 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985468 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:01:13.987733 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985472 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:01:13.987733 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985474 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:01:13.987733 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985477 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:01:13.987733 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985479 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:01:13.987733 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985482 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:01:13.987733 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985484 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:01:13.987733 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985487 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:01:13.987733 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985490 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:01:13.987733 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985492 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:01:13.987733 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985494 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:01:13.987733 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985499 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:01:13.987733 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985501 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:01:13.987733 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985504 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:01:13.987733 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985507 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:01:13.987733 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985509 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:01:13.987733 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985512 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:01:13.987733 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985524 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:01:13.987733 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985528 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:01:13.988217 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985531 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:01:13.988217 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985534 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:01:13.988217 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985537 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:01:13.988217 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985540 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:01:13.988217 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985542 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:01:13.988217 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985545 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:01:13.988217 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985547 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:01:13.988217 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985550 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:01:13.988217 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985552 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:01:13.988217 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985555 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:01:13.988217 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985559 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:01:13.988217 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985562 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:01:13.988217 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985565 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:01:13.988217 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985568 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:01:13.988217 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985571 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:01:13.988217 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985574 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:01:13.988217 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985576 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:01:13.988217 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985581 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:01:13.988217 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985584 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:01:13.988217 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985587 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:01:13.988697 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985590 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:01:13.988697 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985592 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:01:13.988697 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985595 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:01:13.988697 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985598 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:01:13.988697 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985602 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:01:13.988697 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985605 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:01:13.988697 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985608 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:01:13.988697 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985610 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:01:13.988697 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985613 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:01:13.988697 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985616 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:01:13.988697 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985618 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:01:13.988697 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985621 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:01:13.988697 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985624 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:01:13.988697 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985626 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:01:13.988697 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985630 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:01:13.988697 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985634 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:01:13.988697 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985637 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:01:13.988697 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985639 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:01:13.988697 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985641 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:01:13.988697 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985644 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:01:13.989239 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.985647 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:01:13.989239 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986033 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:01:13.989239 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986039 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:01:13.989239 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986041 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:01:13.989239 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986045 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:01:13.989239 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986048 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:01:13.989239 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986051 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:01:13.989239 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986054 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:01:13.989239 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986057 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:01:13.989239 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986060 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:01:13.989239 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986062 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:01:13.989239 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986065 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:01:13.989239 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986068 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:01:13.989239 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986071 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:01:13.989239 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986074 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:01:13.989239 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986077 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:01:13.989239 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986080 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:01:13.989239 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986082 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:01:13.989239 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986085 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:01:13.989239 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986087 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:01:13.989721 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986090 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:01:13.989721 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986092 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:01:13.989721 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986095 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:01:13.989721 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986098 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:01:13.989721 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986101 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:01:13.989721 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986103 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:01:13.989721 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986106 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:01:13.989721 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986109 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:01:13.989721 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986111 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:01:13.989721 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986114 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:01:13.989721 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986116 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:01:13.989721 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986121 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:01:13.989721 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986125 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:01:13.989721 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986128 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:01:13.989721 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986131 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:01:13.989721 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986134 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:01:13.989721 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986137 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:01:13.989721 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986140 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:01:13.989721 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986151 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:01:13.989721 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986153 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:01:13.990211 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986156 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:01:13.990211 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986159 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:01:13.990211 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986162 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:01:13.990211 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986166 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:01:13.990211 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986169 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:01:13.990211 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986172 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:01:13.990211 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986175 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:01:13.990211 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986178 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:01:13.990211 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986180 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:01:13.990211 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986183 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:01:13.990211 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986186 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:01:13.990211 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986188 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:01:13.990211 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986191 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:01:13.990211 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986194 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:01:13.990211 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986196 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:01:13.990211 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986199 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:01:13.990211 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986208 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:01:13.990211 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986211 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:01:13.990211 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986213 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:01:13.990211 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986216 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:01:13.990714 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986218 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:01:13.990714 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986221 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:01:13.990714 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986224 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:01:13.990714 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986226 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:01:13.990714 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986229 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:01:13.990714 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986231 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:01:13.990714 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986234 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:01:13.990714 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986236 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:01:13.990714 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986239 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:01:13.990714 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986241 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:01:13.990714 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986244 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:01:13.990714 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986247 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:01:13.990714 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986250 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:01:13.990714 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986253 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:01:13.990714 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986257 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:01:13.990714 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986260 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:01:13.990714 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986264 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:01:13.990714 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986268 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:01:13.990714 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986271 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:01:13.991282 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986273 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:01:13.991282 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986276 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:01:13.991282 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986279 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:01:13.991282 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986281 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:01:13.991282 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986284 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:01:13.991282 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986286 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:01:13.991282 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986289 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:01:13.991282 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986291 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:01:13.991282 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986294 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:01:13.991282 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986297 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:01:13.991282 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986300 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:01:13.991282 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986303 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:01:13.991282 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986305 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:01:13.991282 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986308 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:01:13.991282 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986311 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:01:13.991282 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986314 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:01:13.991282 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986316 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:01:13.991282 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986319 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:01:13.991282 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986322 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:01:13.991282 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986325 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.986327 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986403 2574 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986410 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986416 2574 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986422 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986427 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986430 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986435 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986439 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986445 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986448 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986452 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986455 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986458 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986461 2574 flags.go:64] FLAG: --cgroup-root="" Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986464 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986467 2574 flags.go:64] FLAG: --client-ca-file="" Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986470 2574 flags.go:64] FLAG: --cloud-provider="external" Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986474 2574 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986478 2574 flags.go:64] FLAG: --cluster-domain="" Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986481 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986485 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986489 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 00:01:13.991765 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986492 2574 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986496 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986499 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986503 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986506 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986509 2574 flags.go:64] FLAG: --contention-profiling="false" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986512 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986515 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986518 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986522 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986526 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986529 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986532 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986535 2574 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986538 2574 flags.go:64] FLAG: --enable-server="true" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986541 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986546 2574 flags.go:64] FLAG: --event-burst="100" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986549 2574 flags.go:64] FLAG: --event-qps="50" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986553 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986557 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986560 2574 flags.go:64] FLAG: --eviction-hard="" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986563 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986566 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986569 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986572 2574 flags.go:64] FLAG: --eviction-soft="" Jul 28 00:01:13.992387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986575 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986578 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986582 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986585 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986588 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986592 2574 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986595 2574 flags.go:64] FLAG: --feature-gates="" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986599 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986602 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986606 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986609 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986612 2574 flags.go:64] FLAG: --healthz-port="10248" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986615 2574 flags.go:64] FLAG: --help="false" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986618 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-130-253.ec2.internal" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986622 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986625 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986628 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986631 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986635 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986638 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986641 2574 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986643 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986647 2574 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 00:01:13.993301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986650 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986653 2574 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986658 2574 flags.go:64] FLAG: --kube-reserved="" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986661 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986663 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986667 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986669 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986672 2574 flags.go:64] FLAG: --lock-file="" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986675 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986678 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986681 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986687 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986690 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986692 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986696 2574 flags.go:64] FLAG: --logging-format="text" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986699 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986702 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986705 2574 flags.go:64] FLAG: --manifest-url="" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986708 2574 flags.go:64] FLAG: --manifest-url-header="" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986712 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986715 2574 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986724 2574 flags.go:64] FLAG: --max-pods="110" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986727 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986731 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986733 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 00:01:13.994314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986737 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986740 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986743 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986746 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986753 2574 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986756 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986759 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986762 2574 flags.go:64] FLAG: --pod-cidr="" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986766 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986772 2574 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986776 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986779 2574 flags.go:64] FLAG: --pods-per-core="0" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986782 2574 flags.go:64] FLAG: --port="10250" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986785 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986788 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0583dd1c1e58e4f11" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986792 2574 flags.go:64] FLAG: --qos-reserved="" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986795 2574 flags.go:64] FLAG: --read-only-port="10255" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986798 2574 flags.go:64] FLAG: --register-node="true" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986800 2574 flags.go:64] FLAG: --register-with-taints="" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986804 2574 flags.go:64] FLAG: --registry-burst="10" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986807 2574 flags.go:64] FLAG: --registry-qps="5" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986810 2574 flags.go:64] FLAG: --reserved-cpus="" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986813 2574 flags.go:64] FLAG: --reserved-memory="" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986817 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986820 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 00:01:13.995405 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986823 2574 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986826 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986829 2574 flags.go:64] FLAG: --runonce="false" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986832 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986835 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986838 2574 flags.go:64] FLAG: --seccomp-default="false" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986841 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986844 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986847 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986850 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986853 2574 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986856 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986859 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986862 2574 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986864 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986868 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986872 2574 flags.go:64] FLAG: --system-cgroups="" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986875 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986881 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986884 2574 flags.go:64] FLAG: --tls-cert-file="" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986887 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986892 2574 flags.go:64] FLAG: --tls-min-version="" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986895 2574 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986897 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986901 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 00:01:13.996527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986904 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 00:01:13.997414 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986907 2574 flags.go:64] FLAG: --v="2" Jul 28 00:01:13.997414 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986911 2574 flags.go:64] FLAG: --version="false" Jul 28 00:01:13.997414 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986917 2574 flags.go:64] FLAG: --vmodule="" Jul 28 00:01:13.997414 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986921 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 00:01:13.997414 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.986924 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 00:01:13.997414 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987055 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:01:13.997414 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987060 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:01:13.997414 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987063 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:01:13.997414 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987066 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:01:13.997414 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987069 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:01:13.997414 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987073 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:01:13.997414 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987076 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:01:13.997414 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987079 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:01:13.997414 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987082 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:01:13.997414 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987084 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:01:13.997414 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987087 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:01:13.997414 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987089 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:01:13.997414 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987092 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:01:13.997414 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987094 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:01:13.997414 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987097 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:01:13.997414 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987099 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:01:13.998261 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987102 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:01:13.998261 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987104 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:01:13.998261 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987110 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:01:13.998261 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987113 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:01:13.998261 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987115 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:01:13.998261 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987118 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:01:13.998261 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987120 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:01:13.998261 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987123 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:01:13.998261 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987125 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:01:13.998261 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987128 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:01:13.998261 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987130 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:01:13.998261 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987133 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:01:13.998261 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987136 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:01:13.998261 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987139 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:01:13.998261 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987142 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:01:13.998261 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987145 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:01:13.998261 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987148 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:01:13.998261 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987150 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:01:13.998261 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987153 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:01:13.998261 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987156 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:01:13.999126 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987159 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:01:13.999126 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987161 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:01:13.999126 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987164 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:01:13.999126 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987166 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:01:13.999126 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987169 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:01:13.999126 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987171 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:01:13.999126 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987174 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:01:13.999126 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987177 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:01:13.999126 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987179 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:01:13.999126 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987182 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:01:13.999126 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987185 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:01:13.999126 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987187 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:01:13.999126 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987190 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:01:13.999126 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987194 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:01:13.999126 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987199 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:01:13.999126 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987202 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:01:13.999126 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987205 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:01:13.999126 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987208 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:01:13.999126 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987212 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:01:13.999644 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987215 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:01:13.999644 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987219 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:01:13.999644 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987222 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:01:13.999644 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987224 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:01:13.999644 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987227 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:01:13.999644 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987230 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:01:13.999644 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987233 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:01:13.999644 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987236 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:01:13.999644 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987238 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:01:13.999644 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987241 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:01:13.999644 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987243 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:01:13.999644 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987247 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:01:13.999644 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987249 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:01:13.999644 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987252 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:01:13.999644 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987254 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:01:13.999644 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987257 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:01:13.999644 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987260 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:01:13.999644 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987263 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:01:13.999644 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987265 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:01:13.999644 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987268 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:01:14.000305 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987270 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:01:14.000305 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987273 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:01:14.000305 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987276 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:01:14.000305 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987278 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:01:14.000305 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987281 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:01:14.000305 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987283 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:01:14.000305 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987286 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:01:14.000305 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987290 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:01:14.000305 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987293 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:01:14.000305 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987296 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:01:14.000305 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987298 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:01:14.000305 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987301 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:01:14.000305 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987303 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:01:14.000305 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987306 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:01:14.000305 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987309 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:01:14.000305 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987311 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:01:14.000305 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987314 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:01:14.000305 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987316 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:01:14.000305 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987320 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:01:14.000305 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987323 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:01:14.000787 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987325 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:01:14.000787 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987328 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:01:14.000787 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987331 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:01:14.000787 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.987333 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:01:14.000787 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.987339 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 00:01:14.000787 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.995339 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 00:01:14.000787 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.995363 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 00:01:14.000787 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.995386 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 00:01:14.000787 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.995399 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 00:01:14.000787 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995489 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:01:14.000787 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995497 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:01:14.000787 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995502 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:01:14.000787 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995507 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:01:14.000787 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995512 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:01:14.001171 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995516 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:01:14.001171 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995522 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:01:14.001171 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995526 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:01:14.001171 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995530 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:01:14.001171 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995535 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:01:14.001171 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995540 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:01:14.001171 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995544 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:01:14.001171 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995549 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:01:14.001171 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995554 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:01:14.001171 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995558 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:01:14.001171 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995563 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:01:14.001171 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995567 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:01:14.001171 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995571 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:01:14.001171 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995575 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:01:14.001171 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995579 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:01:14.001171 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995583 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:01:14.001171 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995587 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:01:14.001171 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995592 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:01:14.001171 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995596 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:01:14.001627 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995600 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:01:14.001627 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995604 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:01:14.001627 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995608 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:01:14.001627 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995612 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:01:14.001627 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995616 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:01:14.001627 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995632 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:01:14.001627 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995639 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:01:14.001627 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995644 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:01:14.001627 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995649 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:01:14.001627 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995654 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:01:14.001627 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995658 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:01:14.001627 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995663 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:01:14.001627 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995667 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:01:14.001627 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995671 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:01:14.001627 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995675 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:01:14.001627 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995679 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:01:14.001627 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995684 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:01:14.001627 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995688 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:01:14.001627 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995694 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:01:14.002164 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995700 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:01:14.002164 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995705 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:01:14.002164 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995709 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:01:14.002164 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995714 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:01:14.002164 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995718 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:01:14.002164 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995722 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:01:14.002164 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995726 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:01:14.002164 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995731 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:01:14.002164 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995735 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:01:14.002164 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995739 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:01:14.002164 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995743 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:01:14.002164 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995747 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:01:14.002164 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995751 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:01:14.002164 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995755 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:01:14.002164 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995759 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:01:14.002164 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995763 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:01:14.002164 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995768 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:01:14.002164 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995772 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:01:14.002164 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995776 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:01:14.002164 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995791 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:01:14.002682 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995796 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:01:14.002682 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995800 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:01:14.002682 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995805 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:01:14.002682 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995809 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:01:14.002682 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995813 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:01:14.002682 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995817 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:01:14.002682 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995821 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:01:14.002682 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995825 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:01:14.002682 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995829 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:01:14.002682 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995834 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:01:14.002682 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995838 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:01:14.002682 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995842 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:01:14.002682 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995847 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:01:14.002682 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995851 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:01:14.002682 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995855 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:01:14.002682 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995860 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:01:14.002682 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995864 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:01:14.002682 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995868 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:01:14.002682 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995872 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:01:14.002682 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995877 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:01:14.003237 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995881 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:01:14.003237 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995885 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:01:14.003237 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995890 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:01:14.003237 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995894 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:01:14.003237 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995898 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:01:14.003237 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995902 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:01:14.003237 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995906 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:01:14.003237 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995910 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:01:14.003237 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995914 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:01:14.003237 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995918 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:01:14.003237 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995923 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:01:14.003237 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995928 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:01:14.003237 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995940 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:01:14.003237 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995946 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:01:14.003237 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995951 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:01:14.003237 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.995956 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:01:14.003641 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.995965 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 00:01:14.003641 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996210 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:01:14.003641 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996220 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:01:14.003641 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996225 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:01:14.003641 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996229 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:01:14.003641 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996234 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:01:14.003641 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996238 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:01:14.003641 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996243 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:01:14.003641 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996249 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:01:14.003641 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996256 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:01:14.003641 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996260 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:01:14.003641 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996265 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:01:14.003641 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996269 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:01:14.003641 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996273 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:01:14.003990 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996278 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:01:14.003990 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996283 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:01:14.003990 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996287 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:01:14.003990 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996294 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:01:14.003990 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996299 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:01:14.003990 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996305 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:01:14.003990 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996309 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:01:14.003990 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996314 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:01:14.003990 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996318 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:01:14.003990 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996323 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:01:14.003990 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996328 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:01:14.003990 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996332 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:01:14.003990 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996337 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:01:14.003990 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996342 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:01:14.003990 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996346 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:01:14.003990 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996358 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:01:14.003990 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996363 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:01:14.003990 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996367 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:01:14.003990 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996372 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:01:14.004482 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996376 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:01:14.004482 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996380 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:01:14.004482 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996384 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:01:14.004482 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996388 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:01:14.004482 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996392 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:01:14.004482 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996396 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:01:14.004482 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996400 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:01:14.004482 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996405 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:01:14.004482 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996409 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:01:14.004482 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996413 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:01:14.004482 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996417 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:01:14.004482 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996422 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:01:14.004482 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996426 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:01:14.004482 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996430 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:01:14.004482 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996434 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:01:14.004482 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996439 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:01:14.004482 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996443 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:01:14.004482 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996448 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:01:14.004482 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996452 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:01:14.004482 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996456 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:01:14.004482 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996460 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:01:14.004984 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996464 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:01:14.004984 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996468 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:01:14.004984 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996473 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:01:14.004984 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996477 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:01:14.004984 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996481 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:01:14.004984 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996485 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:01:14.004984 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996489 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:01:14.004984 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996493 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:01:14.004984 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996504 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:01:14.004984 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996509 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:01:14.004984 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996513 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:01:14.004984 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996517 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:01:14.004984 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996521 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:01:14.004984 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996525 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:01:14.004984 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996529 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:01:14.004984 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996533 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:01:14.004984 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996537 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:01:14.004984 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996541 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:01:14.004984 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996545 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:01:14.004984 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996549 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:01:14.005791 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996553 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:01:14.005791 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996558 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:01:14.005791 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996562 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:01:14.005791 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996567 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:01:14.005791 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996571 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:01:14.005791 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996575 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:01:14.005791 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996579 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:01:14.005791 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996584 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:01:14.005791 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996588 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:01:14.005791 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996592 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:01:14.005791 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996598 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:01:14.005791 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996604 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:01:14.005791 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996608 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:01:14.005791 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996613 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:01:14.005791 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996617 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:01:14.005791 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996622 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:01:14.005791 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996626 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:01:14.005791 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996630 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:01:14.005791 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996634 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:01:14.006579 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996639 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:01:14.006579 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996643 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:01:14.006579 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996654 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:01:14.006579 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996660 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:01:14.006579 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996664 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:01:14.006579 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996668 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:01:14.006579 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:13.996672 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:01:14.006579 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.996681 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 00:01:14.006579 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.996895 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 00:01:14.006579 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:13.999967 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 00:01:14.006579 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.001700 2574 server.go:1019] "Starting client certificate rotation" Jul 28 00:01:14.006579 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.001805 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 00:01:14.006579 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.001875 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 00:01:14.007190 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.005832 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 00:01:14.012209 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.012186 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 00:01:14.028261 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.028241 2574 log.go:25] "Validated CRI v1 runtime API" Jul 28 00:01:14.030578 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.030559 2574 log.go:25] "Validated CRI v1 image API" Jul 28 00:01:14.031394 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.031377 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 00:01:14.033708 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.033688 2574 fs.go:135] Filesystem UUIDs: map[786a8571-477b-4ad5-a55c-35cf3a4e6652:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 80aa86ca-b789-4ccc-a2b9-8484c59ef330:/dev/nvme0n1p3] Jul 28 00:01:14.033758 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.033708 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 00:01:14.037371 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.037351 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 00:01:14.038259 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.038153 2574 manager.go:216] Machine: {Timestamp:2026-07-28 00:01:14.037665446 +0000 UTC m=+0.374908177 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099716 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2411e861ba2f11778e2bea93f655bb SystemUUID:ec2411e8-61ba-2f11-778e-2bea93f655bb BootID:11a14456-1d3f-4e0e-b9ee-bed4919723c5 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4e:ac:2b:b7:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4e:ac:2b:b7:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:20:f1:50:7e:80 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 00:01:14.038259 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.038252 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 00:01:14.038377 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.038334 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 00:01:14.041805 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.041781 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 00:01:14.041963 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.041807 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-253.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 00:01:14.042608 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.042597 2574 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 00:01:14.042639 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.042610 2574 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 00:01:14.042639 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.042618 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 00:01:14.043500 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.043489 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 00:01:14.045139 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.045128 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 00:01:14.049999 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.049986 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 28 00:01:14.050152 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.050142 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 00:01:14.050185 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.050173 2574 kubelet.go:486] "Attempting to sync node with API server" Jul 28 00:01:14.050212 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.050191 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 00:01:14.050212 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.050208 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 00:01:14.050267 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.050222 2574 kubelet.go:398] "Adding apiserver pod source" Jul 28 00:01:14.050267 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.050233 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 00:01:14.050647 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.050633 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 00:01:14.050688 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.050655 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 00:01:14.053008 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.052987 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 00:01:14.055464 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.055451 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 00:01:14.055529 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.055482 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 00:01:14.056641 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.056622 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ptprv" Jul 28 00:01:14.056913 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.056901 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 00:01:14.056949 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.056918 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 00:01:14.056949 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.056925 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 00:01:14.056949 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.056931 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 00:01:14.056949 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.056940 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 00:01:14.056949 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.056945 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 00:01:14.057103 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.056953 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 00:01:14.057103 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.056960 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 00:01:14.057103 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.056967 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 00:01:14.057103 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.056972 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 00:01:14.057103 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.056981 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 00:01:14.057103 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.056986 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 00:01:14.057103 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.057006 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 00:01:14.057103 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.057011 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 00:01:14.061211 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.061192 2574 server.go:1268] "Started kubelet" Jul 28 00:01:14.061310 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.061246 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 00:01:14.061466 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:14.061441 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 00:01:14.061529 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:14.061490 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 00:01:14.061616 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.061598 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 00:01:14.061672 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.061640 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 00:01:14.061723 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.061683 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 00:01:14.062089 ip-10-0-130-253 systemd[1]: Started Kubernetes Kubelet. Jul 28 00:01:14.063080 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.063064 2574 server.go:310] "Adding debug handlers to kubelet server" Jul 28 00:01:14.064386 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.064370 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 00:01:14.064616 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.064601 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ptprv" Jul 28 00:01:14.067678 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:14.067655 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 00:01:14.072232 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:14.071184 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-253.ec2.internal.18c64b193c8d3d75 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-253.ec2.internal,UID:ip-10-0-130-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-253.ec2.internal,},FirstTimestamp:2026-07-28 00:01:14.061135221 +0000 UTC m=+0.398377952,LastTimestamp:2026-07-28 00:01:14.061135221 +0000 UTC m=+0.398377952,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-253.ec2.internal,}" Jul 28 00:01:14.073496 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.073476 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 00:01:14.073581 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.073497 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 00:01:14.073630 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:14.073585 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jul 28 00:01:14.074200 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.074170 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 00:01:14.074291 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.074171 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 00:01:14.074291 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.074220 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 00:01:14.074291 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.074259 2574 factory.go:55] Registering systemd factory Jul 28 00:01:14.074291 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.074282 2574 factory.go:223] Registration of the systemd container factory successfully Jul 28 00:01:14.074484 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.074303 2574 reconstruct.go:97] "Volume reconstruction finished" Jul 28 00:01:14.074484 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.074314 2574 reconciler.go:29] "Reconciler: start to sync state" Jul 28 00:01:14.074484 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.074483 2574 factory.go:153] Registering CRI-O factory Jul 28 00:01:14.074608 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.074496 2574 factory.go:223] Registration of the crio container factory successfully Jul 28 00:01:14.074608 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.074551 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 00:01:14.074608 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.074572 2574 factory.go:103] Registering Raw factory Jul 28 00:01:14.074608 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.074588 2574 manager.go:1196] Started watching for new ooms in manager Jul 28 00:01:14.074983 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.074973 2574 manager.go:349] Starting recovery of all containers Jul 28 00:01:14.082972 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.082950 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:01:14.085906 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.085882 2574 manager.go:354] Recovery completed Jul 28 00:01:14.090090 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:14.090071 2574 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-253.ec2.internal\" not found" node="ip-10-0-130-253.ec2.internal" Jul 28 00:01:14.090956 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.090943 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:01:14.092844 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.092814 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:01:14.092916 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.092857 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:01:14.092916 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.092873 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:01:14.093464 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.093449 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 00:01:14.093464 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.093461 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 00:01:14.093464 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.093464 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:01:14.093624 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.093477 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 28 00:01:14.094300 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.094285 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:01:14.094385 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.094314 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:01:14.094385 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.094328 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:01:14.096234 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.096220 2574 policy_none.go:49] "None policy: Start" Jul 28 00:01:14.096301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.096238 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 00:01:14.096301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.096248 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 00:01:14.098141 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.098129 2574 policy_none.go:47] "Start" Jul 28 00:01:14.131606 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.131585 2574 manager.go:337] "Starting Device Plugin manager" Jul 28 00:01:14.152088 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:14.131622 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 00:01:14.152088 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.131640 2574 server.go:87] "Starting device plugin registration server" Jul 28 00:01:14.152088 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.131881 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 00:01:14.152088 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.131892 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 00:01:14.152088 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.131994 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 00:01:14.152088 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.132107 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 00:01:14.152088 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.132116 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 00:01:14.152088 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:14.132542 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 00:01:14.152088 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:14.132596 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-253.ec2.internal\" not found" Jul 28 00:01:14.152088 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.142383 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 00:01:14.152088 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.143537 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 00:01:14.152088 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.143572 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 00:01:14.152088 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.143595 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 00:01:14.152088 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:14.143631 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 00:01:14.152088 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.145830 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:01:14.232110 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.232011 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:01:14.233012 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.232984 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:01:14.233139 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.233034 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:01:14.233139 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.233049 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:01:14.233139 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.233078 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-253.ec2.internal" Jul 28 00:01:14.242767 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.242751 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-253.ec2.internal" Jul 28 00:01:14.242866 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:14.242773 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-253.ec2.internal\": node \"ip-10-0-130-253.ec2.internal\" not found" Jul 28 00:01:14.244090 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.244073 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal"] Jul 28 00:01:14.244139 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.244134 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:01:14.246355 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.246339 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:01:14.246445 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.246367 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:01:14.246445 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.246378 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:01:14.248634 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.248621 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:01:14.248728 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.248714 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Jul 28 00:01:14.248774 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.248743 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:01:14.249288 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.249274 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:01:14.249369 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.249289 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:01:14.249369 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.249300 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:01:14.249369 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.249315 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:01:14.249369 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.249325 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:01:14.249369 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.249315 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:01:14.251532 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.251516 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" Jul 28 00:01:14.251594 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.251544 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:01:14.252174 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.252161 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:01:14.252232 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.252182 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:01:14.252232 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.252195 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:01:14.266634 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:14.266615 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jul 28 00:01:14.274988 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.274972 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b46af047627177c30ef30b48f0650e79-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal\" (UID: \"b46af047627177c30ef30b48f0650e79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Jul 28 00:01:14.275078 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.274996 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b46af047627177c30ef30b48f0650e79-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal\" (UID: \"b46af047627177c30ef30b48f0650e79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Jul 28 00:01:14.275078 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.275013 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b1c9672097d54576fb7cce42c7e502c6-config\") pod \"kube-apiserver-proxy-ip-10-0-130-253.ec2.internal\" (UID: \"b1c9672097d54576fb7cce42c7e502c6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" Jul 28 00:01:14.284703 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:14.284680 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-253.ec2.internal\" not found" node="ip-10-0-130-253.ec2.internal" Jul 28 00:01:14.288950 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:14.288934 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-253.ec2.internal\" not found" node="ip-10-0-130-253.ec2.internal" Jul 28 00:01:14.367366 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:14.367321 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jul 28 00:01:14.375598 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.375577 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b46af047627177c30ef30b48f0650e79-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal\" (UID: \"b46af047627177c30ef30b48f0650e79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Jul 28 00:01:14.375662 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.375603 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b46af047627177c30ef30b48f0650e79-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal\" (UID: \"b46af047627177c30ef30b48f0650e79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Jul 28 00:01:14.375662 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.375620 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b1c9672097d54576fb7cce42c7e502c6-config\") pod \"kube-apiserver-proxy-ip-10-0-130-253.ec2.internal\" (UID: \"b1c9672097d54576fb7cce42c7e502c6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" Jul 28 00:01:14.375662 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.375657 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b1c9672097d54576fb7cce42c7e502c6-config\") pod \"kube-apiserver-proxy-ip-10-0-130-253.ec2.internal\" (UID: \"b1c9672097d54576fb7cce42c7e502c6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" Jul 28 00:01:14.375815 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.375681 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b46af047627177c30ef30b48f0650e79-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal\" (UID: \"b46af047627177c30ef30b48f0650e79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Jul 28 00:01:14.375815 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.375698 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b46af047627177c30ef30b48f0650e79-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal\" (UID: \"b46af047627177c30ef30b48f0650e79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Jul 28 00:01:14.468416 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:14.468382 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jul 28 00:01:14.568697 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:14.568625 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jul 28 00:01:14.591172 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.591140 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Jul 28 00:01:14.593307 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:14.593277 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" Jul 28 00:01:14.669788 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:14.669751 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jul 28 00:01:15.991012 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:15.990990 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jul 28 00:01:16.091541 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:16.091467 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jul 28 00:01:16.192028 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:16.191992 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jul 28 00:01:16.221465 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:16.221429 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 00:01:16.221971 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:16.221586 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 00:01:16.221971 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:16.221638 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 00:01:16.292697 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:16.292656 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 23:56:15 +0000 UTC" deadline="2028-01-08 15:51:37.962645848 +0000 UTC" Jul 28 00:01:16.292697 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:16.292677 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jul 28 00:01:16.292697 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:16.292686 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12711h50m21.669963231s" Jul 28 00:01:16.393018 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:16.392975 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jul 28 00:01:16.466064 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:16.466037 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:01:16.493669 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:16.493626 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jul 28 00:01:16.504095 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:16.504064 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb46af047627177c30ef30b48f0650e79.slice/crio-2762507b6844f1460b0b142e3cc9bb8fd2eb80c8caf9494a25984bf9502483cb WatchSource:0}: Error finding container 2762507b6844f1460b0b142e3cc9bb8fd2eb80c8caf9494a25984bf9502483cb: Status 404 returned error can't find the container with id 2762507b6844f1460b0b142e3cc9bb8fd2eb80c8caf9494a25984bf9502483cb Jul 28 00:01:16.505081 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:16.505054 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c9672097d54576fb7cce42c7e502c6.slice/crio-32fc7011ad7ee77dec82689b3e16bb686bb6abfe3e9097522c866b7900d39e53 WatchSource:0}: Error finding container 32fc7011ad7ee77dec82689b3e16bb686bb6abfe3e9097522c866b7900d39e53: Status 404 returned error can't find the container with id 32fc7011ad7ee77dec82689b3e16bb686bb6abfe3e9097522c866b7900d39e53 Jul 28 00:01:16.509371 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:16.509356 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 00:01:16.594731 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:16.594695 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jul 28 00:01:16.695187 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:16.695096 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jul 28 00:01:16.726120 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:16.726088 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:01:16.794689 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:16.794656 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" Jul 28 00:01:16.803371 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:16.803350 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 00:01:16.804585 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:16.804571 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Jul 28 00:01:16.814889 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:16.814867 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 00:01:17.160918 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.160837 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:01:17.271806 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.271768 2574 apiserver.go:52] "Watching apiserver" Jul 28 00:01:17.280516 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.280489 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 00:01:17.280896 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.280867 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-md25x","kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq","openshift-dns/node-resolver-27gsr","openshift-image-registry/node-ca-ckjf9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal","openshift-multus/multus-additional-cni-plugins-dl5vz","openshift-network-operator/iptables-alerter-hdmsb","kube-system/global-pull-secret-syncer-n56zd","kube-system/konnectivity-agent-sx88w","openshift-cluster-node-tuning-operator/tuned-45jgc","openshift-multus/multus-gpmnb","openshift-multus/network-metrics-daemon-f29s8","openshift-network-diagnostics/network-check-target-dflsn"] Jul 28 00:01:17.281642 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.281619 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:01:17.283421 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.283400 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.285616 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.285592 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:17.285709 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:17.285686 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f29s8" podUID="5894c611-99f4-4459-8619-63305e3d25d1" Jul 28 00:01:17.286320 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.286300 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 00:01:17.286417 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.286307 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 00:01:17.286417 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.286322 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p8tbp\"" Jul 28 00:01:17.286736 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.286717 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 00:01:17.286865 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.286848 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 00:01:17.286994 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.286976 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 00:01:17.288252 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.287867 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.290166 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.290102 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-27gsr" Jul 28 00:01:17.290552 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.290530 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qjs2g\"" Jul 28 00:01:17.290648 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.290557 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 00:01:17.290648 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.290605 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 00:01:17.290752 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.290717 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 00:01:17.292404 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.292387 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ckjf9" Jul 28 00:01:17.293191 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.293170 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dsnn7\"" Jul 28 00:01:17.293289 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.293173 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 00:01:17.293618 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.293598 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 00:01:17.294499 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.294481 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:17.294596 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:17.294570 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflsn" podUID="65d808ec-5de9-4dfa-9c3e-e45a41f3ccde" Jul 28 00:01:17.294709 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.294630 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 00:01:17.294783 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.294739 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 00:01:17.295047 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.295024 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 00:01:17.295169 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.295151 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wzld6\"" Jul 28 00:01:17.295234 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.295159 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 00:01:17.296888 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.296844 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:17.296966 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:17.296911 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n56zd" podUID="361a09af-a231-45f9-8332-fbd085df9a5f" Jul 28 00:01:17.300166 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.300138 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.302652 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.302285 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hdmsb" Jul 28 00:01:17.302898 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.302878 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 00:01:17.303108 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.303094 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 00:01:17.304352 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.304330 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 00:01:17.304448 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.304369 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 00:01:17.304448 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.304420 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 00:01:17.304555 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.304422 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wgrw5\"" Jul 28 00:01:17.304555 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.304331 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 00:01:17.304656 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.304597 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pwnj\" (UniqueName: \"kubernetes.io/projected/cc43fba5-dd78-4101-88e2-58f00af58ef1-kube-api-access-8pwnj\") pod \"node-resolver-27gsr\" (UID: \"cc43fba5-dd78-4101-88e2-58f00af58ef1\") " pod="openshift-dns/node-resolver-27gsr" Jul 28 00:01:17.304656 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.304627 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0823e600-8868-4c59-b929-7d0a7ae34711-host\") pod \"node-ca-ckjf9\" (UID: \"0823e600-8868-4c59-b929-7d0a7ae34711\") " pod="openshift-image-registry/node-ca-ckjf9" Jul 28 00:01:17.304753 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.304652 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29mkd\" (UniqueName: \"kubernetes.io/projected/0823e600-8868-4c59-b929-7d0a7ae34711-kube-api-access-29mkd\") pod \"node-ca-ckjf9\" (UID: \"0823e600-8868-4c59-b929-7d0a7ae34711\") " pod="openshift-image-registry/node-ca-ckjf9" Jul 28 00:01:17.304753 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.304676 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/86091880-c298-4359-9ca1-b513f2af0889-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.304753 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.304701 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/86091880-c298-4359-9ca1-b513f2af0889-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.304753 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.304722 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c600a59-9500-4e62-bc84-82da85a3b1bd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rf8nq\" (UID: \"8c600a59-9500-4e62-bc84-82da85a3b1bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.304942 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.304749 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/86091880-c298-4359-9ca1-b513f2af0889-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.304942 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.304802 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngsrh\" (UniqueName: \"kubernetes.io/projected/86091880-c298-4359-9ca1-b513f2af0889-kube-api-access-ngsrh\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.304942 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.304842 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/361a09af-a231-45f9-8332-fbd085df9a5f-kubelet-config\") pod \"global-pull-secret-syncer-n56zd\" (UID: \"361a09af-a231-45f9-8332-fbd085df9a5f\") " pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:17.304942 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.304882 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret\") pod \"global-pull-secret-syncer-n56zd\" (UID: \"361a09af-a231-45f9-8332-fbd085df9a5f\") " pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:17.304942 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.304916 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c600a59-9500-4e62-bc84-82da85a3b1bd-socket-dir\") pod \"aws-ebs-csi-driver-node-rf8nq\" (UID: \"8c600a59-9500-4e62-bc84-82da85a3b1bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.305152 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.304944 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c600a59-9500-4e62-bc84-82da85a3b1bd-device-dir\") pod \"aws-ebs-csi-driver-node-rf8nq\" (UID: \"8c600a59-9500-4e62-bc84-82da85a3b1bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.305152 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.304965 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sx88w" Jul 28 00:01:17.305152 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.304971 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0823e600-8868-4c59-b929-7d0a7ae34711-serviceca\") pod \"node-ca-ckjf9\" (UID: \"0823e600-8868-4c59-b929-7d0a7ae34711\") " pod="openshift-image-registry/node-ca-ckjf9" Jul 28 00:01:17.305152 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.304994 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c600a59-9500-4e62-bc84-82da85a3b1bd-registration-dir\") pod \"aws-ebs-csi-driver-node-rf8nq\" (UID: \"8c600a59-9500-4e62-bc84-82da85a3b1bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.305152 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.305017 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nffl2\" (UniqueName: \"kubernetes.io/projected/8c600a59-9500-4e62-bc84-82da85a3b1bd-kube-api-access-nffl2\") pod \"aws-ebs-csi-driver-node-rf8nq\" (UID: \"8c600a59-9500-4e62-bc84-82da85a3b1bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.305152 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.305041 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86091880-c298-4359-9ca1-b513f2af0889-system-cni-dir\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.305152 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.305084 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/86091880-c298-4359-9ca1-b513f2af0889-os-release\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.305152 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.305115 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c600a59-9500-4e62-bc84-82da85a3b1bd-sys-fs\") pod \"aws-ebs-csi-driver-node-rf8nq\" (UID: \"8c600a59-9500-4e62-bc84-82da85a3b1bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.305152 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.305141 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w4sp\" (UniqueName: \"kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp\") pod \"network-check-target-dflsn\" (UID: \"65d808ec-5de9-4dfa-9c3e-e45a41f3ccde\") " pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:17.305503 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.305166 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs\") pod \"network-metrics-daemon-f29s8\" (UID: \"5894c611-99f4-4459-8619-63305e3d25d1\") " pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:17.305503 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.305190 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/86091880-c298-4359-9ca1-b513f2af0889-cnibin\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.305503 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.305217 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/361a09af-a231-45f9-8332-fbd085df9a5f-dbus\") pod \"global-pull-secret-syncer-n56zd\" (UID: \"361a09af-a231-45f9-8332-fbd085df9a5f\") " pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:17.305503 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.305251 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/86091880-c298-4359-9ca1-b513f2af0889-cni-binary-copy\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.305503 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.305285 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c600a59-9500-4e62-bc84-82da85a3b1bd-etc-selinux\") pod \"aws-ebs-csi-driver-node-rf8nq\" (UID: \"8c600a59-9500-4e62-bc84-82da85a3b1bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.305503 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.305316 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cc43fba5-dd78-4101-88e2-58f00af58ef1-hosts-file\") pod \"node-resolver-27gsr\" (UID: \"cc43fba5-dd78-4101-88e2-58f00af58ef1\") " pod="openshift-dns/node-resolver-27gsr" Jul 28 00:01:17.305503 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.305340 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc43fba5-dd78-4101-88e2-58f00af58ef1-tmp-dir\") pod \"node-resolver-27gsr\" (UID: \"cc43fba5-dd78-4101-88e2-58f00af58ef1\") " pod="openshift-dns/node-resolver-27gsr" Jul 28 00:01:17.305503 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.305365 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k7n8\" (UniqueName: \"kubernetes.io/projected/5894c611-99f4-4459-8619-63305e3d25d1-kube-api-access-2k7n8\") pod \"network-metrics-daemon-f29s8\" (UID: \"5894c611-99f4-4459-8619-63305e3d25d1\") " pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:17.305892 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.305627 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:01:17.305892 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.305681 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 00:01:17.305892 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.305632 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 00:01:17.306022 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.305935 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-swc62\"" Jul 28 00:01:17.307403 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.307384 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.308159 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.308136 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 00:01:17.308255 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.308163 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 00:01:17.308576 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.308558 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2c56v\"" Jul 28 00:01:17.309890 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.309868 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.310269 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.310252 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zwn7v\"" Jul 28 00:01:17.310689 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.310632 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 00:01:17.310689 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.310642 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:01:17.310967 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.310949 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 00:01:17.312233 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.312215 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 00:01:17.312313 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.312278 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jpvkh\"" Jul 28 00:01:17.327890 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.327874 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gtp4s" Jul 28 00:01:17.336598 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.336582 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gtp4s" Jul 28 00:01:17.369790 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.369723 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" event={"ID":"b46af047627177c30ef30b48f0650e79","Type":"ContainerStarted","Data":"2762507b6844f1460b0b142e3cc9bb8fd2eb80c8caf9494a25984bf9502483cb"} Jul 28 00:01:17.370711 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.370687 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" event={"ID":"b1c9672097d54576fb7cce42c7e502c6","Type":"ContainerStarted","Data":"32fc7011ad7ee77dec82689b3e16bb686bb6abfe3e9097522c866b7900d39e53"} Jul 28 00:01:17.396014 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.395982 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 00:01:17.406163 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406134 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-host-run-ovn-kubernetes\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.406299 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406172 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/361a09af-a231-45f9-8332-fbd085df9a5f-dbus\") pod \"global-pull-secret-syncer-n56zd\" (UID: \"361a09af-a231-45f9-8332-fbd085df9a5f\") " pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:17.406299 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406189 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cc43fba5-dd78-4101-88e2-58f00af58ef1-hosts-file\") pod \"node-resolver-27gsr\" (UID: \"cc43fba5-dd78-4101-88e2-58f00af58ef1\") " pod="openshift-dns/node-resolver-27gsr" Jul 28 00:01:17.406299 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406207 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc43fba5-dd78-4101-88e2-58f00af58ef1-tmp-dir\") pod \"node-resolver-27gsr\" (UID: \"cc43fba5-dd78-4101-88e2-58f00af58ef1\") " pod="openshift-dns/node-resolver-27gsr" Jul 28 00:01:17.406299 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406264 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-systemd-units\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.406473 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406335 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cc43fba5-dd78-4101-88e2-58f00af58ef1-hosts-file\") pod \"node-resolver-27gsr\" (UID: \"cc43fba5-dd78-4101-88e2-58f00af58ef1\") " pod="openshift-dns/node-resolver-27gsr" Jul 28 00:01:17.406473 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406332 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-host-slash\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.406473 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406378 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-host-var-lib-kubelet\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.406473 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406407 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0823e600-8868-4c59-b929-7d0a7ae34711-host\") pod \"node-ca-ckjf9\" (UID: \"0823e600-8868-4c59-b929-7d0a7ae34711\") " pod="openshift-image-registry/node-ca-ckjf9" Jul 28 00:01:17.406473 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406443 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29mkd\" (UniqueName: \"kubernetes.io/projected/0823e600-8868-4c59-b929-7d0a7ae34711-kube-api-access-29mkd\") pod \"node-ca-ckjf9\" (UID: \"0823e600-8868-4c59-b929-7d0a7ae34711\") " pod="openshift-image-registry/node-ca-ckjf9" Jul 28 00:01:17.406473 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406453 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/361a09af-a231-45f9-8332-fbd085df9a5f-dbus\") pod \"global-pull-secret-syncer-n56zd\" (UID: \"361a09af-a231-45f9-8332-fbd085df9a5f\") " pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:17.406751 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406561 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/184b7c0e-0bee-4207-a828-2b9df804266b-ovnkube-script-lib\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.406751 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406572 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc43fba5-dd78-4101-88e2-58f00af58ef1-tmp-dir\") pod \"node-resolver-27gsr\" (UID: \"cc43fba5-dd78-4101-88e2-58f00af58ef1\") " pod="openshift-dns/node-resolver-27gsr" Jul 28 00:01:17.406751 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406585 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0823e600-8868-4c59-b929-7d0a7ae34711-host\") pod \"node-ca-ckjf9\" (UID: \"0823e600-8868-4c59-b929-7d0a7ae34711\") " pod="openshift-image-registry/node-ca-ckjf9" Jul 28 00:01:17.406751 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406595 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-cni-binary-copy\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.406751 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406644 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-etc-kubernetes\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.406751 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406670 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-etc-modprobe-d\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.406751 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406697 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkfxn\" (UniqueName: \"kubernetes.io/projected/75ab6b83-7e76-44aa-b4a0-0766b1c60382-kube-api-access-pkfxn\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.406751 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406718 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a6a63750-e30c-4a77-bbbf-38498587808f-agent-certs\") pod \"konnectivity-agent-sx88w\" (UID: \"a6a63750-e30c-4a77-bbbf-38498587808f\") " pod="kube-system/konnectivity-agent-sx88w" Jul 28 00:01:17.406751 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406733 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-etc-sysctl-conf\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.406751 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406752 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-run\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.407214 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406789 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-host-run-netns\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.407214 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406812 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-var-lib-openvswitch\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.407214 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406830 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-node-log\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.407214 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406851 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-host-run-k8s-cni-cncf-io\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.407214 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406875 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/361a09af-a231-45f9-8332-fbd085df9a5f-kubelet-config\") pod \"global-pull-secret-syncer-n56zd\" (UID: \"361a09af-a231-45f9-8332-fbd085df9a5f\") " pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:17.407214 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406916 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c600a59-9500-4e62-bc84-82da85a3b1bd-socket-dir\") pod \"aws-ebs-csi-driver-node-rf8nq\" (UID: \"8c600a59-9500-4e62-bc84-82da85a3b1bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.407214 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.406998 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/361a09af-a231-45f9-8332-fbd085df9a5f-kubelet-config\") pod \"global-pull-secret-syncer-n56zd\" (UID: \"361a09af-a231-45f9-8332-fbd085df9a5f\") " pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:17.407214 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407013 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c600a59-9500-4e62-bc84-82da85a3b1bd-device-dir\") pod \"aws-ebs-csi-driver-node-rf8nq\" (UID: \"8c600a59-9500-4e62-bc84-82da85a3b1bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.407214 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407035 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c600a59-9500-4e62-bc84-82da85a3b1bd-socket-dir\") pod \"aws-ebs-csi-driver-node-rf8nq\" (UID: \"8c600a59-9500-4e62-bc84-82da85a3b1bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.407214 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407045 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-hostroot\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.407214 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407072 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a6a63750-e30c-4a77-bbbf-38498587808f-konnectivity-ca\") pod \"konnectivity-agent-sx88w\" (UID: \"a6a63750-e30c-4a77-bbbf-38498587808f\") " pod="kube-system/konnectivity-agent-sx88w" Jul 28 00:01:17.407214 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407105 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-etc-sysctl-d\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.407214 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407126 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/75ab6b83-7e76-44aa-b4a0-0766b1c60382-etc-tuned\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.407214 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407140 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c600a59-9500-4e62-bc84-82da85a3b1bd-device-dir\") pod \"aws-ebs-csi-driver-node-rf8nq\" (UID: \"8c600a59-9500-4e62-bc84-82da85a3b1bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.407214 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407160 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-host-cni-bin\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.407214 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407222 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-host-cni-netd\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.407920 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407246 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-host-var-lib-cni-bin\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.407920 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407268 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-multus-daemon-config\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.407920 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407297 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nffl2\" (UniqueName: \"kubernetes.io/projected/8c600a59-9500-4e62-bc84-82da85a3b1bd-kube-api-access-nffl2\") pod \"aws-ebs-csi-driver-node-rf8nq\" (UID: \"8c600a59-9500-4e62-bc84-82da85a3b1bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.407920 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407322 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86091880-c298-4359-9ca1-b513f2af0889-system-cni-dir\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.407920 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407345 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-host-kubelet\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.407920 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407369 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c600a59-9500-4e62-bc84-82da85a3b1bd-sys-fs\") pod \"aws-ebs-csi-driver-node-rf8nq\" (UID: \"8c600a59-9500-4e62-bc84-82da85a3b1bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.407920 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407392 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w4sp\" (UniqueName: \"kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp\") pod \"network-check-target-dflsn\" (UID: \"65d808ec-5de9-4dfa-9c3e-e45a41f3ccde\") " pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:17.407920 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407411 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86091880-c298-4359-9ca1-b513f2af0889-system-cni-dir\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.407920 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407416 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/86091880-c298-4359-9ca1-b513f2af0889-cnibin\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.407920 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407440 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96mjp\" (UniqueName: \"kubernetes.io/projected/184b7c0e-0bee-4207-a828-2b9df804266b-kube-api-access-96mjp\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.407920 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407453 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c600a59-9500-4e62-bc84-82da85a3b1bd-sys-fs\") pod \"aws-ebs-csi-driver-node-rf8nq\" (UID: \"8c600a59-9500-4e62-bc84-82da85a3b1bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.407920 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407463 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wg6l\" (UniqueName: \"kubernetes.io/projected/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-kube-api-access-4wg6l\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.407920 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407486 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-etc-kubernetes\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.407920 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407493 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/86091880-c298-4359-9ca1-b513f2af0889-cnibin\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.407920 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407508 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-sys\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.407920 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407531 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-run-openvswitch\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.407920 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407554 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/184b7c0e-0bee-4207-a828-2b9df804266b-env-overrides\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.408696 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407574 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-cnibin\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.408696 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407613 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/86091880-c298-4359-9ca1-b513f2af0889-cni-binary-copy\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.408696 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407647 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c600a59-9500-4e62-bc84-82da85a3b1bd-etc-selinux\") pod \"aws-ebs-csi-driver-node-rf8nq\" (UID: \"8c600a59-9500-4e62-bc84-82da85a3b1bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.408696 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407726 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k7n8\" (UniqueName: \"kubernetes.io/projected/5894c611-99f4-4459-8619-63305e3d25d1-kube-api-access-2k7n8\") pod \"network-metrics-daemon-f29s8\" (UID: \"5894c611-99f4-4459-8619-63305e3d25d1\") " pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:17.408696 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407755 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-host-run-netns\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.408696 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407818 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pwnj\" (UniqueName: \"kubernetes.io/projected/cc43fba5-dd78-4101-88e2-58f00af58ef1-kube-api-access-8pwnj\") pod \"node-resolver-27gsr\" (UID: \"cc43fba5-dd78-4101-88e2-58f00af58ef1\") " pod="openshift-dns/node-resolver-27gsr" Jul 28 00:01:17.408696 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407843 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-etc-systemd\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.408696 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407881 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/86091880-c298-4359-9ca1-b513f2af0889-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.408696 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407906 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/86091880-c298-4359-9ca1-b513f2af0889-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.408696 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407932 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.408696 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407959 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c600a59-9500-4e62-bc84-82da85a3b1bd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rf8nq\" (UID: \"8c600a59-9500-4e62-bc84-82da85a3b1bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.408696 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.407985 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/86091880-c298-4359-9ca1-b513f2af0889-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.408696 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408012 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngsrh\" (UniqueName: \"kubernetes.io/projected/86091880-c298-4359-9ca1-b513f2af0889-kube-api-access-ngsrh\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.408696 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408238 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/86091880-c298-4359-9ca1-b513f2af0889-cni-binary-copy\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.408696 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408243 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c600a59-9500-4e62-bc84-82da85a3b1bd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rf8nq\" (UID: \"8c600a59-9500-4e62-bc84-82da85a3b1bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.408696 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408430 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c600a59-9500-4e62-bc84-82da85a3b1bd-etc-selinux\") pod \"aws-ebs-csi-driver-node-rf8nq\" (UID: \"8c600a59-9500-4e62-bc84-82da85a3b1bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.409410 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408439 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/86091880-c298-4359-9ca1-b513f2af0889-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.409410 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408081 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-etc-openvswitch\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.409410 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408497 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/86091880-c298-4359-9ca1-b513f2af0889-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.409410 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408517 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/413bb2d5-d73f-4e81-b7fb-33dd3de573c2-host-slash\") pod \"iptables-alerter-hdmsb\" (UID: \"413bb2d5-d73f-4e81-b7fb-33dd3de573c2\") " pod="openshift-network-operator/iptables-alerter-hdmsb" Jul 28 00:01:17.409410 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408542 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-var-lib-kubelet\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.409410 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408582 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret\") pod \"global-pull-secret-syncer-n56zd\" (UID: \"361a09af-a231-45f9-8332-fbd085df9a5f\") " pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:17.409410 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408601 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0823e600-8868-4c59-b929-7d0a7ae34711-serviceca\") pod \"node-ca-ckjf9\" (UID: \"0823e600-8868-4c59-b929-7d0a7ae34711\") " pod="openshift-image-registry/node-ca-ckjf9" Jul 28 00:01:17.409410 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408621 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-run-systemd\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.409410 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408644 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/184b7c0e-0bee-4207-a828-2b9df804266b-ovn-node-metrics-cert\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.409410 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408670 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-multus-cni-dir\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.409410 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408685 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-host-var-lib-cni-multus\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.409410 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:17.408690 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:17.409410 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408699 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/86091880-c298-4359-9ca1-b513f2af0889-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.409410 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408705 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-etc-sysconfig\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.409410 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408752 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-lib-modules\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.409410 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:17.408796 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret podName:361a09af-a231-45f9-8332-fbd085df9a5f nodeName:}" failed. No retries permitted until 2026-07-28 00:01:17.908745651 +0000 UTC m=+3.025251063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret") pod "global-pull-secret-syncer-n56zd" (UID: "361a09af-a231-45f9-8332-fbd085df9a5f") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:17.409928 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408833 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-host\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.409928 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408858 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75ab6b83-7e76-44aa-b4a0-0766b1c60382-tmp\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.409928 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408890 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c600a59-9500-4e62-bc84-82da85a3b1bd-registration-dir\") pod \"aws-ebs-csi-driver-node-rf8nq\" (UID: \"8c600a59-9500-4e62-bc84-82da85a3b1bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.409928 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408916 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/86091880-c298-4359-9ca1-b513f2af0889-os-release\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.409928 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408940 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-os-release\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.409928 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408974 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/413bb2d5-d73f-4e81-b7fb-33dd3de573c2-iptables-alerter-script\") pod \"iptables-alerter-hdmsb\" (UID: \"413bb2d5-d73f-4e81-b7fb-33dd3de573c2\") " pod="openshift-network-operator/iptables-alerter-hdmsb" Jul 28 00:01:17.409928 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.409000 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-multus-socket-dir-parent\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.409928 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408999 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/86091880-c298-4359-9ca1-b513f2af0889-os-release\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.409928 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.408998 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c600a59-9500-4e62-bc84-82da85a3b1bd-registration-dir\") pod \"aws-ebs-csi-driver-node-rf8nq\" (UID: \"8c600a59-9500-4e62-bc84-82da85a3b1bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.409928 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.409033 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs\") pod \"network-metrics-daemon-f29s8\" (UID: \"5894c611-99f4-4459-8619-63305e3d25d1\") " pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:17.409928 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.409057 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0823e600-8868-4c59-b929-7d0a7ae34711-serviceca\") pod \"node-ca-ckjf9\" (UID: \"0823e600-8868-4c59-b929-7d0a7ae34711\") " pod="openshift-image-registry/node-ca-ckjf9" Jul 28 00:01:17.409928 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.409067 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-run-ovn\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.409928 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:17.409097 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:17.409928 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:17.409137 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs podName:5894c611-99f4-4459-8619-63305e3d25d1 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:17.909124216 +0000 UTC m=+3.025629610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs") pod "network-metrics-daemon-f29s8" (UID: "5894c611-99f4-4459-8619-63305e3d25d1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:17.409928 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.409098 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/184b7c0e-0bee-4207-a828-2b9df804266b-ovnkube-config\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.409928 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.409171 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-system-cni-dir\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.409928 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.409198 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-multus-conf-dir\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.410445 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.409221 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-host-run-multus-certs\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.410445 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.409252 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkgrs\" (UniqueName: \"kubernetes.io/projected/413bb2d5-d73f-4e81-b7fb-33dd3de573c2-kube-api-access-qkgrs\") pod \"iptables-alerter-hdmsb\" (UID: \"413bb2d5-d73f-4e81-b7fb-33dd3de573c2\") " pod="openshift-network-operator/iptables-alerter-hdmsb" Jul 28 00:01:17.410445 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.409274 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-log-socket\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.413090 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.413030 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 00:01:17.413202 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:17.413118 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:17.413202 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:17.413134 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:17.413202 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:17.413146 2574 projected.go:196] Error preparing data for projected volume kube-api-access-5w4sp for pod openshift-network-diagnostics/network-check-target-dflsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:17.413354 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:17.413213 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp podName:65d808ec-5de9-4dfa-9c3e-e45a41f3ccde nodeName:}" failed. No retries permitted until 2026-07-28 00:01:17.913200181 +0000 UTC m=+3.029705575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5w4sp" (UniqueName: "kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp") pod "network-check-target-dflsn" (UID: "65d808ec-5de9-4dfa-9c3e-e45a41f3ccde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:17.417326 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.417305 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngsrh\" (UniqueName: \"kubernetes.io/projected/86091880-c298-4359-9ca1-b513f2af0889-kube-api-access-ngsrh\") pod \"multus-additional-cni-plugins-dl5vz\" (UID: \"86091880-c298-4359-9ca1-b513f2af0889\") " pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.417428 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.417322 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nffl2\" (UniqueName: \"kubernetes.io/projected/8c600a59-9500-4e62-bc84-82da85a3b1bd-kube-api-access-nffl2\") pod \"aws-ebs-csi-driver-node-rf8nq\" (UID: \"8c600a59-9500-4e62-bc84-82da85a3b1bd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.417428 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.417342 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pwnj\" (UniqueName: \"kubernetes.io/projected/cc43fba5-dd78-4101-88e2-58f00af58ef1-kube-api-access-8pwnj\") pod \"node-resolver-27gsr\" (UID: \"cc43fba5-dd78-4101-88e2-58f00af58ef1\") " pod="openshift-dns/node-resolver-27gsr" Jul 28 00:01:17.417862 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.417846 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k7n8\" (UniqueName: \"kubernetes.io/projected/5894c611-99f4-4459-8619-63305e3d25d1-kube-api-access-2k7n8\") pod \"network-metrics-daemon-f29s8\" (UID: \"5894c611-99f4-4459-8619-63305e3d25d1\") " pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:17.417960 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.417942 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29mkd\" (UniqueName: \"kubernetes.io/projected/0823e600-8868-4c59-b929-7d0a7ae34711-kube-api-access-29mkd\") pod \"node-ca-ckjf9\" (UID: \"0823e600-8868-4c59-b929-7d0a7ae34711\") " pod="openshift-image-registry/node-ca-ckjf9" Jul 28 00:01:17.510042 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.509557 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96mjp\" (UniqueName: \"kubernetes.io/projected/184b7c0e-0bee-4207-a828-2b9df804266b-kube-api-access-96mjp\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.510042 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.509598 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wg6l\" (UniqueName: \"kubernetes.io/projected/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-kube-api-access-4wg6l\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.510042 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.509622 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-etc-kubernetes\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.510042 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.509646 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-sys\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.510042 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.509723 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-etc-kubernetes\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.510042 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.509773 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-run-openvswitch\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.510042 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.509808 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/184b7c0e-0bee-4207-a828-2b9df804266b-env-overrides\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.510042 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.509833 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-cnibin\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.510042 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.509850 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-sys\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.510042 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.509858 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-host-run-netns\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.510042 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.509895 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-host-run-netns\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.510042 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.509902 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-run-openvswitch\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.510042 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.509910 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-etc-systemd\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.510042 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.509946 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-etc-systemd\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.510042 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.509948 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.510042 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.509993 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-cnibin\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.510042 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.509998 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.510988 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510084 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-etc-openvswitch\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.510988 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510101 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-etc-openvswitch\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.510988 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510160 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/413bb2d5-d73f-4e81-b7fb-33dd3de573c2-host-slash\") pod \"iptables-alerter-hdmsb\" (UID: \"413bb2d5-d73f-4e81-b7fb-33dd3de573c2\") " pod="openshift-network-operator/iptables-alerter-hdmsb" Jul 28 00:01:17.510988 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510186 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-var-lib-kubelet\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.510988 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510226 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-run-systemd\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.510988 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510276 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-run-systemd\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.510988 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510281 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/413bb2d5-d73f-4e81-b7fb-33dd3de573c2-host-slash\") pod \"iptables-alerter-hdmsb\" (UID: \"413bb2d5-d73f-4e81-b7fb-33dd3de573c2\") " pod="openshift-network-operator/iptables-alerter-hdmsb" Jul 28 00:01:17.510988 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510325 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/184b7c0e-0bee-4207-a828-2b9df804266b-ovn-node-metrics-cert\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.510988 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510329 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-var-lib-kubelet\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.510988 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510345 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-multus-cni-dir\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.510988 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510367 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-host-var-lib-cni-multus\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.510988 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510388 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-etc-sysconfig\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.510988 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510403 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-lib-modules\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.510988 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510417 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-host\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.510988 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510416 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/184b7c0e-0bee-4207-a828-2b9df804266b-env-overrides\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.510988 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510424 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-multus-cni-dir\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.510988 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510431 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75ab6b83-7e76-44aa-b4a0-0766b1c60382-tmp\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.510988 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510473 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-os-release\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.511725 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510486 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-etc-sysconfig\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.511725 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510493 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-host-var-lib-cni-multus\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.511725 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510499 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/413bb2d5-d73f-4e81-b7fb-33dd3de573c2-iptables-alerter-script\") pod \"iptables-alerter-hdmsb\" (UID: \"413bb2d5-d73f-4e81-b7fb-33dd3de573c2\") " pod="openshift-network-operator/iptables-alerter-hdmsb" Jul 28 00:01:17.511725 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510526 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-multus-socket-dir-parent\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.511725 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510564 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-run-ovn\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.511725 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510549 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-os-release\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.511725 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510588 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/184b7c0e-0bee-4207-a828-2b9df804266b-ovnkube-config\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.511725 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510604 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-system-cni-dir\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.511725 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510626 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-multus-socket-dir-parent\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.511725 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510670 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-system-cni-dir\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.511725 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510708 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-multus-conf-dir\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.511725 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510733 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-host-run-multus-certs\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.511725 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510779 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-run-ovn\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.511725 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510813 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkgrs\" (UniqueName: \"kubernetes.io/projected/413bb2d5-d73f-4e81-b7fb-33dd3de573c2-kube-api-access-qkgrs\") pod \"iptables-alerter-hdmsb\" (UID: \"413bb2d5-d73f-4e81-b7fb-33dd3de573c2\") " pod="openshift-network-operator/iptables-alerter-hdmsb" Jul 28 00:01:17.511725 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510828 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-host-run-multus-certs\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.511725 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510832 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-lib-modules\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.511725 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510843 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-log-socket\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.511725 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510859 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-multus-conf-dir\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.512581 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.510979 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-log-socket\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.512581 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511011 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-host-run-ovn-kubernetes\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.512581 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511042 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-systemd-units\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.512581 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511042 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-host\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.512581 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511024 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/413bb2d5-d73f-4e81-b7fb-33dd3de573c2-iptables-alerter-script\") pod \"iptables-alerter-hdmsb\" (UID: \"413bb2d5-d73f-4e81-b7fb-33dd3de573c2\") " pod="openshift-network-operator/iptables-alerter-hdmsb" Jul 28 00:01:17.512581 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511073 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-host-slash\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.512581 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511099 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-host-var-lib-kubelet\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.512581 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511103 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-systemd-units\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.512581 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511097 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/184b7c0e-0bee-4207-a828-2b9df804266b-ovnkube-config\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.512581 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511125 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-host-run-ovn-kubernetes\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.512581 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511141 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-host-slash\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.512581 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511144 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-host-var-lib-kubelet\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.512581 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511165 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/184b7c0e-0bee-4207-a828-2b9df804266b-ovnkube-script-lib\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.512581 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511197 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-cni-binary-copy\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.512581 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511225 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-etc-kubernetes\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.512581 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511256 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-etc-modprobe-d\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.512581 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511285 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkfxn\" (UniqueName: \"kubernetes.io/projected/75ab6b83-7e76-44aa-b4a0-0766b1c60382-kube-api-access-pkfxn\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.512581 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511297 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-etc-kubernetes\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.513358 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511312 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a6a63750-e30c-4a77-bbbf-38498587808f-agent-certs\") pod \"konnectivity-agent-sx88w\" (UID: \"a6a63750-e30c-4a77-bbbf-38498587808f\") " pod="kube-system/konnectivity-agent-sx88w" Jul 28 00:01:17.513358 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511339 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-etc-sysctl-conf\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.513358 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511369 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-run\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.513358 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511401 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-etc-modprobe-d\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.513358 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511404 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-host-run-netns\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.513358 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511434 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-var-lib-openvswitch\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.513358 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511460 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-node-log\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.513358 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511484 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-host-run-k8s-cni-cncf-io\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.513358 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.513085 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-cni-binary-copy\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.513358 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.513226 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/184b7c0e-0bee-4207-a828-2b9df804266b-ovnkube-script-lib\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.513358 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.511511 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-hostroot\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.513358 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.513296 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a6a63750-e30c-4a77-bbbf-38498587808f-konnectivity-ca\") pod \"konnectivity-agent-sx88w\" (UID: \"a6a63750-e30c-4a77-bbbf-38498587808f\") " pod="kube-system/konnectivity-agent-sx88w" Jul 28 00:01:17.513358 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.513331 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-etc-sysctl-d\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.513358 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.513360 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/75ab6b83-7e76-44aa-b4a0-0766b1c60382-etc-tuned\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.514032 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.513391 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-host-cni-bin\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.514032 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.513424 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-host-cni-netd\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.514032 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.513455 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-host-var-lib-cni-bin\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.514032 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.513481 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-multus-daemon-config\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.514032 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.513516 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-host-kubelet\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.514032 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.513638 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-host-kubelet\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.514303 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.514139 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a6a63750-e30c-4a77-bbbf-38498587808f-konnectivity-ca\") pod \"konnectivity-agent-sx88w\" (UID: \"a6a63750-e30c-4a77-bbbf-38498587808f\") " pod="kube-system/konnectivity-agent-sx88w" Jul 28 00:01:17.514303 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.514297 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-etc-sysctl-d\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.514496 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.514467 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-host-run-netns\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.515113 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.514635 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-etc-sysctl-conf\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.515113 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.514701 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/75ab6b83-7e76-44aa-b4a0-0766b1c60382-run\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.515113 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.514785 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-host-cni-netd\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.515113 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.514839 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-host-cni-bin\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.515113 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.514888 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-node-log\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.515113 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.514941 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/184b7c0e-0bee-4207-a828-2b9df804266b-var-lib-openvswitch\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.515435 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.515228 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-host-var-lib-cni-bin\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.515435 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.515355 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75ab6b83-7e76-44aa-b4a0-0766b1c60382-tmp\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.515750 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.515639 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-host-run-k8s-cni-cncf-io\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.515858 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.515747 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-multus-daemon-config\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.515907 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.515896 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-hostroot\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.516073 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.516036 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/184b7c0e-0bee-4207-a828-2b9df804266b-ovn-node-metrics-cert\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.520141 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.520001 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96mjp\" (UniqueName: \"kubernetes.io/projected/184b7c0e-0bee-4207-a828-2b9df804266b-kube-api-access-96mjp\") pod \"ovnkube-node-md25x\" (UID: \"184b7c0e-0bee-4207-a828-2b9df804266b\") " pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.520684 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.520663 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkgrs\" (UniqueName: \"kubernetes.io/projected/413bb2d5-d73f-4e81-b7fb-33dd3de573c2-kube-api-access-qkgrs\") pod \"iptables-alerter-hdmsb\" (UID: \"413bb2d5-d73f-4e81-b7fb-33dd3de573c2\") " pod="openshift-network-operator/iptables-alerter-hdmsb" Jul 28 00:01:17.523259 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.523060 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkfxn\" (UniqueName: \"kubernetes.io/projected/75ab6b83-7e76-44aa-b4a0-0766b1c60382-kube-api-access-pkfxn\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.523410 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.523266 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/75ab6b83-7e76-44aa-b4a0-0766b1c60382-etc-tuned\") pod \"tuned-45jgc\" (UID: \"75ab6b83-7e76-44aa-b4a0-0766b1c60382\") " pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.525482 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.525460 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a6a63750-e30c-4a77-bbbf-38498587808f-agent-certs\") pod \"konnectivity-agent-sx88w\" (UID: \"a6a63750-e30c-4a77-bbbf-38498587808f\") " pod="kube-system/konnectivity-agent-sx88w" Jul 28 00:01:17.525792 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.525749 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wg6l\" (UniqueName: \"kubernetes.io/projected/43ed315f-8fbe-4ed0-bec3-53df8ab99e50-kube-api-access-4wg6l\") pod \"multus-gpmnb\" (UID: \"43ed315f-8fbe-4ed0-bec3-53df8ab99e50\") " pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.594643 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.594595 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dl5vz" Jul 28 00:01:17.603249 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.603046 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" Jul 28 00:01:17.606508 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:17.606472 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86091880_c298_4359_9ca1_b513f2af0889.slice/crio-74b8bc76fa2ed4a439e68e50aa524e258e68fb3a7559188337d7fa22048c16c2 WatchSource:0}: Error finding container 74b8bc76fa2ed4a439e68e50aa524e258e68fb3a7559188337d7fa22048c16c2: Status 404 returned error can't find the container with id 74b8bc76fa2ed4a439e68e50aa524e258e68fb3a7559188337d7fa22048c16c2 Jul 28 00:01:17.612522 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.612354 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-27gsr" Jul 28 00:01:17.612781 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:17.612742 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c600a59_9500_4e62_bc84_82da85a3b1bd.slice/crio-8497c94a367b6c8ec51cc3a7981b173129c39cd2c202848b965b7d821a0ceb76 WatchSource:0}: Error finding container 8497c94a367b6c8ec51cc3a7981b173129c39cd2c202848b965b7d821a0ceb76: Status 404 returned error can't find the container with id 8497c94a367b6c8ec51cc3a7981b173129c39cd2c202848b965b7d821a0ceb76 Jul 28 00:01:17.618025 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.617989 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ckjf9" Jul 28 00:01:17.622558 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.622539 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:17.623641 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:17.623615 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc43fba5_dd78_4101_88e2_58f00af58ef1.slice/crio-430f4c146aee77cd2faa7da37bbe1fa5f59d7bb8e54556afe4cb8190ccb36acf WatchSource:0}: Error finding container 430f4c146aee77cd2faa7da37bbe1fa5f59d7bb8e54556afe4cb8190ccb36acf: Status 404 returned error can't find the container with id 430f4c146aee77cd2faa7da37bbe1fa5f59d7bb8e54556afe4cb8190ccb36acf Jul 28 00:01:17.628752 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.628728 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hdmsb" Jul 28 00:01:17.629967 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:17.629943 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0823e600_8868_4c59_b929_7d0a7ae34711.slice/crio-dcb97ea1b857e6fdc5d2a3309c562ad62d2be5223b9008ea294c64f248c78b83 WatchSource:0}: Error finding container dcb97ea1b857e6fdc5d2a3309c562ad62d2be5223b9008ea294c64f248c78b83: Status 404 returned error can't find the container with id dcb97ea1b857e6fdc5d2a3309c562ad62d2be5223b9008ea294c64f248c78b83 Jul 28 00:01:17.633122 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:17.633096 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod184b7c0e_0bee_4207_a828_2b9df804266b.slice/crio-47dabd84baaebb13f8338ff1b8c57f6f97d51bc5537537c50383328230393858 WatchSource:0}: Error finding container 47dabd84baaebb13f8338ff1b8c57f6f97d51bc5537537c50383328230393858: Status 404 returned error can't find the container with id 47dabd84baaebb13f8338ff1b8c57f6f97d51bc5537537c50383328230393858 Jul 28 00:01:17.633863 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.633823 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sx88w" Jul 28 00:01:17.639156 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.639136 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-45jgc" Jul 28 00:01:17.639364 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:17.639340 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod413bb2d5_d73f_4e81_b7fb_33dd3de573c2.slice/crio-8915fea9c67d7f42b43150c4fe3635a74d4fa17e5c40f3d832f57948d66c7170 WatchSource:0}: Error finding container 8915fea9c67d7f42b43150c4fe3635a74d4fa17e5c40f3d832f57948d66c7170: Status 404 returned error can't find the container with id 8915fea9c67d7f42b43150c4fe3635a74d4fa17e5c40f3d832f57948d66c7170 Jul 28 00:01:17.643900 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.643879 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gpmnb" Jul 28 00:01:17.645798 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:17.645731 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6a63750_e30c_4a77_bbbf_38498587808f.slice/crio-ffe4d1151a8cd5e00758fb35f02fac6ef3f9ddff64dbbedb2b4c5ae2a7e08f03 WatchSource:0}: Error finding container ffe4d1151a8cd5e00758fb35f02fac6ef3f9ddff64dbbedb2b4c5ae2a7e08f03: Status 404 returned error can't find the container with id ffe4d1151a8cd5e00758fb35f02fac6ef3f9ddff64dbbedb2b4c5ae2a7e08f03 Jul 28 00:01:17.655005 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:17.654980 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75ab6b83_7e76_44aa_b4a0_0766b1c60382.slice/crio-fe63bef412009aa9baf6c34ab3356e85c6b2d7624d9a0875642fe26054f3ef29 WatchSource:0}: Error finding container fe63bef412009aa9baf6c34ab3356e85c6b2d7624d9a0875642fe26054f3ef29: Status 404 returned error can't find the container with id fe63bef412009aa9baf6c34ab3356e85c6b2d7624d9a0875642fe26054f3ef29 Jul 28 00:01:17.659276 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:17.659251 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43ed315f_8fbe_4ed0_bec3_53df8ab99e50.slice/crio-fb76693644382728d28dfaf72a6b484681aebf5c1d8bad031997877c61f76b1c WatchSource:0}: Error finding container fb76693644382728d28dfaf72a6b484681aebf5c1d8bad031997877c61f76b1c: Status 404 returned error can't find the container with id fb76693644382728d28dfaf72a6b484681aebf5c1d8bad031997877c61f76b1c Jul 28 00:01:17.916454 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.916365 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w4sp\" (UniqueName: \"kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp\") pod \"network-check-target-dflsn\" (UID: \"65d808ec-5de9-4dfa-9c3e-e45a41f3ccde\") " pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:17.916454 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.916427 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret\") pod \"global-pull-secret-syncer-n56zd\" (UID: \"361a09af-a231-45f9-8332-fbd085df9a5f\") " pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:17.916672 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:17.916464 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs\") pod \"network-metrics-daemon-f29s8\" (UID: \"5894c611-99f4-4459-8619-63305e3d25d1\") " pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:17.916672 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:17.916556 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:17.916672 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:17.916568 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:17.916672 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:17.916588 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:17.916672 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:17.916601 2574 projected.go:196] Error preparing data for projected volume kube-api-access-5w4sp for pod openshift-network-diagnostics/network-check-target-dflsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:17.916672 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:17.916555 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:17.916672 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:17.916624 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs podName:5894c611-99f4-4459-8619-63305e3d25d1 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:18.916605005 +0000 UTC m=+4.033110403 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs") pod "network-metrics-daemon-f29s8" (UID: "5894c611-99f4-4459-8619-63305e3d25d1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:17.916672 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:17.916649 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp podName:65d808ec-5de9-4dfa-9c3e-e45a41f3ccde nodeName:}" failed. No retries permitted until 2026-07-28 00:01:18.916632226 +0000 UTC m=+4.033137629 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5w4sp" (UniqueName: "kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp") pod "network-check-target-dflsn" (UID: "65d808ec-5de9-4dfa-9c3e-e45a41f3ccde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:17.916672 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:17.916669 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret podName:361a09af-a231-45f9-8332-fbd085df9a5f nodeName:}" failed. No retries permitted until 2026-07-28 00:01:18.91665912 +0000 UTC m=+4.033164515 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret") pod "global-pull-secret-syncer-n56zd" (UID: "361a09af-a231-45f9-8332-fbd085df9a5f") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:18.340078 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:18.339968 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 23:56:17 +0000 UTC" deadline="2028-03-29 04:37:07.323066603 +0000 UTC" Jul 28 00:01:18.340078 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:18.340028 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14644h35m48.983043333s" Jul 28 00:01:18.365450 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:18.365415 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:18.365634 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:18.365554 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n56zd" podUID="361a09af-a231-45f9-8332-fbd085df9a5f" Jul 28 00:01:18.374411 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:18.374373 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ckjf9" event={"ID":"0823e600-8868-4c59-b929-7d0a7ae34711","Type":"ContainerStarted","Data":"dcb97ea1b857e6fdc5d2a3309c562ad62d2be5223b9008ea294c64f248c78b83"} Jul 28 00:01:18.375711 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:18.375680 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-27gsr" event={"ID":"cc43fba5-dd78-4101-88e2-58f00af58ef1","Type":"ContainerStarted","Data":"430f4c146aee77cd2faa7da37bbe1fa5f59d7bb8e54556afe4cb8190ccb36acf"} Jul 28 00:01:18.376903 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:18.376875 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gpmnb" event={"ID":"43ed315f-8fbe-4ed0-bec3-53df8ab99e50","Type":"ContainerStarted","Data":"fb76693644382728d28dfaf72a6b484681aebf5c1d8bad031997877c61f76b1c"} Jul 28 00:01:18.378161 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:18.378131 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-45jgc" event={"ID":"75ab6b83-7e76-44aa-b4a0-0766b1c60382","Type":"ContainerStarted","Data":"fe63bef412009aa9baf6c34ab3356e85c6b2d7624d9a0875642fe26054f3ef29"} Jul 28 00:01:18.379307 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:18.379285 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sx88w" event={"ID":"a6a63750-e30c-4a77-bbbf-38498587808f","Type":"ContainerStarted","Data":"ffe4d1151a8cd5e00758fb35f02fac6ef3f9ddff64dbbedb2b4c5ae2a7e08f03"} Jul 28 00:01:18.380415 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:18.380393 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-md25x" event={"ID":"184b7c0e-0bee-4207-a828-2b9df804266b","Type":"ContainerStarted","Data":"47dabd84baaebb13f8338ff1b8c57f6f97d51bc5537537c50383328230393858"} Jul 28 00:01:18.381586 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:18.381565 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" event={"ID":"8c600a59-9500-4e62-bc84-82da85a3b1bd","Type":"ContainerStarted","Data":"8497c94a367b6c8ec51cc3a7981b173129c39cd2c202848b965b7d821a0ceb76"} Jul 28 00:01:18.382617 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:18.382595 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dl5vz" event={"ID":"86091880-c298-4359-9ca1-b513f2af0889","Type":"ContainerStarted","Data":"74b8bc76fa2ed4a439e68e50aa524e258e68fb3a7559188337d7fa22048c16c2"} Jul 28 00:01:18.383617 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:18.383594 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hdmsb" event={"ID":"413bb2d5-d73f-4e81-b7fb-33dd3de573c2","Type":"ContainerStarted","Data":"8915fea9c67d7f42b43150c4fe3635a74d4fa17e5c40f3d832f57948d66c7170"} Jul 28 00:01:18.925809 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:18.924891 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret\") pod \"global-pull-secret-syncer-n56zd\" (UID: \"361a09af-a231-45f9-8332-fbd085df9a5f\") " pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:18.925809 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:18.924952 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs\") pod \"network-metrics-daemon-f29s8\" (UID: \"5894c611-99f4-4459-8619-63305e3d25d1\") " pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:18.925809 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:18.925008 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w4sp\" (UniqueName: \"kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp\") pod \"network-check-target-dflsn\" (UID: \"65d808ec-5de9-4dfa-9c3e-e45a41f3ccde\") " pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:18.925809 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:18.925154 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:18.925809 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:18.925172 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:18.925809 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:18.925185 2574 projected.go:196] Error preparing data for projected volume kube-api-access-5w4sp for pod openshift-network-diagnostics/network-check-target-dflsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:18.925809 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:18.925243 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp podName:65d808ec-5de9-4dfa-9c3e-e45a41f3ccde nodeName:}" failed. No retries permitted until 2026-07-28 00:01:20.925224408 +0000 UTC m=+6.041729803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5w4sp" (UniqueName: "kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp") pod "network-check-target-dflsn" (UID: "65d808ec-5de9-4dfa-9c3e-e45a41f3ccde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:18.925809 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:18.925621 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:18.925809 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:18.925673 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret podName:361a09af-a231-45f9-8332-fbd085df9a5f nodeName:}" failed. No retries permitted until 2026-07-28 00:01:20.925656737 +0000 UTC m=+6.042162132 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret") pod "global-pull-secret-syncer-n56zd" (UID: "361a09af-a231-45f9-8332-fbd085df9a5f") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:18.925809 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:18.925726 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:18.926503 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:18.926471 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs podName:5894c611-99f4-4459-8619-63305e3d25d1 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:20.925748507 +0000 UTC m=+6.042253901 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs") pod "network-metrics-daemon-f29s8" (UID: "5894c611-99f4-4459-8619-63305e3d25d1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:19.340569 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:19.340226 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 23:56:17 +0000 UTC" deadline="2028-03-25 16:31:46.195070853 +0000 UTC" Jul 28 00:01:19.340569 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:19.340487 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14560h30m26.854589905s" Jul 28 00:01:19.366887 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:19.366857 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:19.367035 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:19.366991 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflsn" podUID="65d808ec-5de9-4dfa-9c3e-e45a41f3ccde" Jul 28 00:01:19.367579 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:19.367432 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:19.367579 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:19.367546 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f29s8" podUID="5894c611-99f4-4459-8619-63305e3d25d1" Jul 28 00:01:19.394054 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:19.393990 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" event={"ID":"b1c9672097d54576fb7cce42c7e502c6","Type":"ContainerStarted","Data":"60cebf206d4f79c1ce9550e152331e59c4f5f3312e5789e27cf34b0eea990a63"} Jul 28 00:01:20.365276 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:20.365193 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:20.365740 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:20.365331 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n56zd" podUID="361a09af-a231-45f9-8332-fbd085df9a5f" Jul 28 00:01:20.408393 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:20.407204 2574 generic.go:356] "Generic (PLEG): container finished" podID="b46af047627177c30ef30b48f0650e79" containerID="20eaba18965ebb5fba2d5c0450d3cebd2afbea32492acf0695ef0826697618c9" exitCode=0 Jul 28 00:01:20.408393 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:20.408152 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" event={"ID":"b46af047627177c30ef30b48f0650e79","Type":"ContainerDied","Data":"20eaba18965ebb5fba2d5c0450d3cebd2afbea32492acf0695ef0826697618c9"} Jul 28 00:01:20.435368 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:20.432652 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" podStartSLOduration=4.432631584 podStartE2EDuration="4.432631584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:19.410697213 +0000 UTC m=+4.527202632" watchObservedRunningTime="2026-07-28 00:01:20.432631584 +0000 UTC m=+5.549136997" Jul 28 00:01:20.943220 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:20.943178 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w4sp\" (UniqueName: \"kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp\") pod \"network-check-target-dflsn\" (UID: \"65d808ec-5de9-4dfa-9c3e-e45a41f3ccde\") " pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:20.943418 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:20.943249 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret\") pod \"global-pull-secret-syncer-n56zd\" (UID: \"361a09af-a231-45f9-8332-fbd085df9a5f\") " pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:20.943418 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:20.943285 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs\") pod \"network-metrics-daemon-f29s8\" (UID: \"5894c611-99f4-4459-8619-63305e3d25d1\") " pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:20.943538 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:20.943432 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:20.943538 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:20.943489 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs podName:5894c611-99f4-4459-8619-63305e3d25d1 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:24.943470221 +0000 UTC m=+10.059975619 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs") pod "network-metrics-daemon-f29s8" (UID: "5894c611-99f4-4459-8619-63305e3d25d1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:20.943944 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:20.943923 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:20.944043 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:20.943948 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:20.944043 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:20.943960 2574 projected.go:196] Error preparing data for projected volume kube-api-access-5w4sp for pod openshift-network-diagnostics/network-check-target-dflsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:20.944043 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:20.944006 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp podName:65d808ec-5de9-4dfa-9c3e-e45a41f3ccde nodeName:}" failed. No retries permitted until 2026-07-28 00:01:24.943991562 +0000 UTC m=+10.060496967 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5w4sp" (UniqueName: "kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp") pod "network-check-target-dflsn" (UID: "65d808ec-5de9-4dfa-9c3e-e45a41f3ccde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:20.944210 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:20.944074 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:20.944210 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:20.944107 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret podName:361a09af-a231-45f9-8332-fbd085df9a5f nodeName:}" failed. No retries permitted until 2026-07-28 00:01:24.944096596 +0000 UTC m=+10.060601989 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret") pod "global-pull-secret-syncer-n56zd" (UID: "361a09af-a231-45f9-8332-fbd085df9a5f") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:21.365982 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:21.365870 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:21.366541 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:21.365999 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflsn" podUID="65d808ec-5de9-4dfa-9c3e-e45a41f3ccde" Jul 28 00:01:21.366541 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:21.366494 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:21.366680 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:21.366602 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f29s8" podUID="5894c611-99f4-4459-8619-63305e3d25d1" Jul 28 00:01:22.365433 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:22.365401 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:22.365607 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:22.365584 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n56zd" podUID="361a09af-a231-45f9-8332-fbd085df9a5f" Jul 28 00:01:23.365015 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:23.364975 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:23.365495 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:23.364983 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:23.365495 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:23.365107 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflsn" podUID="65d808ec-5de9-4dfa-9c3e-e45a41f3ccde" Jul 28 00:01:23.365495 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:23.365188 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f29s8" podUID="5894c611-99f4-4459-8619-63305e3d25d1" Jul 28 00:01:24.365341 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:24.365261 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:24.365840 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:24.365369 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n56zd" podUID="361a09af-a231-45f9-8332-fbd085df9a5f" Jul 28 00:01:24.976156 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:24.975975 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w4sp\" (UniqueName: \"kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp\") pod \"network-check-target-dflsn\" (UID: \"65d808ec-5de9-4dfa-9c3e-e45a41f3ccde\") " pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:24.976156 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:24.976039 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret\") pod \"global-pull-secret-syncer-n56zd\" (UID: \"361a09af-a231-45f9-8332-fbd085df9a5f\") " pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:24.976156 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:24.976074 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs\") pod \"network-metrics-daemon-f29s8\" (UID: \"5894c611-99f4-4459-8619-63305e3d25d1\") " pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:24.976446 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:24.976176 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:24.976446 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:24.976202 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:24.976446 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:24.976217 2574 projected.go:196] Error preparing data for projected volume kube-api-access-5w4sp for pod openshift-network-diagnostics/network-check-target-dflsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:24.976446 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:24.976231 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:24.976446 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:24.976281 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp podName:65d808ec-5de9-4dfa-9c3e-e45a41f3ccde nodeName:}" failed. No retries permitted until 2026-07-28 00:01:32.976262366 +0000 UTC m=+18.092767778 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5w4sp" (UniqueName: "kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp") pod "network-check-target-dflsn" (UID: "65d808ec-5de9-4dfa-9c3e-e45a41f3ccde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:24.976446 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:24.976304 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs podName:5894c611-99f4-4459-8619-63305e3d25d1 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:32.976293309 +0000 UTC m=+18.092798706 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs") pod "network-metrics-daemon-f29s8" (UID: "5894c611-99f4-4459-8619-63305e3d25d1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:24.976446 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:24.976316 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:24.976446 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:24.976353 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret podName:361a09af-a231-45f9-8332-fbd085df9a5f nodeName:}" failed. No retries permitted until 2026-07-28 00:01:32.976336166 +0000 UTC m=+18.092841557 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret") pod "global-pull-secret-syncer-n56zd" (UID: "361a09af-a231-45f9-8332-fbd085df9a5f") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:25.367034 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:25.366959 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:25.367452 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:25.367177 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflsn" podUID="65d808ec-5de9-4dfa-9c3e-e45a41f3ccde" Jul 28 00:01:25.367529 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:25.367515 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:25.367651 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:25.367626 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f29s8" podUID="5894c611-99f4-4459-8619-63305e3d25d1" Jul 28 00:01:26.365380 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:26.364857 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:26.365380 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:26.364996 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n56zd" podUID="361a09af-a231-45f9-8332-fbd085df9a5f" Jul 28 00:01:27.365038 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:27.364868 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:27.365038 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:27.365004 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflsn" podUID="65d808ec-5de9-4dfa-9c3e-e45a41f3ccde" Jul 28 00:01:27.365572 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:27.365136 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:27.365572 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:27.365234 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f29s8" podUID="5894c611-99f4-4459-8619-63305e3d25d1" Jul 28 00:01:28.364577 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:28.364496 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:28.364739 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:28.364628 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n56zd" podUID="361a09af-a231-45f9-8332-fbd085df9a5f" Jul 28 00:01:29.364901 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:29.364859 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:29.364901 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:29.364900 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:29.365415 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:29.365008 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflsn" podUID="65d808ec-5de9-4dfa-9c3e-e45a41f3ccde" Jul 28 00:01:29.365415 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:29.365147 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f29s8" podUID="5894c611-99f4-4459-8619-63305e3d25d1" Jul 28 00:01:30.364609 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:30.364571 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:30.364812 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:30.364694 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n56zd" podUID="361a09af-a231-45f9-8332-fbd085df9a5f" Jul 28 00:01:31.365223 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:31.365185 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:31.365699 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:31.365185 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:31.365699 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:31.365328 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflsn" podUID="65d808ec-5de9-4dfa-9c3e-e45a41f3ccde" Jul 28 00:01:31.365699 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:31.365374 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f29s8" podUID="5894c611-99f4-4459-8619-63305e3d25d1" Jul 28 00:01:32.365562 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:32.365517 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:32.366087 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:32.365656 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n56zd" podUID="361a09af-a231-45f9-8332-fbd085df9a5f" Jul 28 00:01:33.041993 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:33.041942 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w4sp\" (UniqueName: \"kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp\") pod \"network-check-target-dflsn\" (UID: \"65d808ec-5de9-4dfa-9c3e-e45a41f3ccde\") " pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:33.042185 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:33.042096 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret\") pod \"global-pull-secret-syncer-n56zd\" (UID: \"361a09af-a231-45f9-8332-fbd085df9a5f\") " pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:33.042185 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:33.042134 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs\") pod \"network-metrics-daemon-f29s8\" (UID: \"5894c611-99f4-4459-8619-63305e3d25d1\") " pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:33.042185 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:33.042137 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:33.042185 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:33.042166 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:33.042185 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:33.042180 2574 projected.go:196] Error preparing data for projected volume kube-api-access-5w4sp for pod openshift-network-diagnostics/network-check-target-dflsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:33.042368 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:33.042245 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp podName:65d808ec-5de9-4dfa-9c3e-e45a41f3ccde nodeName:}" failed. No retries permitted until 2026-07-28 00:01:49.042224639 +0000 UTC m=+34.158730031 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5w4sp" (UniqueName: "kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp") pod "network-check-target-dflsn" (UID: "65d808ec-5de9-4dfa-9c3e-e45a41f3ccde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:33.042368 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:33.042259 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:33.042368 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:33.042310 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs podName:5894c611-99f4-4459-8619-63305e3d25d1 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:49.042292616 +0000 UTC m=+34.158798009 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs") pod "network-metrics-daemon-f29s8" (UID: "5894c611-99f4-4459-8619-63305e3d25d1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:33.042368 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:33.042368 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:33.042513 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:33.042401 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret podName:361a09af-a231-45f9-8332-fbd085df9a5f nodeName:}" failed. No retries permitted until 2026-07-28 00:01:49.042390178 +0000 UTC m=+34.158895572 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret") pod "global-pull-secret-syncer-n56zd" (UID: "361a09af-a231-45f9-8332-fbd085df9a5f") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:33.365368 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:33.365278 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:33.365368 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:33.365279 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:33.365626 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:33.365428 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f29s8" podUID="5894c611-99f4-4459-8619-63305e3d25d1" Jul 28 00:01:33.365626 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:33.365516 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflsn" podUID="65d808ec-5de9-4dfa-9c3e-e45a41f3ccde" Jul 28 00:01:34.365369 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:34.365329 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:34.365548 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:34.365446 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n56zd" podUID="361a09af-a231-45f9-8332-fbd085df9a5f" Jul 28 00:01:35.366066 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:35.366029 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:35.366493 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:35.366172 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflsn" podUID="65d808ec-5de9-4dfa-9c3e-e45a41f3ccde" Jul 28 00:01:35.366493 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:35.366210 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:35.366493 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:35.366309 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f29s8" podUID="5894c611-99f4-4459-8619-63305e3d25d1" Jul 28 00:01:36.365192 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:36.365154 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:36.365375 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:36.365284 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n56zd" podUID="361a09af-a231-45f9-8332-fbd085df9a5f" Jul 28 00:01:37.364896 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:37.364582 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:37.365555 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:37.364579 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:37.365555 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:37.364980 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f29s8" podUID="5894c611-99f4-4459-8619-63305e3d25d1" Jul 28 00:01:37.365555 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:37.365055 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflsn" podUID="65d808ec-5de9-4dfa-9c3e-e45a41f3ccde" Jul 28 00:01:37.444216 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:37.444188 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gpmnb" event={"ID":"43ed315f-8fbe-4ed0-bec3-53df8ab99e50","Type":"ContainerStarted","Data":"3e7ede4c7624713c1f8d7a67d2b821465e8e090a98d3c7c79860fd6a0effb8e7"} Jul 28 00:01:37.445634 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:37.445608 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-45jgc" event={"ID":"75ab6b83-7e76-44aa-b4a0-0766b1c60382","Type":"ContainerStarted","Data":"767782e269ce682d77c411562b85a2f3307f3b7c1e6884f716c4d5e01b9d6f03"} Jul 28 00:01:37.447069 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:37.447045 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sx88w" event={"ID":"a6a63750-e30c-4a77-bbbf-38498587808f","Type":"ContainerStarted","Data":"e7f4ada542cc22ed97959f832e967bdafc150827c0181ef9058c9052fafdfd5d"} Jul 28 00:01:37.449593 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:37.449572 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-md25x" event={"ID":"184b7c0e-0bee-4207-a828-2b9df804266b","Type":"ContainerStarted","Data":"9c6efc84c7d4e8d4b06d6b92d190a697d27b81b13e45bbc8f209457f4f95954e"} Jul 28 00:01:37.449670 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:37.449631 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-md25x" event={"ID":"184b7c0e-0bee-4207-a828-2b9df804266b","Type":"ContainerStarted","Data":"692ef35ebfc39830069a35129a60123661bcbaae220ad7e0fa24f3baee62bee8"} Jul 28 00:01:37.449705 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:37.449675 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-md25x" event={"ID":"184b7c0e-0bee-4207-a828-2b9df804266b","Type":"ContainerStarted","Data":"ded82a77dcfed9b6fa89e985a7a3ad9438df91170c2673685262b3ac9c74030d"} Jul 28 00:01:37.449745 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:37.449718 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-md25x" event={"ID":"184b7c0e-0bee-4207-a828-2b9df804266b","Type":"ContainerStarted","Data":"660b0c9be20908ada9514a8ec55fddb3b949f47fb44695f5a4e5c86ba9f9ecbb"} Jul 28 00:01:37.450805 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:37.450788 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" event={"ID":"8c600a59-9500-4e62-bc84-82da85a3b1bd","Type":"ContainerStarted","Data":"c8abfe4ae4f31d1d6942301614c8b55b72189a65bc79f40bc0486055ea8e319a"} Jul 28 00:01:37.452039 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:37.452017 2574 generic.go:356] "Generic (PLEG): container finished" podID="86091880-c298-4359-9ca1-b513f2af0889" containerID="f5ae3cb74ed0865cb5878459eed716c89fcaab0e302239dbaa47b8e1040596bf" exitCode=0 Jul 28 00:01:37.452110 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:37.452088 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dl5vz" event={"ID":"86091880-c298-4359-9ca1-b513f2af0889","Type":"ContainerDied","Data":"f5ae3cb74ed0865cb5878459eed716c89fcaab0e302239dbaa47b8e1040596bf"} Jul 28 00:01:37.453726 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:37.453706 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" event={"ID":"b46af047627177c30ef30b48f0650e79","Type":"ContainerStarted","Data":"07d459c7b935f656bf216544ce43ea75d62b19e75ccea10c39c7d415ca4a60a1"} Jul 28 00:01:37.455211 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:37.455183 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ckjf9" event={"ID":"0823e600-8868-4c59-b929-7d0a7ae34711","Type":"ContainerStarted","Data":"a906ef4fe011630b4cd046a3990d4853044b9d50e040a6b7273cc899f343295c"} Jul 28 00:01:37.456579 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:37.456553 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-27gsr" event={"ID":"cc43fba5-dd78-4101-88e2-58f00af58ef1","Type":"ContainerStarted","Data":"0f1ccee7e657855601e9cdbf11fa18297b16f7797646dc0549769b5d11387e62"} Jul 28 00:01:37.461524 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:37.461485 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gpmnb" podStartSLOduration=3.157329671 podStartE2EDuration="22.461471652s" totalImagesPullingTime="19.304141981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:37.461096251 +0000 UTC m=+22.577601663" watchObservedRunningTime="2026-07-28 00:01:37.461471652 +0000 UTC m=+22.577977063" Jul 28 00:01:37.476906 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:37.476857 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sx88w" podStartSLOduration=3.221650012 podStartE2EDuration="22.476842784s" totalImagesPullingTime="19.255192772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:37.476724733 +0000 UTC m=+22.593230145" watchObservedRunningTime="2026-07-28 00:01:37.476842784 +0000 UTC m=+22.593348196" Jul 28 00:01:37.494055 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:37.494012 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-45jgc" podStartSLOduration=3.245742448 podStartE2EDuration="22.493997661s" totalImagesPullingTime="19.248255213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:37.493896976 +0000 UTC m=+22.610402400" watchObservedRunningTime="2026-07-28 00:01:37.493997661 +0000 UTC m=+22.610503073" Jul 28 00:01:37.537928 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:37.537884 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-27gsr" podStartSLOduration=3.25736225 podStartE2EDuration="22.537868818s" totalImagesPullingTime="19.280506568s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:37.537534526 +0000 UTC m=+22.654039939" watchObservedRunningTime="2026-07-28 00:01:37.537868818 +0000 UTC m=+22.654374229" Jul 28 00:01:37.551958 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:37.551893 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ckjf9" podStartSLOduration=3.27860846 podStartE2EDuration="22.551876729s" totalImagesPullingTime="19.273268269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:37.551867442 +0000 UTC m=+22.668372855" watchObservedRunningTime="2026-07-28 00:01:37.551876729 +0000 UTC m=+22.668382138" Jul 28 00:01:37.568518 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:37.568478 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" podStartSLOduration=21.568462565 podStartE2EDuration="21.568462565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:37.56842001 +0000 UTC m=+22.684925421" watchObservedRunningTime="2026-07-28 00:01:37.568462565 +0000 UTC m=+22.684967977" Jul 28 00:01:38.032271 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:38.032232 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sx88w" Jul 28 00:01:38.032797 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:38.032754 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sx88w" Jul 28 00:01:38.364961 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:38.364927 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:38.365390 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:38.365048 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n56zd" podUID="361a09af-a231-45f9-8332-fbd085df9a5f" Jul 28 00:01:38.439004 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:38.438980 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 00:01:38.462166 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:38.462126 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-md25x" event={"ID":"184b7c0e-0bee-4207-a828-2b9df804266b","Type":"ContainerStarted","Data":"2d9afcf52196cd16faaa56132e73545d9ddf66dc978149f675e5b00727a8a7ca"} Jul 28 00:01:38.462324 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:38.462201 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-md25x" event={"ID":"184b7c0e-0bee-4207-a828-2b9df804266b","Type":"ContainerStarted","Data":"13d541c3000f32def5db35f16bb12958aded3b7843f5a596ff7fac5856117299"} Jul 28 00:01:38.464020 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:38.463983 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" event={"ID":"8c600a59-9500-4e62-bc84-82da85a3b1bd","Type":"ContainerStarted","Data":"44bdf2f6567438f40e63d2dc3b622be805de58f07d841164a5e9c0d182dded69"} Jul 28 00:01:38.465594 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:38.465495 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hdmsb" event={"ID":"413bb2d5-d73f-4e81-b7fb-33dd3de573c2","Type":"ContainerStarted","Data":"d51a601963ca393b2adb2905dea4d6ea817f032ec262624e0e86e4725bef271e"} Jul 28 00:01:38.480996 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:38.480951 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hdmsb" podStartSLOduration=4.210482746 podStartE2EDuration="23.480933013s" totalImagesPullingTime="19.270450267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:38.480600474 +0000 UTC m=+23.597105886" watchObservedRunningTime="2026-07-28 00:01:38.480933013 +0000 UTC m=+23.597438425" Jul 28 00:01:39.364851 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:39.364725 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T00:01:38.438998327Z","UUID":"e84dd322-b868-4d4e-8043-cccc2971454d","Handler":null,"Name":"","Endpoint":""} Jul 28 00:01:39.365441 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:39.365408 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:39.365873 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:39.365537 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflsn" podUID="65d808ec-5de9-4dfa-9c3e-e45a41f3ccde" Jul 28 00:01:39.365873 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:39.365581 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:39.365873 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:39.365705 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f29s8" podUID="5894c611-99f4-4459-8619-63305e3d25d1" Jul 28 00:01:39.366495 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:39.366475 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 00:01:39.366607 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:39.366514 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 00:01:39.467841 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:39.467810 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 28 00:01:40.365068 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:40.364874 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:40.365229 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:40.365158 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n56zd" podUID="361a09af-a231-45f9-8332-fbd085df9a5f" Jul 28 00:01:40.473978 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:40.473937 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-md25x" event={"ID":"184b7c0e-0bee-4207-a828-2b9df804266b","Type":"ContainerStarted","Data":"1d79991287ffbbea349707ddd22ed118bc0db8c2ad27556f47ef7e8e87930f33"} Jul 28 00:01:41.364594 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:41.364550 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:41.364594 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:41.364593 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:41.364884 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:41.364685 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f29s8" podUID="5894c611-99f4-4459-8619-63305e3d25d1" Jul 28 00:01:41.364884 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:41.364847 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflsn" podUID="65d808ec-5de9-4dfa-9c3e-e45a41f3ccde" Jul 28 00:01:42.117838 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:42.117556 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sx88w" Jul 28 00:01:42.118586 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:42.117964 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 28 00:01:42.118586 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:42.118418 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sx88w" Jul 28 00:01:42.364711 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:42.364637 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:42.364863 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:42.364740 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n56zd" podUID="361a09af-a231-45f9-8332-fbd085df9a5f" Jul 28 00:01:42.482116 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:42.482082 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-md25x" event={"ID":"184b7c0e-0bee-4207-a828-2b9df804266b","Type":"ContainerStarted","Data":"c4716bb98a5206643dfd7c17c21af83f915b4668aefc2e1245e85cfd635afb16"} Jul 28 00:01:42.482322 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:42.482298 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:42.484148 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:42.484128 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" event={"ID":"8c600a59-9500-4e62-bc84-82da85a3b1bd","Type":"ContainerStarted","Data":"248b36b5acf80d66566c508081d004a935257b0c860285d977f6c90b8fcc7d97"} Jul 28 00:01:42.486004 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:42.485985 2574 generic.go:356] "Generic (PLEG): container finished" podID="86091880-c298-4359-9ca1-b513f2af0889" containerID="aac1c199faec96227926f9fe8dbda6dfffc31036be4f9bbc7838fbc511571214" exitCode=0 Jul 28 00:01:42.486100 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:42.486070 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dl5vz" event={"ID":"86091880-c298-4359-9ca1-b513f2af0889","Type":"ContainerDied","Data":"aac1c199faec96227926f9fe8dbda6dfffc31036be4f9bbc7838fbc511571214"} Jul 28 00:01:42.499249 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:42.499228 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:42.516402 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:42.514289 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-md25x" podStartSLOduration=8.179550482 podStartE2EDuration="27.514271083s" totalImagesPullingTime="19.334720601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:42.514038976 +0000 UTC m=+27.630544389" watchObservedRunningTime="2026-07-28 00:01:42.514271083 +0000 UTC m=+27.630776496" Jul 28 00:01:42.533629 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:42.533579 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rf8nq" podStartSLOduration=5.26523098 podStartE2EDuration="27.533564797s" totalImagesPullingTime="22.268333817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:42.532838551 +0000 UTC m=+27.649343963" watchObservedRunningTime="2026-07-28 00:01:42.533564797 +0000 UTC m=+27.650070209" Jul 28 00:01:43.366972 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:43.365988 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:43.366972 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:43.366107 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflsn" podUID="65d808ec-5de9-4dfa-9c3e-e45a41f3ccde" Jul 28 00:01:43.366972 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:43.366581 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:43.366972 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:43.366689 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f29s8" podUID="5894c611-99f4-4459-8619-63305e3d25d1" Jul 28 00:01:43.488927 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:43.488897 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:43.489096 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:43.488971 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:43.504074 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:43.504047 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:01:44.191307 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:44.191277 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dflsn"] Jul 28 00:01:44.191455 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:44.191427 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:44.191535 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:44.191510 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflsn" podUID="65d808ec-5de9-4dfa-9c3e-e45a41f3ccde" Jul 28 00:01:44.193314 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:44.193288 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f29s8"] Jul 28 00:01:44.193463 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:44.193400 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:44.193537 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:44.193511 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f29s8" podUID="5894c611-99f4-4459-8619-63305e3d25d1" Jul 28 00:01:44.205221 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:44.205194 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n56zd"] Jul 28 00:01:44.205362 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:44.205325 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:44.205491 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:44.205452 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n56zd" podUID="361a09af-a231-45f9-8332-fbd085df9a5f" Jul 28 00:01:44.492673 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:44.492590 2574 generic.go:356] "Generic (PLEG): container finished" podID="86091880-c298-4359-9ca1-b513f2af0889" containerID="90728b0f3e17cde96a5928298e678941362c097d8ee867e5500b203f074cb52a" exitCode=0 Jul 28 00:01:44.493068 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:44.492680 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dl5vz" event={"ID":"86091880-c298-4359-9ca1-b513f2af0889","Type":"ContainerDied","Data":"90728b0f3e17cde96a5928298e678941362c097d8ee867e5500b203f074cb52a"} Jul 28 00:01:46.365393 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:46.365357 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:46.365989 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:46.365457 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:46.365989 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:46.365463 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n56zd" podUID="361a09af-a231-45f9-8332-fbd085df9a5f" Jul 28 00:01:46.365989 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:46.365483 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:46.365989 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:46.365553 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflsn" podUID="65d808ec-5de9-4dfa-9c3e-e45a41f3ccde" Jul 28 00:01:46.365989 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:46.365613 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f29s8" podUID="5894c611-99f4-4459-8619-63305e3d25d1" Jul 28 00:01:46.499087 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:46.499056 2574 generic.go:356] "Generic (PLEG): container finished" podID="86091880-c298-4359-9ca1-b513f2af0889" containerID="1c8adffc3ec0dc3d1c4f0b714c0aafacc857a60d0361569f6d415638088e26b5" exitCode=0 Jul 28 00:01:46.499242 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:46.499099 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dl5vz" event={"ID":"86091880-c298-4359-9ca1-b513f2af0889","Type":"ContainerDied","Data":"1c8adffc3ec0dc3d1c4f0b714c0aafacc857a60d0361569f6d415638088e26b5"} Jul 28 00:01:48.364554 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:48.364513 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:48.365174 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:48.364513 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:48.365174 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:48.364666 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f29s8" podUID="5894c611-99f4-4459-8619-63305e3d25d1" Jul 28 00:01:48.365174 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:48.364719 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n56zd" podUID="361a09af-a231-45f9-8332-fbd085df9a5f" Jul 28 00:01:48.365174 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:48.364513 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:48.365174 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:48.364823 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dflsn" podUID="65d808ec-5de9-4dfa-9c3e-e45a41f3ccde" Jul 28 00:01:49.062972 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.062935 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w4sp\" (UniqueName: \"kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp\") pod \"network-check-target-dflsn\" (UID: \"65d808ec-5de9-4dfa-9c3e-e45a41f3ccde\") " pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:49.063174 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.062989 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret\") pod \"global-pull-secret-syncer-n56zd\" (UID: \"361a09af-a231-45f9-8332-fbd085df9a5f\") " pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:49.063174 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.063020 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs\") pod \"network-metrics-daemon-f29s8\" (UID: \"5894c611-99f4-4459-8619-63305e3d25d1\") " pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:49.063174 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:49.063123 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:49.063174 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:49.063162 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:49.063391 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:49.063179 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs podName:5894c611-99f4-4459-8619-63305e3d25d1 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:21.063164532 +0000 UTC m=+66.179669923 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs") pod "network-metrics-daemon-f29s8" (UID: "5894c611-99f4-4459-8619-63305e3d25d1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:49.063391 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:49.063123 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:49.063391 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:49.063226 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:49.063391 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:49.063240 2574 projected.go:196] Error preparing data for projected volume kube-api-access-5w4sp for pod openshift-network-diagnostics/network-check-target-dflsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:49.063391 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:49.063227 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret podName:361a09af-a231-45f9-8332-fbd085df9a5f nodeName:}" failed. No retries permitted until 2026-07-28 00:02:21.063208617 +0000 UTC m=+66.179714029 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret") pod "global-pull-secret-syncer-n56zd" (UID: "361a09af-a231-45f9-8332-fbd085df9a5f") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:49.063391 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:49.063289 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp podName:65d808ec-5de9-4dfa-9c3e-e45a41f3ccde nodeName:}" failed. No retries permitted until 2026-07-28 00:02:21.063275485 +0000 UTC m=+66.179780890 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5w4sp" (UniqueName: "kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp") pod "network-check-target-dflsn" (UID: "65d808ec-5de9-4dfa-9c3e-e45a41f3ccde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:49.648379 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.648343 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeReady" Jul 28 00:01:49.648856 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.648517 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 00:01:49.690723 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.690693 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7zf7v"] Jul 28 00:01:49.695871 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.695810 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-stwkz"] Jul 28 00:01:49.695989 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.695924 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7zf7v" Jul 28 00:01:49.698681 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.698655 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 00:01:49.698681 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.698673 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-trh8s\"" Jul 28 00:01:49.698681 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.698661 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 00:01:49.699175 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.699157 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-stwkz" Jul 28 00:01:49.701681 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.701657 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 00:01:49.701807 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.701725 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 00:01:49.702276 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.702258 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8pfvf\"" Jul 28 00:01:49.702390 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.702296 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 00:01:49.707637 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.707253 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7zf7v"] Jul 28 00:01:49.708152 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.708134 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-stwkz"] Jul 28 00:01:49.868754 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.868705 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e6289e83-59b7-439e-8461-6c85c6828ddb-config-volume\") pod \"dns-default-7zf7v\" (UID: \"e6289e83-59b7-439e-8461-6c85c6828ddb\") " pod="openshift-dns/dns-default-7zf7v" Jul 28 00:01:49.868955 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.868788 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6wqn\" (UniqueName: \"kubernetes.io/projected/e6289e83-59b7-439e-8461-6c85c6828ddb-kube-api-access-b6wqn\") pod \"dns-default-7zf7v\" (UID: \"e6289e83-59b7-439e-8461-6c85c6828ddb\") " pod="openshift-dns/dns-default-7zf7v" Jul 28 00:01:49.868955 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.868834 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bclnh\" (UniqueName: \"kubernetes.io/projected/acbb6d5a-520b-4258-bea6-85a4c279d823-kube-api-access-bclnh\") pod \"ingress-canary-stwkz\" (UID: \"acbb6d5a-520b-4258-bea6-85a4c279d823\") " pod="openshift-ingress-canary/ingress-canary-stwkz" Jul 28 00:01:49.868955 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.868856 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6289e83-59b7-439e-8461-6c85c6828ddb-tmp-dir\") pod \"dns-default-7zf7v\" (UID: \"e6289e83-59b7-439e-8461-6c85c6828ddb\") " pod="openshift-dns/dns-default-7zf7v" Jul 28 00:01:49.868955 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.868904 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acbb6d5a-520b-4258-bea6-85a4c279d823-cert\") pod \"ingress-canary-stwkz\" (UID: \"acbb6d5a-520b-4258-bea6-85a4c279d823\") " pod="openshift-ingress-canary/ingress-canary-stwkz" Jul 28 00:01:49.868955 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.868929 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls\") pod \"dns-default-7zf7v\" (UID: \"e6289e83-59b7-439e-8461-6c85c6828ddb\") " pod="openshift-dns/dns-default-7zf7v" Jul 28 00:01:49.969656 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.969562 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acbb6d5a-520b-4258-bea6-85a4c279d823-cert\") pod \"ingress-canary-stwkz\" (UID: \"acbb6d5a-520b-4258-bea6-85a4c279d823\") " pod="openshift-ingress-canary/ingress-canary-stwkz" Jul 28 00:01:49.969656 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.969610 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls\") pod \"dns-default-7zf7v\" (UID: \"e6289e83-59b7-439e-8461-6c85c6828ddb\") " pod="openshift-dns/dns-default-7zf7v" Jul 28 00:01:49.969905 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.969673 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e6289e83-59b7-439e-8461-6c85c6828ddb-config-volume\") pod \"dns-default-7zf7v\" (UID: \"e6289e83-59b7-439e-8461-6c85c6828ddb\") " pod="openshift-dns/dns-default-7zf7v" Jul 28 00:01:49.969905 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.969722 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6wqn\" (UniqueName: \"kubernetes.io/projected/e6289e83-59b7-439e-8461-6c85c6828ddb-kube-api-access-b6wqn\") pod \"dns-default-7zf7v\" (UID: \"e6289e83-59b7-439e-8461-6c85c6828ddb\") " pod="openshift-dns/dns-default-7zf7v" Jul 28 00:01:49.969905 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.969797 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bclnh\" (UniqueName: \"kubernetes.io/projected/acbb6d5a-520b-4258-bea6-85a4c279d823-kube-api-access-bclnh\") pod \"ingress-canary-stwkz\" (UID: \"acbb6d5a-520b-4258-bea6-85a4c279d823\") " pod="openshift-ingress-canary/ingress-canary-stwkz" Jul 28 00:01:49.969905 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.969825 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6289e83-59b7-439e-8461-6c85c6828ddb-tmp-dir\") pod \"dns-default-7zf7v\" (UID: \"e6289e83-59b7-439e-8461-6c85c6828ddb\") " pod="openshift-dns/dns-default-7zf7v" Jul 28 00:01:49.970388 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:49.970156 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:01:49.970388 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.970171 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6289e83-59b7-439e-8461-6c85c6828ddb-tmp-dir\") pod \"dns-default-7zf7v\" (UID: \"e6289e83-59b7-439e-8461-6c85c6828ddb\") " pod="openshift-dns/dns-default-7zf7v" Jul 28 00:01:49.970388 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:49.970238 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls podName:e6289e83-59b7-439e-8461-6c85c6828ddb nodeName:}" failed. No retries permitted until 2026-07-28 00:01:50.470217403 +0000 UTC m=+35.586722808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls") pod "dns-default-7zf7v" (UID: "e6289e83-59b7-439e-8461-6c85c6828ddb") : secret "dns-default-metrics-tls" not found Jul 28 00:01:49.970605 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.970577 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e6289e83-59b7-439e-8461-6c85c6828ddb-config-volume\") pod \"dns-default-7zf7v\" (UID: \"e6289e83-59b7-439e-8461-6c85c6828ddb\") " pod="openshift-dns/dns-default-7zf7v" Jul 28 00:01:49.975211 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.975184 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acbb6d5a-520b-4258-bea6-85a4c279d823-cert\") pod \"ingress-canary-stwkz\" (UID: \"acbb6d5a-520b-4258-bea6-85a4c279d823\") " pod="openshift-ingress-canary/ingress-canary-stwkz" Jul 28 00:01:49.982806 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.982782 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6wqn\" (UniqueName: \"kubernetes.io/projected/e6289e83-59b7-439e-8461-6c85c6828ddb-kube-api-access-b6wqn\") pod \"dns-default-7zf7v\" (UID: \"e6289e83-59b7-439e-8461-6c85c6828ddb\") " pod="openshift-dns/dns-default-7zf7v" Jul 28 00:01:49.983624 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:49.983602 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bclnh\" (UniqueName: \"kubernetes.io/projected/acbb6d5a-520b-4258-bea6-85a4c279d823-kube-api-access-bclnh\") pod \"ingress-canary-stwkz\" (UID: \"acbb6d5a-520b-4258-bea6-85a4c279d823\") " pod="openshift-ingress-canary/ingress-canary-stwkz" Jul 28 00:01:50.016528 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:50.016495 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-stwkz" Jul 28 00:01:50.365358 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:50.365154 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:01:50.365475 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:50.365184 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:01:50.365956 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:50.365196 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:01:50.368677 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:50.368653 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 00:01:50.370221 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:50.369788 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 00:01:50.370221 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:50.369851 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wccf\"" Jul 28 00:01:50.370221 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:50.369794 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bxxgg\"" Jul 28 00:01:50.370221 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:50.370094 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 00:01:50.370221 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:50.370187 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 00:01:50.447394 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:50.447370 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-stwkz"] Jul 28 00:01:50.467829 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:01:50.467797 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacbb6d5a_520b_4258_bea6_85a4c279d823.slice/crio-c0c834d1739dd795559ace209227dcf7a442a5389ad42f931b4b1fd4fec8d5e6 WatchSource:0}: Error finding container c0c834d1739dd795559ace209227dcf7a442a5389ad42f931b4b1fd4fec8d5e6: Status 404 returned error can't find the container with id c0c834d1739dd795559ace209227dcf7a442a5389ad42f931b4b1fd4fec8d5e6 Jul 28 00:01:50.473470 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:50.473447 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls\") pod \"dns-default-7zf7v\" (UID: \"e6289e83-59b7-439e-8461-6c85c6828ddb\") " pod="openshift-dns/dns-default-7zf7v" Jul 28 00:01:50.473712 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:50.473693 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:01:50.473796 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:50.473750 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls podName:e6289e83-59b7-439e-8461-6c85c6828ddb nodeName:}" failed. No retries permitted until 2026-07-28 00:01:51.473735736 +0000 UTC m=+36.590241126 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls") pod "dns-default-7zf7v" (UID: "e6289e83-59b7-439e-8461-6c85c6828ddb") : secret "dns-default-metrics-tls" not found Jul 28 00:01:50.510010 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:50.509982 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-stwkz" event={"ID":"acbb6d5a-520b-4258-bea6-85a4c279d823","Type":"ContainerStarted","Data":"c0c834d1739dd795559ace209227dcf7a442a5389ad42f931b4b1fd4fec8d5e6"} Jul 28 00:01:50.512981 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:50.512955 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dl5vz" event={"ID":"86091880-c298-4359-9ca1-b513f2af0889","Type":"ContainerStarted","Data":"183a264b92eff4e55cf7d3494d137a45c3a014bbd122b0ba3839d9b104abcbe6"} Jul 28 00:01:51.480993 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:51.480952 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls\") pod \"dns-default-7zf7v\" (UID: \"e6289e83-59b7-439e-8461-6c85c6828ddb\") " pod="openshift-dns/dns-default-7zf7v" Jul 28 00:01:51.481438 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:51.481129 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:01:51.481438 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:51.481214 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls podName:e6289e83-59b7-439e-8461-6c85c6828ddb nodeName:}" failed. No retries permitted until 2026-07-28 00:01:53.481190081 +0000 UTC m=+38.597695493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls") pod "dns-default-7zf7v" (UID: "e6289e83-59b7-439e-8461-6c85c6828ddb") : secret "dns-default-metrics-tls" not found Jul 28 00:01:51.518461 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:51.518426 2574 generic.go:356] "Generic (PLEG): container finished" podID="86091880-c298-4359-9ca1-b513f2af0889" containerID="183a264b92eff4e55cf7d3494d137a45c3a014bbd122b0ba3839d9b104abcbe6" exitCode=0 Jul 28 00:01:51.518647 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:51.518493 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dl5vz" event={"ID":"86091880-c298-4359-9ca1-b513f2af0889","Type":"ContainerDied","Data":"183a264b92eff4e55cf7d3494d137a45c3a014bbd122b0ba3839d9b104abcbe6"} Jul 28 00:01:52.523605 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:52.523570 2574 generic.go:356] "Generic (PLEG): container finished" podID="86091880-c298-4359-9ca1-b513f2af0889" containerID="339408d596b0d0eadba673f44e00e87c2c1f4cb1324d132d2d2d4980038b3ec0" exitCode=0 Jul 28 00:01:52.523983 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:52.523624 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dl5vz" event={"ID":"86091880-c298-4359-9ca1-b513f2af0889","Type":"ContainerDied","Data":"339408d596b0d0eadba673f44e00e87c2c1f4cb1324d132d2d2d4980038b3ec0"} Jul 28 00:01:53.494646 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:53.494613 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls\") pod \"dns-default-7zf7v\" (UID: \"e6289e83-59b7-439e-8461-6c85c6828ddb\") " pod="openshift-dns/dns-default-7zf7v" Jul 28 00:01:53.494812 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:53.494793 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:01:53.494879 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:53.494868 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls podName:e6289e83-59b7-439e-8461-6c85c6828ddb nodeName:}" failed. No retries permitted until 2026-07-28 00:01:57.494844369 +0000 UTC m=+42.611349767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls") pod "dns-default-7zf7v" (UID: "e6289e83-59b7-439e-8461-6c85c6828ddb") : secret "dns-default-metrics-tls" not found Jul 28 00:01:53.529588 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:53.529553 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dl5vz" event={"ID":"86091880-c298-4359-9ca1-b513f2af0889","Type":"ContainerStarted","Data":"0ec04dc6b0775730022087a0ae318c9c1c0547f6cdff8f69628c7816f9213507"} Jul 28 00:01:53.530948 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:53.530924 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-stwkz" event={"ID":"acbb6d5a-520b-4258-bea6-85a4c279d823","Type":"ContainerStarted","Data":"b90bc6daa7d7c6b902374df3aa9610e995da7e861e62f3b045ad4263ebf24bd2"} Jul 28 00:01:53.551404 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:53.551350 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dl5vz" podStartSLOduration=8.352545329 podStartE2EDuration="38.551331649s" totalImagesPullingTime="30.19878632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:53.550054928 +0000 UTC m=+38.666560340" watchObservedRunningTime="2026-07-28 00:01:53.551331649 +0000 UTC m=+38.667837062" Jul 28 00:01:53.567460 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:53.567411 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-stwkz" podStartSLOduration=2.417931888 podStartE2EDuration="4.567394362s" totalImagesPullingTime="2.149462474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:53.566530055 +0000 UTC m=+38.683035479" watchObservedRunningTime="2026-07-28 00:01:53.567394362 +0000 UTC m=+38.683899775" Jul 28 00:01:57.517717 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:01:57.517676 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls\") pod \"dns-default-7zf7v\" (UID: \"e6289e83-59b7-439e-8461-6c85c6828ddb\") " pod="openshift-dns/dns-default-7zf7v" Jul 28 00:01:57.518265 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:57.517825 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:01:57.518265 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:01:57.517879 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls podName:e6289e83-59b7-439e-8461-6c85c6828ddb nodeName:}" failed. No retries permitted until 2026-07-28 00:02:05.517865016 +0000 UTC m=+50.634370407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls") pod "dns-default-7zf7v" (UID: "e6289e83-59b7-439e-8461-6c85c6828ddb") : secret "dns-default-metrics-tls" not found Jul 28 00:02:05.577318 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:05.577266 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls\") pod \"dns-default-7zf7v\" (UID: \"e6289e83-59b7-439e-8461-6c85c6828ddb\") " pod="openshift-dns/dns-default-7zf7v" Jul 28 00:02:05.577820 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:05.577425 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:02:05.577820 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:05.577493 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls podName:e6289e83-59b7-439e-8461-6c85c6828ddb nodeName:}" failed. No retries permitted until 2026-07-28 00:02:21.577476836 +0000 UTC m=+66.693982227 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls") pod "dns-default-7zf7v" (UID: "e6289e83-59b7-439e-8461-6c85c6828ddb") : secret "dns-default-metrics-tls" not found Jul 28 00:02:15.513621 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:15.513593 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-md25x" Jul 28 00:02:16.170283 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.170252 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n"] Jul 28 00:02:16.175957 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.175929 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-679f79d87c-8wpbk"] Jul 28 00:02:16.176084 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.176051 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n" Jul 28 00:02:16.177573 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.177550 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:16.179178 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.179156 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 28 00:02:16.180997 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.180970 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 28 00:02:16.180997 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.180978 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 00:02:16.182059 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.182038 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 00:02:16.182059 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.182046 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 28 00:02:16.182210 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.182060 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 28 00:02:16.182210 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.182146 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 28 00:02:16.182210 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.182155 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-6qs9q\"" Jul 28 00:02:16.182210 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.182171 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 28 00:02:16.182210 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.182160 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 28 00:02:16.182442 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.182280 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 28 00:02:16.182442 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.182342 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-74v2p\"" Jul 28 00:02:16.189560 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.189539 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n"] Jul 28 00:02:16.196822 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.196803 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-679f79d87c-8wpbk"] Jul 28 00:02:16.256149 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.256113 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-default-certificate\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:16.256149 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.256152 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-metrics-certs\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:16.256384 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.256178 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brc9z\" (UniqueName: \"kubernetes.io/projected/57909377-68d5-4ecb-b1dc-3ebece8627a7-kube-api-access-brc9z\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:16.256384 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.256205 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0674b82c-2b52-4f92-b1b9-adefc4f30141-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-svw4n\" (UID: \"0674b82c-2b52-4f92-b1b9-adefc4f30141\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n" Jul 28 00:02:16.256384 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.256244 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-stats-auth\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:16.256384 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.256261 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzdq9\" (UniqueName: \"kubernetes.io/projected/0674b82c-2b52-4f92-b1b9-adefc4f30141-kube-api-access-nzdq9\") pod \"cluster-monitoring-operator-548b489cb8-svw4n\" (UID: \"0674b82c-2b52-4f92-b1b9-adefc4f30141\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n" Jul 28 00:02:16.256384 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.256284 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57909377-68d5-4ecb-b1dc-3ebece8627a7-service-ca-bundle\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:16.256384 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.256332 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0674b82c-2b52-4f92-b1b9-adefc4f30141-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-svw4n\" (UID: \"0674b82c-2b52-4f92-b1b9-adefc4f30141\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n" Jul 28 00:02:16.293001 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.292970 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vp982"] Jul 28 00:02:16.294647 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.294626 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vp982" Jul 28 00:02:16.300079 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.300059 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 28 00:02:16.300657 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.300633 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vnwhk\"" Jul 28 00:02:16.307448 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.307432 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:02:16.320731 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.320708 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-6w6lx"] Jul 28 00:02:16.322637 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.322620 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" Jul 28 00:02:16.325106 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.325084 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5fd5f75b7c-fms6d"] Jul 28 00:02:16.326607 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.326587 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:16.334836 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:16.334801 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"installation-pull-secrets\" is forbidden: User \"system:node:ip-10-0-130-253.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-130-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" type="*v1.Secret" Jul 28 00:02:16.338017 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:16.337977 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"trusted-ca\" is forbidden: User \"system:node:ip-10-0-130-253.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-130-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" type="*v1.ConfigMap" Jul 28 00:02:16.338017 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.338015 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 28 00:02:16.338218 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:16.338021 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-tls\" is forbidden: User \"system:node:ip-10-0-130-253.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-130-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" type="*v1.Secret" Jul 28 00:02:16.338218 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:16.338049 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"registry-dockercfg-tgc5p\" is forbidden: User \"system:node:ip-10-0-130-253.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-130-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tgc5p\"" type="*v1.Secret" Jul 28 00:02:16.338218 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.338164 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 28 00:02:16.338495 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.338482 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wk7b2\"" Jul 28 00:02:16.340899 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.340882 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:02:16.342489 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.342469 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 00:02:16.342814 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.342752 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n"] Jul 28 00:02:16.342926 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.342913 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 28 00:02:16.344684 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.344667 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n" Jul 28 00:02:16.346563 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.346543 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 28 00:02:16.348057 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.348036 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vp982"] Jul 28 00:02:16.350713 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.350147 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 28 00:02:16.350713 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.350356 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:02:16.350713 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.350458 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 28 00:02:16.350713 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.350592 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 28 00:02:16.350964 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.350893 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mgnnh\"" Jul 28 00:02:16.356234 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.356213 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fd5f75b7c-fms6d"] Jul 28 00:02:16.357339 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.357318 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-stats-auth\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:16.357435 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.357348 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8b547976-0a9f-481c-bb16-884e484d1b69-config\") pod \"console-operator-584dcb6b54-6w6lx\" (UID: \"8b547976-0a9f-481c-bb16-884e484d1b69\") " pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" Jul 28 00:02:16.357435 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.357379 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6800826-e553-484f-8ed6-32f10a400f5f-ca-trust-extracted\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:16.357537 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.357477 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzdq9\" (UniqueName: \"kubernetes.io/projected/0674b82c-2b52-4f92-b1b9-adefc4f30141-kube-api-access-nzdq9\") pod \"cluster-monitoring-operator-548b489cb8-svw4n\" (UID: \"0674b82c-2b52-4f92-b1b9-adefc4f30141\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n" Jul 28 00:02:16.357622 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.357597 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a9aeaa9-bdff-44d6-85f4-06375e0c97ce-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n\" (UID: \"3a9aeaa9-bdff-44d6-85f4-06375e0c97ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n" Jul 28 00:02:16.357681 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.357666 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wnrl\" (UniqueName: \"kubernetes.io/projected/3a9aeaa9-bdff-44d6-85f4-06375e0c97ce-kube-api-access-6wnrl\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n\" (UID: \"3a9aeaa9-bdff-44d6-85f4-06375e0c97ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n" Jul 28 00:02:16.357730 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.357721 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57909377-68d5-4ecb-b1dc-3ebece8627a7-service-ca-bundle\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:16.357807 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.357745 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b547976-0a9f-481c-bb16-884e484d1b69-trusted-ca\") pod \"console-operator-584dcb6b54-6w6lx\" (UID: \"8b547976-0a9f-481c-bb16-884e484d1b69\") " pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" Jul 28 00:02:16.357856 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.357807 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0674b82c-2b52-4f92-b1b9-adefc4f30141-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-svw4n\" (UID: \"0674b82c-2b52-4f92-b1b9-adefc4f30141\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n" Jul 28 00:02:16.357856 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.357834 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2xhb\" (UniqueName: \"kubernetes.io/projected/a42da2e2-fca2-4f1b-b7e1-98d538dcf473-kube-api-access-q2xhb\") pod \"volume-data-source-validator-549c6d54cf-vp982\" (UID: \"a42da2e2-fca2-4f1b-b7e1-98d538dcf473\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vp982" Jul 28 00:02:16.357922 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.357864 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-registry-tls\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:16.357922 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.357902 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a9aeaa9-bdff-44d6-85f4-06375e0c97ce-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n\" (UID: \"3a9aeaa9-bdff-44d6-85f4-06375e0c97ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n" Jul 28 00:02:16.358027 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.357960 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6800826-e553-484f-8ed6-32f10a400f5f-image-registry-private-configuration\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:16.358027 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:16.357976 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 00:02:16.358027 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.358014 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxkd8\" (UniqueName: \"kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-kube-api-access-vxkd8\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:16.358142 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:16.358040 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0674b82c-2b52-4f92-b1b9-adefc4f30141-cluster-monitoring-operator-tls podName:0674b82c-2b52-4f92-b1b9-adefc4f30141 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:16.858018437 +0000 UTC m=+61.974523842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0674b82c-2b52-4f92-b1b9-adefc4f30141-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-svw4n" (UID: "0674b82c-2b52-4f92-b1b9-adefc4f30141") : secret "cluster-monitoring-operator-tls" not found Jul 28 00:02:16.358189 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:16.358139 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57909377-68d5-4ecb-b1dc-3ebece8627a7-service-ca-bundle podName:57909377-68d5-4ecb-b1dc-3ebece8627a7 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:16.858122802 +0000 UTC m=+61.974628208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/57909377-68d5-4ecb-b1dc-3ebece8627a7-service-ca-bundle") pod "router-default-679f79d87c-8wpbk" (UID: "57909377-68d5-4ecb-b1dc-3ebece8627a7") : configmap references non-existent config key: service-ca.crt Jul 28 00:02:16.358189 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.358171 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brc9z\" (UniqueName: \"kubernetes.io/projected/57909377-68d5-4ecb-b1dc-3ebece8627a7-kube-api-access-brc9z\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:16.358274 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.358201 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0674b82c-2b52-4f92-b1b9-adefc4f30141-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-svw4n\" (UID: \"0674b82c-2b52-4f92-b1b9-adefc4f30141\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n" Jul 28 00:02:16.358274 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.358241 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6800826-e553-484f-8ed6-32f10a400f5f-registry-certificates\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:16.358274 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.358267 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8b547976-0a9f-481c-bb16-884e484d1b69-serving-cert\") pod \"console-operator-584dcb6b54-6w6lx\" (UID: \"8b547976-0a9f-481c-bb16-884e484d1b69\") " pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" Jul 28 00:02:16.358388 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.358294 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6800826-e553-484f-8ed6-32f10a400f5f-trusted-ca\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:16.358388 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.358338 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6800826-e553-484f-8ed6-32f10a400f5f-installation-pull-secrets\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:16.358388 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.358361 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-bound-sa-token\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:16.358512 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.358391 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-default-certificate\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:16.358512 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.358415 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-metrics-certs\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:16.358512 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.358441 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbr8c\" (UniqueName: \"kubernetes.io/projected/8b547976-0a9f-481c-bb16-884e484d1b69-kube-api-access-mbr8c\") pod \"console-operator-584dcb6b54-6w6lx\" (UID: \"8b547976-0a9f-481c-bb16-884e484d1b69\") " pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" Jul 28 00:02:16.359159 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:16.358926 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 00:02:16.359159 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:16.358974 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-metrics-certs podName:57909377-68d5-4ecb-b1dc-3ebece8627a7 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:16.858959363 +0000 UTC m=+61.975464759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-metrics-certs") pod "router-default-679f79d87c-8wpbk" (UID: "57909377-68d5-4ecb-b1dc-3ebece8627a7") : secret "router-metrics-certs-default" not found Jul 28 00:02:16.359159 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.359090 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-6w6lx"] Jul 28 00:02:16.359159 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.359140 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0674b82c-2b52-4f92-b1b9-adefc4f30141-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-svw4n\" (UID: \"0674b82c-2b52-4f92-b1b9-adefc4f30141\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n" Jul 28 00:02:16.363137 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.362961 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-default-certificate\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:16.368854 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.368829 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n"] Jul 28 00:02:16.369000 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.368850 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-stats-auth\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:16.376348 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.376324 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzdq9\" (UniqueName: \"kubernetes.io/projected/0674b82c-2b52-4f92-b1b9-adefc4f30141-kube-api-access-nzdq9\") pod \"cluster-monitoring-operator-548b489cb8-svw4n\" (UID: \"0674b82c-2b52-4f92-b1b9-adefc4f30141\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n" Jul 28 00:02:16.381889 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.381863 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brc9z\" (UniqueName: \"kubernetes.io/projected/57909377-68d5-4ecb-b1dc-3ebece8627a7-kube-api-access-brc9z\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:16.459355 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.459253 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2xhb\" (UniqueName: \"kubernetes.io/projected/a42da2e2-fca2-4f1b-b7e1-98d538dcf473-kube-api-access-q2xhb\") pod \"volume-data-source-validator-549c6d54cf-vp982\" (UID: \"a42da2e2-fca2-4f1b-b7e1-98d538dcf473\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vp982" Jul 28 00:02:16.459355 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.459295 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-registry-tls\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:16.459355 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.459315 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a9aeaa9-bdff-44d6-85f4-06375e0c97ce-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n\" (UID: \"3a9aeaa9-bdff-44d6-85f4-06375e0c97ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n" Jul 28 00:02:16.459625 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.459441 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6800826-e553-484f-8ed6-32f10a400f5f-image-registry-private-configuration\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:16.459625 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.459484 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxkd8\" (UniqueName: \"kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-kube-api-access-vxkd8\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:16.459625 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.459528 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6800826-e553-484f-8ed6-32f10a400f5f-registry-certificates\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:16.459835 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.459651 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8b547976-0a9f-481c-bb16-884e484d1b69-serving-cert\") pod \"console-operator-584dcb6b54-6w6lx\" (UID: \"8b547976-0a9f-481c-bb16-884e484d1b69\") " pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" Jul 28 00:02:16.459835 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.459685 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6800826-e553-484f-8ed6-32f10a400f5f-trusted-ca\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:16.459835 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.459738 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6800826-e553-484f-8ed6-32f10a400f5f-installation-pull-secrets\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:16.459835 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.459791 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-bound-sa-token\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:16.460031 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.459837 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbr8c\" (UniqueName: \"kubernetes.io/projected/8b547976-0a9f-481c-bb16-884e484d1b69-kube-api-access-mbr8c\") pod \"console-operator-584dcb6b54-6w6lx\" (UID: \"8b547976-0a9f-481c-bb16-884e484d1b69\") " pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" Jul 28 00:02:16.460031 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.459873 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8b547976-0a9f-481c-bb16-884e484d1b69-config\") pod \"console-operator-584dcb6b54-6w6lx\" (UID: \"8b547976-0a9f-481c-bb16-884e484d1b69\") " pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" Jul 28 00:02:16.460031 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.459893 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3a9aeaa9-bdff-44d6-85f4-06375e0c97ce-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n\" (UID: \"3a9aeaa9-bdff-44d6-85f4-06375e0c97ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n" Jul 28 00:02:16.460031 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.459915 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6800826-e553-484f-8ed6-32f10a400f5f-ca-trust-extracted\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:16.460031 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.459948 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a9aeaa9-bdff-44d6-85f4-06375e0c97ce-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n\" (UID: \"3a9aeaa9-bdff-44d6-85f4-06375e0c97ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n" Jul 28 00:02:16.460031 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.459975 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wnrl\" (UniqueName: \"kubernetes.io/projected/3a9aeaa9-bdff-44d6-85f4-06375e0c97ce-kube-api-access-6wnrl\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n\" (UID: \"3a9aeaa9-bdff-44d6-85f4-06375e0c97ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n" Jul 28 00:02:16.460031 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.460015 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b547976-0a9f-481c-bb16-884e484d1b69-trusted-ca\") pod \"console-operator-584dcb6b54-6w6lx\" (UID: \"8b547976-0a9f-481c-bb16-884e484d1b69\") " pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" Jul 28 00:02:16.460378 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.460095 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6800826-e553-484f-8ed6-32f10a400f5f-registry-certificates\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:16.460378 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.460294 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6800826-e553-484f-8ed6-32f10a400f5f-ca-trust-extracted\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:16.460640 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.460616 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8b547976-0a9f-481c-bb16-884e484d1b69-config\") pod \"console-operator-584dcb6b54-6w6lx\" (UID: \"8b547976-0a9f-481c-bb16-884e484d1b69\") " pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" Jul 28 00:02:16.460958 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.460938 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b547976-0a9f-481c-bb16-884e484d1b69-trusted-ca\") pod \"console-operator-584dcb6b54-6w6lx\" (UID: \"8b547976-0a9f-481c-bb16-884e484d1b69\") " pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" Jul 28 00:02:16.462021 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.462001 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8b547976-0a9f-481c-bb16-884e484d1b69-serving-cert\") pod \"console-operator-584dcb6b54-6w6lx\" (UID: \"8b547976-0a9f-481c-bb16-884e484d1b69\") " pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" Jul 28 00:02:16.462091 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.462059 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3a9aeaa9-bdff-44d6-85f4-06375e0c97ce-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n\" (UID: \"3a9aeaa9-bdff-44d6-85f4-06375e0c97ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n" Jul 28 00:02:16.462142 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.462125 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6800826-e553-484f-8ed6-32f10a400f5f-image-registry-private-configuration\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:16.468298 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.468270 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-bound-sa-token\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:16.468417 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.468360 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbr8c\" (UniqueName: \"kubernetes.io/projected/8b547976-0a9f-481c-bb16-884e484d1b69-kube-api-access-mbr8c\") pod \"console-operator-584dcb6b54-6w6lx\" (UID: \"8b547976-0a9f-481c-bb16-884e484d1b69\") " pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" Jul 28 00:02:16.468482 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.468432 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2xhb\" (UniqueName: \"kubernetes.io/projected/a42da2e2-fca2-4f1b-b7e1-98d538dcf473-kube-api-access-q2xhb\") pod \"volume-data-source-validator-549c6d54cf-vp982\" (UID: \"a42da2e2-fca2-4f1b-b7e1-98d538dcf473\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vp982" Jul 28 00:02:16.469139 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.469120 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wnrl\" (UniqueName: \"kubernetes.io/projected/3a9aeaa9-bdff-44d6-85f4-06375e0c97ce-kube-api-access-6wnrl\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n\" (UID: \"3a9aeaa9-bdff-44d6-85f4-06375e0c97ce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n" Jul 28 00:02:16.469667 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.469651 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxkd8\" (UniqueName: \"kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-kube-api-access-vxkd8\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:16.602706 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.602675 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vp982" Jul 28 00:02:16.632569 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.632529 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" Jul 28 00:02:16.655335 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.655275 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n" Jul 28 00:02:16.762233 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.762196 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vp982"] Jul 28 00:02:16.766446 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:02:16.766414 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda42da2e2_fca2_4f1b_b7e1_98d538dcf473.slice/crio-08782b2859cef35f737d332119594b344a1e9a9c05446e7b95bf4d6f05dbe59a WatchSource:0}: Error finding container 08782b2859cef35f737d332119594b344a1e9a9c05446e7b95bf4d6f05dbe59a: Status 404 returned error can't find the container with id 08782b2859cef35f737d332119594b344a1e9a9c05446e7b95bf4d6f05dbe59a Jul 28 00:02:16.797381 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.797265 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-6w6lx"] Jul 28 00:02:16.799923 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:02:16.799889 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b547976_0a9f_481c_bb16_884e484d1b69.slice/crio-a76be61512d9a4ce626c8ed622777e94999c6fef1c1844f6f1a48d9a41576f93 WatchSource:0}: Error finding container a76be61512d9a4ce626c8ed622777e94999c6fef1c1844f6f1a48d9a41576f93: Status 404 returned error can't find the container with id a76be61512d9a4ce626c8ed622777e94999c6fef1c1844f6f1a48d9a41576f93 Jul 28 00:02:16.814636 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.814611 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n"] Jul 28 00:02:16.817832 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:02:16.817808 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a9aeaa9_bdff_44d6_85f4_06375e0c97ce.slice/crio-242a544e903703f262709e19680864719a42444f3bdd682ef54ecf254da76394 WatchSource:0}: Error finding container 242a544e903703f262709e19680864719a42444f3bdd682ef54ecf254da76394: Status 404 returned error can't find the container with id 242a544e903703f262709e19680864719a42444f3bdd682ef54ecf254da76394 Jul 28 00:02:16.864592 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.864556 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57909377-68d5-4ecb-b1dc-3ebece8627a7-service-ca-bundle\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:16.864796 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.864614 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0674b82c-2b52-4f92-b1b9-adefc4f30141-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-svw4n\" (UID: \"0674b82c-2b52-4f92-b1b9-adefc4f30141\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n" Jul 28 00:02:16.864796 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:16.864708 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-metrics-certs\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:16.864796 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:16.864727 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57909377-68d5-4ecb-b1dc-3ebece8627a7-service-ca-bundle podName:57909377-68d5-4ecb-b1dc-3ebece8627a7 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:17.86470374 +0000 UTC m=+62.981209153 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/57909377-68d5-4ecb-b1dc-3ebece8627a7-service-ca-bundle") pod "router-default-679f79d87c-8wpbk" (UID: "57909377-68d5-4ecb-b1dc-3ebece8627a7") : configmap references non-existent config key: service-ca.crt Jul 28 00:02:16.864796 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:16.864787 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 00:02:16.864989 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:16.864816 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 00:02:16.864989 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:16.864835 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0674b82c-2b52-4f92-b1b9-adefc4f30141-cluster-monitoring-operator-tls podName:0674b82c-2b52-4f92-b1b9-adefc4f30141 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:17.864822056 +0000 UTC m=+62.981327457 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0674b82c-2b52-4f92-b1b9-adefc4f30141-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-svw4n" (UID: "0674b82c-2b52-4f92-b1b9-adefc4f30141") : secret "cluster-monitoring-operator-tls" not found Jul 28 00:02:16.864989 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:16.864866 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-metrics-certs podName:57909377-68d5-4ecb-b1dc-3ebece8627a7 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:17.864850584 +0000 UTC m=+62.981355976 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-metrics-certs") pod "router-default-679f79d87c-8wpbk" (UID: "57909377-68d5-4ecb-b1dc-3ebece8627a7") : secret "router-metrics-certs-default" not found Jul 28 00:02:17.181447 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:17.181415 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tgc5p\"" Jul 28 00:02:17.346739 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:17.346701 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 00:02:17.352467 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:17.352439 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6800826-e553-484f-8ed6-32f10a400f5f-installation-pull-secrets\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:17.460513 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:17.460424 2574 configmap.go:193] Couldn't get configMap openshift-image-registry/trusted-ca: failed to sync configmap cache: timed out waiting for the condition Jul 28 00:02:17.460671 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:17.460524 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6800826-e553-484f-8ed6-32f10a400f5f-trusted-ca podName:c6800826-e553-484f-8ed6-32f10a400f5f nodeName:}" failed. No retries permitted until 2026-07-28 00:02:17.960498662 +0000 UTC m=+63.077004054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "trusted-ca" (UniqueName: "kubernetes.io/configmap/c6800826-e553-484f-8ed6-32f10a400f5f-trusted-ca") pod "image-registry-5fd5f75b7c-fms6d" (UID: "c6800826-e553-484f-8ed6-32f10a400f5f") : failed to sync configmap cache: timed out waiting for the condition Jul 28 00:02:17.460671 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:17.460440 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: failed to sync secret cache: timed out waiting for the condition Jul 28 00:02:17.460671 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:17.460543 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd5f75b7c-fms6d: failed to sync secret cache: timed out waiting for the condition Jul 28 00:02:17.460671 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:17.460580 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-registry-tls podName:c6800826-e553-484f-8ed6-32f10a400f5f nodeName:}" failed. No retries permitted until 2026-07-28 00:02:17.960571403 +0000 UTC m=+63.077076793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-registry-tls") pod "image-registry-5fd5f75b7c-fms6d" (UID: "c6800826-e553-484f-8ed6-32f10a400f5f") : failed to sync secret cache: timed out waiting for the condition Jul 28 00:02:17.593402 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:17.593359 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vp982" event={"ID":"a42da2e2-fca2-4f1b-b7e1-98d538dcf473","Type":"ContainerStarted","Data":"08782b2859cef35f737d332119594b344a1e9a9c05446e7b95bf4d6f05dbe59a"} Jul 28 00:02:17.594677 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:17.594643 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" event={"ID":"8b547976-0a9f-481c-bb16-884e484d1b69","Type":"ContainerStarted","Data":"a76be61512d9a4ce626c8ed622777e94999c6fef1c1844f6f1a48d9a41576f93"} Jul 28 00:02:17.596100 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:17.596071 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n" event={"ID":"3a9aeaa9-bdff-44d6-85f4-06375e0c97ce","Type":"ContainerStarted","Data":"242a544e903703f262709e19680864719a42444f3bdd682ef54ecf254da76394"} Jul 28 00:02:17.745502 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:17.745419 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 00:02:17.874534 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:17.874495 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-metrics-certs\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:17.874980 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:17.874575 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57909377-68d5-4ecb-b1dc-3ebece8627a7-service-ca-bundle\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:17.874980 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:17.874619 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0674b82c-2b52-4f92-b1b9-adefc4f30141-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-svw4n\" (UID: \"0674b82c-2b52-4f92-b1b9-adefc4f30141\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n" Jul 28 00:02:17.874980 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:17.874806 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 00:02:17.874980 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:17.874839 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 00:02:17.874980 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:17.874875 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57909377-68d5-4ecb-b1dc-3ebece8627a7-service-ca-bundle podName:57909377-68d5-4ecb-b1dc-3ebece8627a7 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:19.874851899 +0000 UTC m=+64.991357292 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/57909377-68d5-4ecb-b1dc-3ebece8627a7-service-ca-bundle") pod "router-default-679f79d87c-8wpbk" (UID: "57909377-68d5-4ecb-b1dc-3ebece8627a7") : configmap references non-existent config key: service-ca.crt Jul 28 00:02:17.874980 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:17.874902 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0674b82c-2b52-4f92-b1b9-adefc4f30141-cluster-monitoring-operator-tls podName:0674b82c-2b52-4f92-b1b9-adefc4f30141 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:19.874890474 +0000 UTC m=+64.991395864 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0674b82c-2b52-4f92-b1b9-adefc4f30141-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-svw4n" (UID: "0674b82c-2b52-4f92-b1b9-adefc4f30141") : secret "cluster-monitoring-operator-tls" not found Jul 28 00:02:17.874980 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:17.874917 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-metrics-certs podName:57909377-68d5-4ecb-b1dc-3ebece8627a7 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:19.874907879 +0000 UTC m=+64.991413270 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-metrics-certs") pod "router-default-679f79d87c-8wpbk" (UID: "57909377-68d5-4ecb-b1dc-3ebece8627a7") : secret "router-metrics-certs-default" not found Jul 28 00:02:17.914696 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:17.914658 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 00:02:17.975533 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:17.975497 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-registry-tls\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:17.975706 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:17.975585 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6800826-e553-484f-8ed6-32f10a400f5f-trusted-ca\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:17.975809 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:17.975654 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:02:17.975809 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:17.975727 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd5f75b7c-fms6d: secret "image-registry-tls" not found Jul 28 00:02:17.975904 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:17.975822 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-registry-tls podName:c6800826-e553-484f-8ed6-32f10a400f5f nodeName:}" failed. No retries permitted until 2026-07-28 00:02:18.975796773 +0000 UTC m=+64.092302164 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-registry-tls") pod "image-registry-5fd5f75b7c-fms6d" (UID: "c6800826-e553-484f-8ed6-32f10a400f5f") : secret "image-registry-tls" not found Jul 28 00:02:17.976703 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:17.976675 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6800826-e553-484f-8ed6-32f10a400f5f-trusted-ca\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:18.982888 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:18.982841 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-registry-tls\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:18.983256 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:18.983002 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:02:18.983256 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:18.983025 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd5f75b7c-fms6d: secret "image-registry-tls" not found Jul 28 00:02:18.983256 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:18.983078 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-registry-tls podName:c6800826-e553-484f-8ed6-32f10a400f5f nodeName:}" failed. No retries permitted until 2026-07-28 00:02:20.983063184 +0000 UTC m=+66.099568574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-registry-tls") pod "image-registry-5fd5f75b7c-fms6d" (UID: "c6800826-e553-484f-8ed6-32f10a400f5f") : secret "image-registry-tls" not found Jul 28 00:02:19.602404 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:19.602371 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6w6lx_8b547976-0a9f-481c-bb16-884e484d1b69/console-operator/0.log" Jul 28 00:02:19.602639 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:19.602419 2574 generic.go:356] "Generic (PLEG): container finished" podID="8b547976-0a9f-481c-bb16-884e484d1b69" containerID="5728165b4664a99239a921fa95d6c4662c6d2828552c143ce16ac51661473c62" exitCode=255 Jul 28 00:02:19.602639 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:19.602509 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" event={"ID":"8b547976-0a9f-481c-bb16-884e484d1b69","Type":"ContainerDied","Data":"5728165b4664a99239a921fa95d6c4662c6d2828552c143ce16ac51661473c62"} Jul 28 00:02:19.602839 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:19.602739 2574 scope.go:117] "RemoveContainer" containerID="5728165b4664a99239a921fa95d6c4662c6d2828552c143ce16ac51661473c62" Jul 28 00:02:19.604051 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:19.604026 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n" event={"ID":"3a9aeaa9-bdff-44d6-85f4-06375e0c97ce","Type":"ContainerStarted","Data":"fc4c5efd8ab6b14e6b5d6b8fbdb175a71c7b44ba1cdf8fc576073938b09ddb5b"} Jul 28 00:02:19.605427 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:19.605406 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vp982" event={"ID":"a42da2e2-fca2-4f1b-b7e1-98d538dcf473","Type":"ContainerStarted","Data":"e482b6be1c6c02c82ddd8d1653064e30ef704cfb4a74ab2e5d466ef057e8811b"} Jul 28 00:02:19.635946 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:19.635899 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n" podStartSLOduration=1.238615203 podStartE2EDuration="3.635883055s" totalImagesPullingTime="2.397267852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:19.635298892 +0000 UTC m=+64.751804308" watchObservedRunningTime="2026-07-28 00:02:19.635883055 +0000 UTC m=+64.752388466" Jul 28 00:02:19.653510 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:19.653462 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-vp982" podStartSLOduration=1.258612919 podStartE2EDuration="3.653441578s" totalImagesPullingTime="2.394828659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:19.652356352 +0000 UTC m=+64.768861766" watchObservedRunningTime="2026-07-28 00:02:19.653441578 +0000 UTC m=+64.769946991" Jul 28 00:02:19.891207 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:19.891117 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-metrics-certs\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:19.891207 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:19.891172 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57909377-68d5-4ecb-b1dc-3ebece8627a7-service-ca-bundle\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:19.891207 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:19.891203 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0674b82c-2b52-4f92-b1b9-adefc4f30141-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-svw4n\" (UID: \"0674b82c-2b52-4f92-b1b9-adefc4f30141\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n" Jul 28 00:02:19.891480 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:19.891302 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 00:02:19.891480 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:19.891353 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57909377-68d5-4ecb-b1dc-3ebece8627a7-service-ca-bundle podName:57909377-68d5-4ecb-b1dc-3ebece8627a7 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:23.89133223 +0000 UTC m=+69.007837622 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/57909377-68d5-4ecb-b1dc-3ebece8627a7-service-ca-bundle") pod "router-default-679f79d87c-8wpbk" (UID: "57909377-68d5-4ecb-b1dc-3ebece8627a7") : configmap references non-existent config key: service-ca.crt Jul 28 00:02:19.891480 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:19.891380 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-metrics-certs podName:57909377-68d5-4ecb-b1dc-3ebece8627a7 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:23.89137115 +0000 UTC m=+69.007876540 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-metrics-certs") pod "router-default-679f79d87c-8wpbk" (UID: "57909377-68d5-4ecb-b1dc-3ebece8627a7") : secret "router-metrics-certs-default" not found Jul 28 00:02:19.891480 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:19.891390 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 00:02:19.891480 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:19.891444 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0674b82c-2b52-4f92-b1b9-adefc4f30141-cluster-monitoring-operator-tls podName:0674b82c-2b52-4f92-b1b9-adefc4f30141 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:23.891433087 +0000 UTC m=+69.007938481 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0674b82c-2b52-4f92-b1b9-adefc4f30141-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-svw4n" (UID: "0674b82c-2b52-4f92-b1b9-adefc4f30141") : secret "cluster-monitoring-operator-tls" not found Jul 28 00:02:20.609229 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:20.609200 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6w6lx_8b547976-0a9f-481c-bb16-884e484d1b69/console-operator/1.log" Jul 28 00:02:20.609657 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:20.609611 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6w6lx_8b547976-0a9f-481c-bb16-884e484d1b69/console-operator/0.log" Jul 28 00:02:20.609657 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:20.609643 2574 generic.go:356] "Generic (PLEG): container finished" podID="8b547976-0a9f-481c-bb16-884e484d1b69" containerID="3f49c221006d0c75af02ca4d0c908276fe392d11a5c50fc00ad9a75aac642954" exitCode=255 Jul 28 00:02:20.609825 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:20.609674 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" event={"ID":"8b547976-0a9f-481c-bb16-884e484d1b69","Type":"ContainerDied","Data":"3f49c221006d0c75af02ca4d0c908276fe392d11a5c50fc00ad9a75aac642954"} Jul 28 00:02:20.610232 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:20.610212 2574 scope.go:117] "RemoveContainer" containerID="5728165b4664a99239a921fa95d6c4662c6d2828552c143ce16ac51661473c62" Jul 28 00:02:20.610323 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:20.610309 2574 scope.go:117] "RemoveContainer" containerID="3f49c221006d0c75af02ca4d0c908276fe392d11a5c50fc00ad9a75aac642954" Jul 28 00:02:20.610447 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:20.610428 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-6w6lx_openshift-console-operator(8b547976-0a9f-481c-bb16-884e484d1b69)\"" pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" podUID="8b547976-0a9f-481c-bb16-884e484d1b69" Jul 28 00:02:20.999683 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:20.999585 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-registry-tls\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:20.999861 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:20.999733 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:02:20.999861 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:20.999770 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd5f75b7c-fms6d: secret "image-registry-tls" not found Jul 28 00:02:20.999861 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:20.999825 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-registry-tls podName:c6800826-e553-484f-8ed6-32f10a400f5f nodeName:}" failed. No retries permitted until 2026-07-28 00:02:24.999808079 +0000 UTC m=+70.116313468 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-registry-tls") pod "image-registry-5fd5f75b7c-fms6d" (UID: "c6800826-e553-484f-8ed6-32f10a400f5f") : secret "image-registry-tls" not found Jul 28 00:02:21.100727 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.100683 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret\") pod \"global-pull-secret-syncer-n56zd\" (UID: \"361a09af-a231-45f9-8332-fbd085df9a5f\") " pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:02:21.100947 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.100740 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w4sp\" (UniqueName: \"kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp\") pod \"network-check-target-dflsn\" (UID: \"65d808ec-5de9-4dfa-9c3e-e45a41f3ccde\") " pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:02:21.100947 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.100787 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs\") pod \"network-metrics-daemon-f29s8\" (UID: \"5894c611-99f4-4459-8619-63305e3d25d1\") " pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:02:21.103544 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.103521 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 00:02:21.103661 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.103573 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 00:02:21.103661 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.103529 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 00:02:21.111859 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:21.111835 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 28 00:02:21.111965 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:21.111893 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs podName:5894c611-99f4-4459-8619-63305e3d25d1 nodeName:}" failed. No retries permitted until 2026-07-28 00:03:25.111875842 +0000 UTC m=+130.228381232 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs") pod "network-metrics-daemon-f29s8" (UID: "5894c611-99f4-4459-8619-63305e3d25d1") : secret "metrics-daemon-secret" not found Jul 28 00:02:21.113982 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.113962 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 00:02:21.114071 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.113981 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/361a09af-a231-45f9-8332-fbd085df9a5f-original-pull-secret\") pod \"global-pull-secret-syncer-n56zd\" (UID: \"361a09af-a231-45f9-8332-fbd085df9a5f\") " pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:02:21.124749 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.124724 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w4sp\" (UniqueName: \"kubernetes.io/projected/65d808ec-5de9-4dfa-9c3e-e45a41f3ccde-kube-api-access-5w4sp\") pod \"network-check-target-dflsn\" (UID: \"65d808ec-5de9-4dfa-9c3e-e45a41f3ccde\") " pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:02:21.278218 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.278136 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n56zd" Jul 28 00:02:21.290350 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.290323 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bxxgg\"" Jul 28 00:02:21.298672 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.298648 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:02:21.418904 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.418870 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n56zd"] Jul 28 00:02:21.421615 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:02:21.421587 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361a09af_a231_45f9_8332_fbd085df9a5f.slice/crio-c99d1d7850c153b85e79189099bb0d735412ce1cbf58233bfb564dd874569942 WatchSource:0}: Error finding container c99d1d7850c153b85e79189099bb0d735412ce1cbf58233bfb564dd874569942: Status 404 returned error can't find the container with id c99d1d7850c153b85e79189099bb0d735412ce1cbf58233bfb564dd874569942 Jul 28 00:02:21.434674 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.434646 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8dxf9"] Jul 28 00:02:21.475308 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.475265 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dflsn"] Jul 28 00:02:21.475308 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.475307 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8dxf9"] Jul 28 00:02:21.475550 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.475415 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:21.479041 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.479020 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 00:02:21.479594 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.479574 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 00:02:21.479712 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.479606 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 00:02:21.480097 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.480081 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-98st5\"" Jul 28 00:02:21.485776 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.485746 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 00:02:21.503418 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.503387 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttlnm\" (UniqueName: \"kubernetes.io/projected/5183a10e-9591-4737-94b4-fd2490a6adf3-kube-api-access-ttlnm\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:21.503520 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.503501 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5183a10e-9591-4737-94b4-fd2490a6adf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:21.503589 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.503548 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5183a10e-9591-4737-94b4-fd2490a6adf3-crio-socket\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:21.503589 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.503579 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5183a10e-9591-4737-94b4-fd2490a6adf3-data-volume\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:21.503673 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.503610 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5183a10e-9591-4737-94b4-fd2490a6adf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:21.604187 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.604145 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttlnm\" (UniqueName: \"kubernetes.io/projected/5183a10e-9591-4737-94b4-fd2490a6adf3-kube-api-access-ttlnm\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:21.604376 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.604228 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls\") pod \"dns-default-7zf7v\" (UID: \"e6289e83-59b7-439e-8461-6c85c6828ddb\") " pod="openshift-dns/dns-default-7zf7v" Jul 28 00:02:21.604376 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.604292 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5183a10e-9591-4737-94b4-fd2490a6adf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:21.604376 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.604324 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5183a10e-9591-4737-94b4-fd2490a6adf3-crio-socket\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:21.604376 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.604350 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5183a10e-9591-4737-94b4-fd2490a6adf3-data-volume\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:21.604576 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.604379 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5183a10e-9591-4737-94b4-fd2490a6adf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:21.604576 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.604434 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5183a10e-9591-4737-94b4-fd2490a6adf3-crio-socket\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:21.604576 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:21.604457 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:02:21.604576 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:21.604469 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 00:02:21.604576 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:21.604522 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5183a10e-9591-4737-94b4-fd2490a6adf3-insights-runtime-extractor-tls podName:5183a10e-9591-4737-94b4-fd2490a6adf3 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:22.104500688 +0000 UTC m=+67.221006085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5183a10e-9591-4737-94b4-fd2490a6adf3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8dxf9" (UID: "5183a10e-9591-4737-94b4-fd2490a6adf3") : secret "insights-runtime-extractor-tls" not found Jul 28 00:02:21.604576 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:21.604526 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:02:21.604576 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:21.604542 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5183a10e-9591-4737-94b4-fd2490a6adf3-kube-rbac-proxy-cm podName:5183a10e-9591-4737-94b4-fd2490a6adf3 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:22.10453062 +0000 UTC m=+67.221036015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5183a10e-9591-4737-94b4-fd2490a6adf3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8dxf9" (UID: "5183a10e-9591-4737-94b4-fd2490a6adf3") : configmap "kube-rbac-proxy" not found Jul 28 00:02:21.604576 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:21.604564 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls podName:e6289e83-59b7-439e-8461-6c85c6828ddb nodeName:}" failed. No retries permitted until 2026-07-28 00:02:53.604553343 +0000 UTC m=+98.721058746 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls") pod "dns-default-7zf7v" (UID: "e6289e83-59b7-439e-8461-6c85c6828ddb") : secret "dns-default-metrics-tls" not found Jul 28 00:02:21.604932 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.604674 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5183a10e-9591-4737-94b4-fd2490a6adf3-data-volume\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:21.612713 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.612683 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttlnm\" (UniqueName: \"kubernetes.io/projected/5183a10e-9591-4737-94b4-fd2490a6adf3-kube-api-access-ttlnm\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:21.613673 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.613656 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6w6lx_8b547976-0a9f-481c-bb16-884e484d1b69/console-operator/1.log" Jul 28 00:02:21.614073 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.614057 2574 scope.go:117] "RemoveContainer" containerID="3f49c221006d0c75af02ca4d0c908276fe392d11a5c50fc00ad9a75aac642954" Jul 28 00:02:21.614234 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:21.614216 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-6w6lx_openshift-console-operator(8b547976-0a9f-481c-bb16-884e484d1b69)\"" pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" podUID="8b547976-0a9f-481c-bb16-884e484d1b69" Jul 28 00:02:21.614842 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.614820 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n56zd" event={"ID":"361a09af-a231-45f9-8332-fbd085df9a5f","Type":"ContainerStarted","Data":"c99d1d7850c153b85e79189099bb0d735412ce1cbf58233bfb564dd874569942"} Jul 28 00:02:21.615809 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:21.615789 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dflsn" event={"ID":"65d808ec-5de9-4dfa-9c3e-e45a41f3ccde","Type":"ContainerStarted","Data":"0a784c8b05dfb548cd21fba43acd7b814a652388699c6dd61b98ca9d8b5d4795"} Jul 28 00:02:22.108698 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:22.108655 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5183a10e-9591-4737-94b4-fd2490a6adf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:22.108928 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:22.108729 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5183a10e-9591-4737-94b4-fd2490a6adf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:22.108928 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:22.108845 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:02:22.108928 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:22.108921 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5183a10e-9591-4737-94b4-fd2490a6adf3-insights-runtime-extractor-tls podName:5183a10e-9591-4737-94b4-fd2490a6adf3 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:23.108900831 +0000 UTC m=+68.225406226 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5183a10e-9591-4737-94b4-fd2490a6adf3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8dxf9" (UID: "5183a10e-9591-4737-94b4-fd2490a6adf3") : secret "insights-runtime-extractor-tls" not found Jul 28 00:02:22.109094 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:22.108949 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 00:02:22.109094 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:22.109002 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5183a10e-9591-4737-94b4-fd2490a6adf3-kube-rbac-proxy-cm podName:5183a10e-9591-4737-94b4-fd2490a6adf3 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:23.108986181 +0000 UTC m=+68.225491575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5183a10e-9591-4737-94b4-fd2490a6adf3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8dxf9" (UID: "5183a10e-9591-4737-94b4-fd2490a6adf3") : configmap "kube-rbac-proxy" not found Jul 28 00:02:22.899346 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:22.899312 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-m999l"] Jul 28 00:02:22.916103 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:22.915624 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-m999l"] Jul 28 00:02:22.916103 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:22.915744 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-m999l" Jul 28 00:02:22.919300 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:22.919230 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 28 00:02:22.919300 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:22.919263 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 28 00:02:22.920785 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:22.920474 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-9db57\"" Jul 28 00:02:22.920785 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:22.920563 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 28 00:02:22.920966 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:22.920939 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 28 00:02:23.017153 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:23.017118 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c371b551-6de3-4739-9699-d452ba1b3c7c-signing-cabundle\") pod \"service-ca-658d7b7c78-m999l\" (UID: \"c371b551-6de3-4739-9699-d452ba1b3c7c\") " pod="openshift-service-ca/service-ca-658d7b7c78-m999l" Jul 28 00:02:23.017343 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:23.017239 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c371b551-6de3-4739-9699-d452ba1b3c7c-signing-key\") pod \"service-ca-658d7b7c78-m999l\" (UID: \"c371b551-6de3-4739-9699-d452ba1b3c7c\") " pod="openshift-service-ca/service-ca-658d7b7c78-m999l" Jul 28 00:02:23.017343 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:23.017287 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzc9h\" (UniqueName: \"kubernetes.io/projected/c371b551-6de3-4739-9699-d452ba1b3c7c-kube-api-access-lzc9h\") pod \"service-ca-658d7b7c78-m999l\" (UID: \"c371b551-6de3-4739-9699-d452ba1b3c7c\") " pod="openshift-service-ca/service-ca-658d7b7c78-m999l" Jul 28 00:02:23.118594 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:23.118555 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5183a10e-9591-4737-94b4-fd2490a6adf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:23.118806 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:23.118615 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c371b551-6de3-4739-9699-d452ba1b3c7c-signing-cabundle\") pod \"service-ca-658d7b7c78-m999l\" (UID: \"c371b551-6de3-4739-9699-d452ba1b3c7c\") " pod="openshift-service-ca/service-ca-658d7b7c78-m999l" Jul 28 00:02:23.118806 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:23.118655 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5183a10e-9591-4737-94b4-fd2490a6adf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:23.118806 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:23.118713 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c371b551-6de3-4739-9699-d452ba1b3c7c-signing-key\") pod \"service-ca-658d7b7c78-m999l\" (UID: \"c371b551-6de3-4739-9699-d452ba1b3c7c\") " pod="openshift-service-ca/service-ca-658d7b7c78-m999l" Jul 28 00:02:23.118806 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:23.118738 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzc9h\" (UniqueName: \"kubernetes.io/projected/c371b551-6de3-4739-9699-d452ba1b3c7c-kube-api-access-lzc9h\") pod \"service-ca-658d7b7c78-m999l\" (UID: \"c371b551-6de3-4739-9699-d452ba1b3c7c\") " pod="openshift-service-ca/service-ca-658d7b7c78-m999l" Jul 28 00:02:23.118806 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:23.118771 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:02:23.119032 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:23.118843 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5183a10e-9591-4737-94b4-fd2490a6adf3-insights-runtime-extractor-tls podName:5183a10e-9591-4737-94b4-fd2490a6adf3 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:25.118823643 +0000 UTC m=+70.235329034 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5183a10e-9591-4737-94b4-fd2490a6adf3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8dxf9" (UID: "5183a10e-9591-4737-94b4-fd2490a6adf3") : secret "insights-runtime-extractor-tls" not found Jul 28 00:02:23.119107 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:23.119086 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 00:02:23.119234 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:23.119134 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5183a10e-9591-4737-94b4-fd2490a6adf3-kube-rbac-proxy-cm podName:5183a10e-9591-4737-94b4-fd2490a6adf3 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:25.119121105 +0000 UTC m=+70.235626524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5183a10e-9591-4737-94b4-fd2490a6adf3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8dxf9" (UID: "5183a10e-9591-4737-94b4-fd2490a6adf3") : configmap "kube-rbac-proxy" not found Jul 28 00:02:23.119447 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:23.119426 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c371b551-6de3-4739-9699-d452ba1b3c7c-signing-cabundle\") pod \"service-ca-658d7b7c78-m999l\" (UID: \"c371b551-6de3-4739-9699-d452ba1b3c7c\") " pod="openshift-service-ca/service-ca-658d7b7c78-m999l" Jul 28 00:02:23.121993 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:23.121968 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c371b551-6de3-4739-9699-d452ba1b3c7c-signing-key\") pod \"service-ca-658d7b7c78-m999l\" (UID: \"c371b551-6de3-4739-9699-d452ba1b3c7c\") " pod="openshift-service-ca/service-ca-658d7b7c78-m999l" Jul 28 00:02:23.127027 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:23.126974 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzc9h\" (UniqueName: \"kubernetes.io/projected/c371b551-6de3-4739-9699-d452ba1b3c7c-kube-api-access-lzc9h\") pod \"service-ca-658d7b7c78-m999l\" (UID: \"c371b551-6de3-4739-9699-d452ba1b3c7c\") " pod="openshift-service-ca/service-ca-658d7b7c78-m999l" Jul 28 00:02:23.230967 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:23.230783 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-m999l" Jul 28 00:02:23.409537 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:23.409507 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-m999l"] Jul 28 00:02:23.414064 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:02:23.413237 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc371b551_6de3_4739_9699_d452ba1b3c7c.slice/crio-3c530a4b3071ed40ab7938f809ffd18b9767f34f17748cd631af0e6f61ac3bcf WatchSource:0}: Error finding container 3c530a4b3071ed40ab7938f809ffd18b9767f34f17748cd631af0e6f61ac3bcf: Status 404 returned error can't find the container with id 3c530a4b3071ed40ab7938f809ffd18b9767f34f17748cd631af0e6f61ac3bcf Jul 28 00:02:23.616660 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:23.616632 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-27gsr_cc43fba5-dd78-4101-88e2-58f00af58ef1/dns-node-resolver/0.log" Jul 28 00:02:23.622979 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:23.622936 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-m999l" event={"ID":"c371b551-6de3-4739-9699-d452ba1b3c7c","Type":"ContainerStarted","Data":"3c530a4b3071ed40ab7938f809ffd18b9767f34f17748cd631af0e6f61ac3bcf"} Jul 28 00:02:23.927621 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:23.927517 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-metrics-certs\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:23.927621 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:23.927598 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57909377-68d5-4ecb-b1dc-3ebece8627a7-service-ca-bundle\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:23.928172 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:23.927631 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0674b82c-2b52-4f92-b1b9-adefc4f30141-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-svw4n\" (UID: \"0674b82c-2b52-4f92-b1b9-adefc4f30141\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n" Jul 28 00:02:23.928172 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:23.927698 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 00:02:23.928172 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:23.927745 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 00:02:23.928172 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:23.927800 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57909377-68d5-4ecb-b1dc-3ebece8627a7-service-ca-bundle podName:57909377-68d5-4ecb-b1dc-3ebece8627a7 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:31.927776688 +0000 UTC m=+77.044282092 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/57909377-68d5-4ecb-b1dc-3ebece8627a7-service-ca-bundle") pod "router-default-679f79d87c-8wpbk" (UID: "57909377-68d5-4ecb-b1dc-3ebece8627a7") : configmap references non-existent config key: service-ca.crt Jul 28 00:02:23.928172 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:23.927832 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0674b82c-2b52-4f92-b1b9-adefc4f30141-cluster-monitoring-operator-tls podName:0674b82c-2b52-4f92-b1b9-adefc4f30141 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:31.927819305 +0000 UTC m=+77.044324701 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0674b82c-2b52-4f92-b1b9-adefc4f30141-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-svw4n" (UID: "0674b82c-2b52-4f92-b1b9-adefc4f30141") : secret "cluster-monitoring-operator-tls" not found Jul 28 00:02:23.928172 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:23.927851 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-metrics-certs podName:57909377-68d5-4ecb-b1dc-3ebece8627a7 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:31.927840484 +0000 UTC m=+77.044345888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-metrics-certs") pod "router-default-679f79d87c-8wpbk" (UID: "57909377-68d5-4ecb-b1dc-3ebece8627a7") : secret "router-metrics-certs-default" not found Jul 28 00:02:25.017517 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:25.017487 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ckjf9_0823e600-8868-4c59-b929-7d0a7ae34711/node-ca/0.log" Jul 28 00:02:25.037959 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:25.037917 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-registry-tls\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:25.038139 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:25.038066 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:02:25.038139 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:25.038084 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd5f75b7c-fms6d: secret "image-registry-tls" not found Jul 28 00:02:25.038229 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:25.038146 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-registry-tls podName:c6800826-e553-484f-8ed6-32f10a400f5f nodeName:}" failed. No retries permitted until 2026-07-28 00:02:33.038128215 +0000 UTC m=+78.154633610 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-registry-tls") pod "image-registry-5fd5f75b7c-fms6d" (UID: "c6800826-e553-484f-8ed6-32f10a400f5f") : secret "image-registry-tls" not found Jul 28 00:02:25.138652 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:25.138608 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5183a10e-9591-4737-94b4-fd2490a6adf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:25.138844 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:25.138678 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5183a10e-9591-4737-94b4-fd2490a6adf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:25.138844 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:25.138732 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:02:25.138844 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:25.138777 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 00:02:25.138844 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:25.138822 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5183a10e-9591-4737-94b4-fd2490a6adf3-insights-runtime-extractor-tls podName:5183a10e-9591-4737-94b4-fd2490a6adf3 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:29.138806415 +0000 UTC m=+74.255311806 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5183a10e-9591-4737-94b4-fd2490a6adf3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8dxf9" (UID: "5183a10e-9591-4737-94b4-fd2490a6adf3") : secret "insights-runtime-extractor-tls" not found Jul 28 00:02:25.138844 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:25.138839 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5183a10e-9591-4737-94b4-fd2490a6adf3-kube-rbac-proxy-cm podName:5183a10e-9591-4737-94b4-fd2490a6adf3 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:29.138831042 +0000 UTC m=+74.255336431 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5183a10e-9591-4737-94b4-fd2490a6adf3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8dxf9" (UID: "5183a10e-9591-4737-94b4-fd2490a6adf3") : configmap "kube-rbac-proxy" not found Jul 28 00:02:25.818135 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:25.818095 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-stwkz_acbb6d5a-520b-4258-bea6-85a4c279d823/serve-healthcheck-canary/0.log" Jul 28 00:02:26.419431 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:26.419349 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n_3a9aeaa9-bdff-44d6-85f4-06375e0c97ce/kube-storage-version-migrator-operator/0.log" Jul 28 00:02:26.632721 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:26.632693 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" Jul 28 00:02:26.632921 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:26.632792 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" Jul 28 00:02:26.633222 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:26.633201 2574 scope.go:117] "RemoveContainer" containerID="3f49c221006d0c75af02ca4d0c908276fe392d11a5c50fc00ad9a75aac642954" Jul 28 00:02:26.633424 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:26.633399 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-6w6lx_openshift-console-operator(8b547976-0a9f-481c-bb16-884e484d1b69)\"" pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" podUID="8b547976-0a9f-481c-bb16-884e484d1b69" Jul 28 00:02:26.634282 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:26.634252 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n56zd" event={"ID":"361a09af-a231-45f9-8332-fbd085df9a5f","Type":"ContainerStarted","Data":"6c2ec0a92984bf4df9693495b2874b206981af699f0aa262d3001b28fef88a5a"} Jul 28 00:02:26.635867 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:26.635839 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dflsn" event={"ID":"65d808ec-5de9-4dfa-9c3e-e45a41f3ccde","Type":"ContainerStarted","Data":"e7dad938e422c87cfec2b462fd5b966b832b5495e8ceecc7f951c4e7053eba53"} Jul 28 00:02:26.636001 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:26.635978 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:02:26.649460 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:26.649393 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n56zd" podStartSLOduration=67.009294244 podStartE2EDuration="1m11.649374344s" totalImagesPullingTime="4.6400801s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:26.649177305 +0000 UTC m=+71.765682717" watchObservedRunningTime="2026-07-28 00:02:26.649374344 +0000 UTC m=+71.765879751" Jul 28 00:02:26.668047 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:26.667993 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dflsn" podStartSLOduration=67.052995681 podStartE2EDuration="1m11.667970049s" totalImagesPullingTime="4.614974368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:26.666818735 +0000 UTC m=+71.783324147" watchObservedRunningTime="2026-07-28 00:02:26.667970049 +0000 UTC m=+71.784475462" Jul 28 00:02:28.642702 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:28.642662 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-m999l" event={"ID":"c371b551-6de3-4739-9699-d452ba1b3c7c","Type":"ContainerStarted","Data":"3a315b3d46086a6cf63e1e6260f5d2bd86180a70b941873aad87050a48470d1e"} Jul 28 00:02:29.174414 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:29.174364 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5183a10e-9591-4737-94b4-fd2490a6adf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:29.174590 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:29.174437 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5183a10e-9591-4737-94b4-fd2490a6adf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:29.174590 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:29.174514 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:02:29.174590 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:29.174579 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5183a10e-9591-4737-94b4-fd2490a6adf3-insights-runtime-extractor-tls podName:5183a10e-9591-4737-94b4-fd2490a6adf3 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:37.174562733 +0000 UTC m=+82.291068123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5183a10e-9591-4737-94b4-fd2490a6adf3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8dxf9" (UID: "5183a10e-9591-4737-94b4-fd2490a6adf3") : secret "insights-runtime-extractor-tls" not found Jul 28 00:02:29.174706 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:29.174523 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 00:02:29.174706 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:29.174658 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5183a10e-9591-4737-94b4-fd2490a6adf3-kube-rbac-proxy-cm podName:5183a10e-9591-4737-94b4-fd2490a6adf3 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:37.174640041 +0000 UTC m=+82.291145434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5183a10e-9591-4737-94b4-fd2490a6adf3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8dxf9" (UID: "5183a10e-9591-4737-94b4-fd2490a6adf3") : configmap "kube-rbac-proxy" not found Jul 28 00:02:31.998688 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:31.998640 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-metrics-certs\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:31.999200 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:31.998704 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57909377-68d5-4ecb-b1dc-3ebece8627a7-service-ca-bundle\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:31.999200 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:31.998734 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0674b82c-2b52-4f92-b1b9-adefc4f30141-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-svw4n\" (UID: \"0674b82c-2b52-4f92-b1b9-adefc4f30141\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n" Jul 28 00:02:31.999200 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:31.998806 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 00:02:31.999200 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:31.998860 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 00:02:31.999200 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:31.998865 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-metrics-certs podName:57909377-68d5-4ecb-b1dc-3ebece8627a7 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:47.998849358 +0000 UTC m=+93.115354749 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-metrics-certs") pod "router-default-679f79d87c-8wpbk" (UID: "57909377-68d5-4ecb-b1dc-3ebece8627a7") : secret "router-metrics-certs-default" not found Jul 28 00:02:31.999200 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:31.998880 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57909377-68d5-4ecb-b1dc-3ebece8627a7-service-ca-bundle podName:57909377-68d5-4ecb-b1dc-3ebece8627a7 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:47.998873855 +0000 UTC m=+93.115379244 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/57909377-68d5-4ecb-b1dc-3ebece8627a7-service-ca-bundle") pod "router-default-679f79d87c-8wpbk" (UID: "57909377-68d5-4ecb-b1dc-3ebece8627a7") : configmap references non-existent config key: service-ca.crt Jul 28 00:02:31.999200 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:31.998892 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0674b82c-2b52-4f92-b1b9-adefc4f30141-cluster-monitoring-operator-tls podName:0674b82c-2b52-4f92-b1b9-adefc4f30141 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:47.998887275 +0000 UTC m=+93.115392665 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0674b82c-2b52-4f92-b1b9-adefc4f30141-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-svw4n" (UID: "0674b82c-2b52-4f92-b1b9-adefc4f30141") : secret "cluster-monitoring-operator-tls" not found Jul 28 00:02:33.108303 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:33.108264 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-registry-tls\") pod \"image-registry-5fd5f75b7c-fms6d\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:33.108820 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:33.108416 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:02:33.108820 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:33.108434 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd5f75b7c-fms6d: secret "image-registry-tls" not found Jul 28 00:02:33.108820 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:33.108489 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-registry-tls podName:c6800826-e553-484f-8ed6-32f10a400f5f nodeName:}" failed. No retries permitted until 2026-07-28 00:02:49.108471997 +0000 UTC m=+94.224977390 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-registry-tls") pod "image-registry-5fd5f75b7c-fms6d" (UID: "c6800826-e553-484f-8ed6-32f10a400f5f") : secret "image-registry-tls" not found Jul 28 00:02:37.243601 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:37.243564 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5183a10e-9591-4737-94b4-fd2490a6adf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:37.243601 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:37.243612 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5183a10e-9591-4737-94b4-fd2490a6adf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:37.244054 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:37.243731 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:02:37.244054 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:37.243821 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5183a10e-9591-4737-94b4-fd2490a6adf3-insights-runtime-extractor-tls podName:5183a10e-9591-4737-94b4-fd2490a6adf3 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:53.243798146 +0000 UTC m=+98.360303537 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5183a10e-9591-4737-94b4-fd2490a6adf3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8dxf9" (UID: "5183a10e-9591-4737-94b4-fd2490a6adf3") : secret "insights-runtime-extractor-tls" not found Jul 28 00:02:37.244136 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:37.244113 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5183a10e-9591-4737-94b4-fd2490a6adf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:41.366109 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:41.365961 2574 scope.go:117] "RemoveContainer" containerID="3f49c221006d0c75af02ca4d0c908276fe392d11a5c50fc00ad9a75aac642954" Jul 28 00:02:41.685099 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:41.685019 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6w6lx_8b547976-0a9f-481c-bb16-884e484d1b69/console-operator/2.log" Jul 28 00:02:41.685410 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:41.685394 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6w6lx_8b547976-0a9f-481c-bb16-884e484d1b69/console-operator/1.log" Jul 28 00:02:41.685465 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:41.685430 2574 generic.go:356] "Generic (PLEG): container finished" podID="8b547976-0a9f-481c-bb16-884e484d1b69" containerID="542f7932260eed66e0305600bf395ef756d6752e0bc0ca05fac3262fd3b4d246" exitCode=255 Jul 28 00:02:41.685509 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:41.685478 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" event={"ID":"8b547976-0a9f-481c-bb16-884e484d1b69","Type":"ContainerDied","Data":"542f7932260eed66e0305600bf395ef756d6752e0bc0ca05fac3262fd3b4d246"} Jul 28 00:02:41.685557 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:41.685525 2574 scope.go:117] "RemoveContainer" containerID="3f49c221006d0c75af02ca4d0c908276fe392d11a5c50fc00ad9a75aac642954" Jul 28 00:02:41.685889 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:41.685866 2574 scope.go:117] "RemoveContainer" containerID="542f7932260eed66e0305600bf395ef756d6752e0bc0ca05fac3262fd3b4d246" Jul 28 00:02:41.686106 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:41.686086 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-6w6lx_openshift-console-operator(8b547976-0a9f-481c-bb16-884e484d1b69)\"" pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" podUID="8b547976-0a9f-481c-bb16-884e484d1b69" Jul 28 00:02:41.703625 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:41.703579 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-m999l" podStartSLOduration=15.519046839 podStartE2EDuration="19.703565082s" totalImagesPullingTime="4.184518243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:28.659527434 +0000 UTC m=+73.776032847" watchObservedRunningTime="2026-07-28 00:02:41.703565082 +0000 UTC m=+86.820070493" Jul 28 00:02:42.690072 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:42.690044 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6w6lx_8b547976-0a9f-481c-bb16-884e484d1b69/console-operator/2.log" Jul 28 00:02:45.884384 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:45.884350 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8659cdd95b-n92qz"] Jul 28 00:02:45.888534 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:45.888511 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94"] Jul 28 00:02:45.888659 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:45.888640 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8659cdd95b-n92qz" Jul 28 00:02:45.891142 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:45.891120 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 28 00:02:45.891327 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:45.891306 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 28 00:02:45.891400 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:45.891335 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 28 00:02:45.891457 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:45.891412 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-7whnn\"" Jul 28 00:02:45.891457 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:45.891437 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" Jul 28 00:02:45.892546 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:45.892532 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 28 00:02:45.893775 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:45.893744 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 28 00:02:45.896875 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:45.896844 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8659cdd95b-n92qz"] Jul 28 00:02:45.898083 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:45.898063 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94"] Jul 28 00:02:45.969673 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:45.969643 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5fd5f75b7c-fms6d"] Jul 28 00:02:45.969909 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:45.969887 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" podUID="c6800826-e553-484f-8ed6-32f10a400f5f" Jul 28 00:02:46.008502 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.008467 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5df5f45bbb-6rmzz"] Jul 28 00:02:46.011561 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.011544 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.021914 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.021890 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zctq8\" (UniqueName: \"kubernetes.io/projected/af3c5589-dcec-4dc3-82b8-360247bfc7e0-kube-api-access-zctq8\") pod \"managed-serviceaccount-addon-agent-8659cdd95b-n92qz\" (UID: \"af3c5589-dcec-4dc3-82b8-360247bfc7e0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8659cdd95b-n92qz" Jul 28 00:02:46.022032 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.021927 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8w9m\" (UniqueName: \"kubernetes.io/projected/594d3f46-2f3c-4c40-a2ac-6597013cd069-kube-api-access-k8w9m\") pod \"klusterlet-addon-workmgr-5c89c65d5c-p2l94\" (UID: \"594d3f46-2f3c-4c40-a2ac-6597013cd069\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" Jul 28 00:02:46.022032 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.021993 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/594d3f46-2f3c-4c40-a2ac-6597013cd069-klusterlet-config\") pod \"klusterlet-addon-workmgr-5c89c65d5c-p2l94\" (UID: \"594d3f46-2f3c-4c40-a2ac-6597013cd069\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" Jul 28 00:02:46.022032 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.022026 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af3c5589-dcec-4dc3-82b8-360247bfc7e0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8659cdd95b-n92qz\" (UID: \"af3c5589-dcec-4dc3-82b8-360247bfc7e0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8659cdd95b-n92qz" Jul 28 00:02:46.022171 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.022131 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/594d3f46-2f3c-4c40-a2ac-6597013cd069-tmp\") pod \"klusterlet-addon-workmgr-5c89c65d5c-p2l94\" (UID: \"594d3f46-2f3c-4c40-a2ac-6597013cd069\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" Jul 28 00:02:46.026393 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.026344 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5df5f45bbb-6rmzz"] Jul 28 00:02:46.123271 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.123228 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-image-registry-private-configuration\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.123466 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.123285 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/594d3f46-2f3c-4c40-a2ac-6597013cd069-tmp\") pod \"klusterlet-addon-workmgr-5c89c65d5c-p2l94\" (UID: \"594d3f46-2f3c-4c40-a2ac-6597013cd069\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" Jul 28 00:02:46.123466 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.123304 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-bound-sa-token\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.123466 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.123346 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-registry-tls\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.123466 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.123395 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-registry-certificates\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.123466 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.123429 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-trusted-ca\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.123706 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.123502 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-ca-trust-extracted\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.123706 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.123567 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zctq8\" (UniqueName: \"kubernetes.io/projected/af3c5589-dcec-4dc3-82b8-360247bfc7e0-kube-api-access-zctq8\") pod \"managed-serviceaccount-addon-agent-8659cdd95b-n92qz\" (UID: \"af3c5589-dcec-4dc3-82b8-360247bfc7e0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8659cdd95b-n92qz" Jul 28 00:02:46.123706 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.123611 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8w9m\" (UniqueName: \"kubernetes.io/projected/594d3f46-2f3c-4c40-a2ac-6597013cd069-kube-api-access-k8w9m\") pod \"klusterlet-addon-workmgr-5c89c65d5c-p2l94\" (UID: \"594d3f46-2f3c-4c40-a2ac-6597013cd069\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" Jul 28 00:02:46.123706 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.123628 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8nxs\" (UniqueName: \"kubernetes.io/projected/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-kube-api-access-f8nxs\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.123706 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.123644 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/594d3f46-2f3c-4c40-a2ac-6597013cd069-tmp\") pod \"klusterlet-addon-workmgr-5c89c65d5c-p2l94\" (UID: \"594d3f46-2f3c-4c40-a2ac-6597013cd069\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" Jul 28 00:02:46.123706 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.123652 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-installation-pull-secrets\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.124023 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.123745 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/594d3f46-2f3c-4c40-a2ac-6597013cd069-klusterlet-config\") pod \"klusterlet-addon-workmgr-5c89c65d5c-p2l94\" (UID: \"594d3f46-2f3c-4c40-a2ac-6597013cd069\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" Jul 28 00:02:46.124023 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.123801 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af3c5589-dcec-4dc3-82b8-360247bfc7e0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8659cdd95b-n92qz\" (UID: \"af3c5589-dcec-4dc3-82b8-360247bfc7e0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8659cdd95b-n92qz" Jul 28 00:02:46.126288 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.126261 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/594d3f46-2f3c-4c40-a2ac-6597013cd069-klusterlet-config\") pod \"klusterlet-addon-workmgr-5c89c65d5c-p2l94\" (UID: \"594d3f46-2f3c-4c40-a2ac-6597013cd069\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" Jul 28 00:02:46.126288 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.126281 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af3c5589-dcec-4dc3-82b8-360247bfc7e0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8659cdd95b-n92qz\" (UID: \"af3c5589-dcec-4dc3-82b8-360247bfc7e0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8659cdd95b-n92qz" Jul 28 00:02:46.134375 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.134353 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zctq8\" (UniqueName: \"kubernetes.io/projected/af3c5589-dcec-4dc3-82b8-360247bfc7e0-kube-api-access-zctq8\") pod \"managed-serviceaccount-addon-agent-8659cdd95b-n92qz\" (UID: \"af3c5589-dcec-4dc3-82b8-360247bfc7e0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8659cdd95b-n92qz" Jul 28 00:02:46.134533 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.134491 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8w9m\" (UniqueName: \"kubernetes.io/projected/594d3f46-2f3c-4c40-a2ac-6597013cd069-kube-api-access-k8w9m\") pod \"klusterlet-addon-workmgr-5c89c65d5c-p2l94\" (UID: \"594d3f46-2f3c-4c40-a2ac-6597013cd069\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" Jul 28 00:02:46.206285 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.206253 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8659cdd95b-n92qz" Jul 28 00:02:46.212501 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.212475 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" Jul 28 00:02:46.224365 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.224330 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-image-registry-private-configuration\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.224592 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.224386 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-bound-sa-token\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.224592 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.224440 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-registry-tls\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.224592 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.224467 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-registry-certificates\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.224592 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.224489 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-trusted-ca\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.224931 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.224820 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-ca-trust-extracted\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.224993 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.224955 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8nxs\" (UniqueName: \"kubernetes.io/projected/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-kube-api-access-f8nxs\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.225043 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.224990 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-installation-pull-secrets\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.225202 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.225177 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-ca-trust-extracted\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.226213 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.226184 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-registry-certificates\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.226338 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.226265 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-trusted-ca\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.227696 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.227675 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-image-registry-private-configuration\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.227967 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.227949 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-registry-tls\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.228180 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.228160 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-installation-pull-secrets\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.235337 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.235312 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-bound-sa-token\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.237655 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.237624 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8nxs\" (UniqueName: \"kubernetes.io/projected/5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf-kube-api-access-f8nxs\") pod \"image-registry-5df5f45bbb-6rmzz\" (UID: \"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf\") " pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.320204 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.320166 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.349377 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.349225 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8659cdd95b-n92qz"] Jul 28 00:02:46.351823 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:02:46.351786 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf3c5589_dcec_4dc3_82b8_360247bfc7e0.slice/crio-b356bba3f5eb100bb19b242bd1e64c6b941192f0b36c5136774442b7e29b0082 WatchSource:0}: Error finding container b356bba3f5eb100bb19b242bd1e64c6b941192f0b36c5136774442b7e29b0082: Status 404 returned error can't find the container with id b356bba3f5eb100bb19b242bd1e64c6b941192f0b36c5136774442b7e29b0082 Jul 28 00:02:46.368901 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.368873 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94"] Jul 28 00:02:46.373939 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:02:46.373367 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod594d3f46_2f3c_4c40_a2ac_6597013cd069.slice/crio-6742d3d7220ef67c7751c69deb4a8554a2dfe2bc967ca3e676a07d7f2eae1cdb WatchSource:0}: Error finding container 6742d3d7220ef67c7751c69deb4a8554a2dfe2bc967ca3e676a07d7f2eae1cdb: Status 404 returned error can't find the container with id 6742d3d7220ef67c7751c69deb4a8554a2dfe2bc967ca3e676a07d7f2eae1cdb Jul 28 00:02:46.456740 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.456670 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5df5f45bbb-6rmzz"] Jul 28 00:02:46.459163 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:02:46.459138 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b1f8b4d_f1df_4e50_8c4a_ad21bd92cccf.slice/crio-ba9787bd0a4c2775847db2b6a5a0c141b572865e0f92939f506c84420e5c67de WatchSource:0}: Error finding container ba9787bd0a4c2775847db2b6a5a0c141b572865e0f92939f506c84420e5c67de: Status 404 returned error can't find the container with id ba9787bd0a4c2775847db2b6a5a0c141b572865e0f92939f506c84420e5c67de Jul 28 00:02:46.633468 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.633433 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" Jul 28 00:02:46.633608 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.633494 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" Jul 28 00:02:46.633836 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.633822 2574 scope.go:117] "RemoveContainer" containerID="542f7932260eed66e0305600bf395ef756d6752e0bc0ca05fac3262fd3b4d246" Jul 28 00:02:46.633995 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:46.633974 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-6w6lx_openshift-console-operator(8b547976-0a9f-481c-bb16-884e484d1b69)\"" pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" podUID="8b547976-0a9f-481c-bb16-884e484d1b69" Jul 28 00:02:46.703591 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.703501 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" event={"ID":"594d3f46-2f3c-4c40-a2ac-6597013cd069","Type":"ContainerStarted","Data":"6742d3d7220ef67c7751c69deb4a8554a2dfe2bc967ca3e676a07d7f2eae1cdb"} Jul 28 00:02:46.704779 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.704728 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8659cdd95b-n92qz" event={"ID":"af3c5589-dcec-4dc3-82b8-360247bfc7e0","Type":"ContainerStarted","Data":"b356bba3f5eb100bb19b242bd1e64c6b941192f0b36c5136774442b7e29b0082"} Jul 28 00:02:46.706196 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.706167 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" event={"ID":"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf","Type":"ContainerStarted","Data":"90cd68d9f6deed4b9b7e6fd88502f0bf941d9ef74c26246f54cbdb7673ad45ef"} Jul 28 00:02:46.706304 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.706217 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" event={"ID":"5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf","Type":"ContainerStarted","Data":"ba9787bd0a4c2775847db2b6a5a0c141b572865e0f92939f506c84420e5c67de"} Jul 28 00:02:46.706304 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.706179 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:46.706304 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.706280 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:02:46.712630 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.712613 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:46.750048 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.749929 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" podStartSLOduration=1.749910212 podStartE2EDuration="1.749910212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:02:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:46.749381389 +0000 UTC m=+91.865886823" watchObservedRunningTime="2026-07-28 00:02:46.749910212 +0000 UTC m=+91.866415627" Jul 28 00:02:46.831602 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.831563 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6800826-e553-484f-8ed6-32f10a400f5f-registry-certificates\") pod \"c6800826-e553-484f-8ed6-32f10a400f5f\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " Jul 28 00:02:46.831602 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.831609 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-bound-sa-token\") pod \"c6800826-e553-484f-8ed6-32f10a400f5f\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " Jul 28 00:02:46.831855 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.831638 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6800826-e553-484f-8ed6-32f10a400f5f-image-registry-private-configuration\") pod \"c6800826-e553-484f-8ed6-32f10a400f5f\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " Jul 28 00:02:46.831855 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.831669 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxkd8\" (UniqueName: \"kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-kube-api-access-vxkd8\") pod \"c6800826-e553-484f-8ed6-32f10a400f5f\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " Jul 28 00:02:46.831855 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.831695 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6800826-e553-484f-8ed6-32f10a400f5f-ca-trust-extracted\") pod \"c6800826-e553-484f-8ed6-32f10a400f5f\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " Jul 28 00:02:46.831855 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.831711 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6800826-e553-484f-8ed6-32f10a400f5f-installation-pull-secrets\") pod \"c6800826-e553-484f-8ed6-32f10a400f5f\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " Jul 28 00:02:46.832119 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.831972 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6800826-e553-484f-8ed6-32f10a400f5f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c6800826-e553-484f-8ed6-32f10a400f5f" (UID: "c6800826-e553-484f-8ed6-32f10a400f5f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:02:46.832119 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.832075 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6800826-e553-484f-8ed6-32f10a400f5f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c6800826-e553-484f-8ed6-32f10a400f5f" (UID: "c6800826-e553-484f-8ed6-32f10a400f5f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:02:46.832211 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.832189 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6800826-e553-484f-8ed6-32f10a400f5f-trusted-ca\") pod \"c6800826-e553-484f-8ed6-32f10a400f5f\" (UID: \"c6800826-e553-484f-8ed6-32f10a400f5f\") " Jul 28 00:02:46.832625 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.832595 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6800826-e553-484f-8ed6-32f10a400f5f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c6800826-e553-484f-8ed6-32f10a400f5f" (UID: "c6800826-e553-484f-8ed6-32f10a400f5f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:02:46.832737 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.832702 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6800826-e553-484f-8ed6-32f10a400f5f-trusted-ca\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jul 28 00:02:46.832737 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.832722 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c6800826-e553-484f-8ed6-32f10a400f5f-registry-certificates\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jul 28 00:02:46.832883 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.832738 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c6800826-e553-484f-8ed6-32f10a400f5f-ca-trust-extracted\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jul 28 00:02:46.834143 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.834122 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c6800826-e553-484f-8ed6-32f10a400f5f" (UID: "c6800826-e553-484f-8ed6-32f10a400f5f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:02:46.834240 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.834211 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6800826-e553-484f-8ed6-32f10a400f5f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c6800826-e553-484f-8ed6-32f10a400f5f" (UID: "c6800826-e553-484f-8ed6-32f10a400f5f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:02:46.834324 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.834310 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6800826-e553-484f-8ed6-32f10a400f5f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c6800826-e553-484f-8ed6-32f10a400f5f" (UID: "c6800826-e553-484f-8ed6-32f10a400f5f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:02:46.834629 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.834604 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-kube-api-access-vxkd8" (OuterVolumeSpecName: "kube-api-access-vxkd8") pod "c6800826-e553-484f-8ed6-32f10a400f5f" (UID: "c6800826-e553-484f-8ed6-32f10a400f5f"). InnerVolumeSpecName "kube-api-access-vxkd8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:02:46.933778 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.933735 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxkd8\" (UniqueName: \"kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-kube-api-access-vxkd8\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jul 28 00:02:46.933778 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.933782 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c6800826-e553-484f-8ed6-32f10a400f5f-installation-pull-secrets\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jul 28 00:02:46.934289 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.933799 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-bound-sa-token\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jul 28 00:02:46.934289 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:46.933814 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c6800826-e553-484f-8ed6-32f10a400f5f-image-registry-private-configuration\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jul 28 00:02:47.352147 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:47.352078 2574 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc" Jul 28 00:02:47.352355 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:47.352235 2574 kuberuntime_manager.go:1459] "Unhandled Error" err="container acm-agent start failed in pod klusterlet-addon-workmgr-5c89c65d5c-p2l94_open-cluster-management-agent-addon(594d3f46-2f3c-4c40-a2ac-6597013cd069): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 28 00:02:47.352355 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:47.352290 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:02:47.710286 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:47.710242 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fd5f75b7c-fms6d" Jul 28 00:02:47.711575 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:02:47.711513 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:02:47.752383 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:47.752353 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5fd5f75b7c-fms6d"] Jul 28 00:02:47.756193 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:47.756168 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5fd5f75b7c-fms6d"] Jul 28 00:02:47.943881 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:47.943848 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c6800826-e553-484f-8ed6-32f10a400f5f-registry-tls\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jul 28 00:02:48.045206 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:48.045129 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-metrics-certs\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:48.045366 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:48.045219 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57909377-68d5-4ecb-b1dc-3ebece8627a7-service-ca-bundle\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:48.045431 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:48.045405 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0674b82c-2b52-4f92-b1b9-adefc4f30141-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-svw4n\" (UID: \"0674b82c-2b52-4f92-b1b9-adefc4f30141\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n" Jul 28 00:02:48.045988 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:48.045960 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57909377-68d5-4ecb-b1dc-3ebece8627a7-service-ca-bundle\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:48.048017 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:48.047984 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0674b82c-2b52-4f92-b1b9-adefc4f30141-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-svw4n\" (UID: \"0674b82c-2b52-4f92-b1b9-adefc4f30141\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n" Jul 28 00:02:48.048287 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:48.048261 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57909377-68d5-4ecb-b1dc-3ebece8627a7-metrics-certs\") pod \"router-default-679f79d87c-8wpbk\" (UID: \"57909377-68d5-4ecb-b1dc-3ebece8627a7\") " pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:48.286419 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:48.286384 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n" Jul 28 00:02:48.291678 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:48.291636 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:48.718483 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:48.717911 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-679f79d87c-8wpbk"] Jul 28 00:02:48.722165 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:02:48.722138 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57909377_68d5_4ecb_b1dc_3ebece8627a7.slice/crio-c3f9898616a6bf8e9de1defcc91ad1bb28c3255901bd70e9495c2ad94f3d36ff WatchSource:0}: Error finding container c3f9898616a6bf8e9de1defcc91ad1bb28c3255901bd70e9495c2ad94f3d36ff: Status 404 returned error can't find the container with id c3f9898616a6bf8e9de1defcc91ad1bb28c3255901bd70e9495c2ad94f3d36ff Jul 28 00:02:48.728279 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:48.728254 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n"] Jul 28 00:02:48.733631 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:02:48.733607 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0674b82c_2b52_4f92_b1b9_adefc4f30141.slice/crio-5527f1126ec53bd895515abc2b9e3e0615647908e954d28bb705ddcb62b47c50 WatchSource:0}: Error finding container 5527f1126ec53bd895515abc2b9e3e0615647908e954d28bb705ddcb62b47c50: Status 404 returned error can't find the container with id 5527f1126ec53bd895515abc2b9e3e0615647908e954d28bb705ddcb62b47c50 Jul 28 00:02:49.369371 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:49.369339 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6800826-e553-484f-8ed6-32f10a400f5f" path="/var/lib/kubelet/pods/c6800826-e553-484f-8ed6-32f10a400f5f/volumes" Jul 28 00:02:49.723240 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:49.723033 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-679f79d87c-8wpbk" event={"ID":"57909377-68d5-4ecb-b1dc-3ebece8627a7","Type":"ContainerStarted","Data":"f90e6d65e32da105308b9d32417d862a92754fbc26dbfb8169c89a82d4bd5514"} Jul 28 00:02:49.723240 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:49.723099 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-679f79d87c-8wpbk" event={"ID":"57909377-68d5-4ecb-b1dc-3ebece8627a7","Type":"ContainerStarted","Data":"c3f9898616a6bf8e9de1defcc91ad1bb28c3255901bd70e9495c2ad94f3d36ff"} Jul 28 00:02:49.725108 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:49.725078 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8659cdd95b-n92qz" event={"ID":"af3c5589-dcec-4dc3-82b8-360247bfc7e0","Type":"ContainerStarted","Data":"579ffdb2f967cd95f96883d74227c304df7a5d888f768c59928dd5b85623d3ca"} Jul 28 00:02:49.726361 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:49.726333 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n" event={"ID":"0674b82c-2b52-4f92-b1b9-adefc4f30141","Type":"ContainerStarted","Data":"5527f1126ec53bd895515abc2b9e3e0615647908e954d28bb705ddcb62b47c50"} Jul 28 00:02:49.761105 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:49.761042 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-679f79d87c-8wpbk" podStartSLOduration=33.761024811 podStartE2EDuration="33.761024811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:02:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:49.74504839 +0000 UTC m=+94.861553801" watchObservedRunningTime="2026-07-28 00:02:49.761024811 +0000 UTC m=+94.877530201" Jul 28 00:02:50.291845 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:50.291795 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:50.294950 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:50.294915 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:50.317251 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:50.317192 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8659cdd95b-n92qz" podStartSLOduration=3.019670061 podStartE2EDuration="5.317171289s" totalImagesPullingTime="2.297501228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:49.760280709 +0000 UTC m=+94.876786122" watchObservedRunningTime="2026-07-28 00:02:50.317171289 +0000 UTC m=+95.433676702" Jul 28 00:02:50.729165 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:50.729135 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:50.730279 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:50.730259 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-679f79d87c-8wpbk" Jul 28 00:02:51.735908 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:51.735861 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n" event={"ID":"0674b82c-2b52-4f92-b1b9-adefc4f30141","Type":"ContainerStarted","Data":"e00ded13f87030b6aca19c9584bafe521d7c4691fc7a9eb1c52e1e23bc38ff28"} Jul 28 00:02:51.755245 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:51.755178 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-svw4n" podStartSLOduration=33.406809101 podStartE2EDuration="35.755162225s" totalImagesPullingTime="2.348353124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:51.753203851 +0000 UTC m=+96.869709297" watchObservedRunningTime="2026-07-28 00:02:51.755162225 +0000 UTC m=+96.871667637" Jul 28 00:02:53.291048 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:53.290996 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5183a10e-9591-4737-94b4-fd2490a6adf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:53.293315 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:53.293291 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5183a10e-9591-4737-94b4-fd2490a6adf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dxf9\" (UID: \"5183a10e-9591-4737-94b4-fd2490a6adf3\") " pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:53.585290 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:53.585250 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8dxf9" Jul 28 00:02:53.694641 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:53.694495 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls\") pod \"dns-default-7zf7v\" (UID: \"e6289e83-59b7-439e-8461-6c85c6828ddb\") " pod="openshift-dns/dns-default-7zf7v" Jul 28 00:02:53.696778 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:53.696740 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6289e83-59b7-439e-8461-6c85c6828ddb-metrics-tls\") pod \"dns-default-7zf7v\" (UID: \"e6289e83-59b7-439e-8461-6c85c6828ddb\") " pod="openshift-dns/dns-default-7zf7v" Jul 28 00:02:53.713141 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:53.713090 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8dxf9"] Jul 28 00:02:53.715429 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:02:53.715399 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5183a10e_9591_4737_94b4_fd2490a6adf3.slice/crio-350f85c1e7b2d33d04f29958263873e0b585dd1045bde45b2f7315cac6351f48 WatchSource:0}: Error finding container 350f85c1e7b2d33d04f29958263873e0b585dd1045bde45b2f7315cac6351f48: Status 404 returned error can't find the container with id 350f85c1e7b2d33d04f29958263873e0b585dd1045bde45b2f7315cac6351f48 Jul 28 00:02:53.743045 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:53.743011 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8dxf9" event={"ID":"5183a10e-9591-4737-94b4-fd2490a6adf3","Type":"ContainerStarted","Data":"350f85c1e7b2d33d04f29958263873e0b585dd1045bde45b2f7315cac6351f48"} Jul 28 00:02:53.912960 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:53.912873 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-trh8s\"" Jul 28 00:02:53.921363 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:53.921341 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7zf7v" Jul 28 00:02:54.048645 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:54.048619 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7zf7v"] Jul 28 00:02:54.051088 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:02:54.051058 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6289e83_59b7_439e_8461_6c85c6828ddb.slice/crio-36bb87543fbd4430c0a88bb4d76fe242b23360a8841eaed684cad82230bf0827 WatchSource:0}: Error finding container 36bb87543fbd4430c0a88bb4d76fe242b23360a8841eaed684cad82230bf0827: Status 404 returned error can't find the container with id 36bb87543fbd4430c0a88bb4d76fe242b23360a8841eaed684cad82230bf0827 Jul 28 00:02:54.749140 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:54.749094 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7zf7v" event={"ID":"e6289e83-59b7-439e-8461-6c85c6828ddb","Type":"ContainerStarted","Data":"36bb87543fbd4430c0a88bb4d76fe242b23360a8841eaed684cad82230bf0827"} Jul 28 00:02:56.759029 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:56.758988 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7zf7v" event={"ID":"e6289e83-59b7-439e-8461-6c85c6828ddb","Type":"ContainerStarted","Data":"f4efbd33f0a4f3e1555c6a7b4ae05b020212bc47b632d87bbfd673f055c39c01"} Jul 28 00:02:57.641581 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:57.641539 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dflsn" Jul 28 00:02:59.771901 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:59.771857 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7zf7v" event={"ID":"e6289e83-59b7-439e-8461-6c85c6828ddb","Type":"ContainerStarted","Data":"ce0a6d6109469526c0b4d95b9284dec9c37c07accac5ece8021d6ef6a78d87fb"} Jul 28 00:02:59.772386 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:59.771994 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7zf7v" Jul 28 00:02:59.773400 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:59.773375 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8dxf9" event={"ID":"5183a10e-9591-4737-94b4-fd2490a6adf3","Type":"ContainerStarted","Data":"545fd37507e8971ae879820a6d2040cae87063e1b83134e5298334580c1fbabe"} Jul 28 00:02:59.790778 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:02:59.790671 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7zf7v" podStartSLOduration=68.892525596 podStartE2EDuration="1m10.790654773s" totalImagesPullingTime="1.898129177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:59.788692099 +0000 UTC m=+104.905197537" watchObservedRunningTime="2026-07-28 00:02:59.790654773 +0000 UTC m=+104.907160189" Jul 28 00:03:01.365850 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:01.365812 2574 scope.go:117] "RemoveContainer" containerID="542f7932260eed66e0305600bf395ef756d6752e0bc0ca05fac3262fd3b4d246" Jul 28 00:03:01.366351 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:03:01.366000 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-6w6lx_openshift-console-operator(8b547976-0a9f-481c-bb16-884e484d1b69)\"" pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" podUID="8b547976-0a9f-481c-bb16-884e484d1b69" Jul 28 00:03:03.794750 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:03.794713 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8dxf9" event={"ID":"5183a10e-9591-4737-94b4-fd2490a6adf3","Type":"ContainerStarted","Data":"f01193c759b40c772f58251cde0c7f7978ff255023be8d64cc13bddb4eb6aca5"} Jul 28 00:03:04.330662 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:03:04.330607 2574 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc" Jul 28 00:03:04.330877 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:03:04.330738 2574 kuberuntime_manager.go:1459] "Unhandled Error" err="container acm-agent start failed in pod klusterlet-addon-workmgr-5c89c65d5c-p2l94_open-cluster-management-agent-addon(594d3f46-2f3c-4c40-a2ac-6597013cd069): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 28 00:03:04.330877 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:03:04.330803 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:03:06.783600 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:06.783562 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7zf7v" Jul 28 00:03:07.055770 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.055667 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lmjql"] Jul 28 00:03:07.058243 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.058222 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.061747 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.061724 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 00:03:07.061912 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.061892 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 00:03:07.062013 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.061997 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 00:03:07.062175 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.062160 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 00:03:07.062625 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.062431 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fbxbt\"" Jul 28 00:03:07.117320 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.117282 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-metrics-client-ca\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.117503 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.117332 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-sys\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.117503 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.117425 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-node-exporter-wtmp\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.117503 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.117475 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-node-exporter-accelerators-collector-config\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.117639 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.117531 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.117639 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.117579 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-node-exporter-tls\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.117639 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.117607 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-node-exporter-textfile\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.117751 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.117648 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzdng\" (UniqueName: \"kubernetes.io/projected/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-kube-api-access-pzdng\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.117751 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.117679 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-root\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.218825 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.218787 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-node-exporter-wtmp\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.218825 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.218830 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-node-exporter-accelerators-collector-config\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.219074 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.218862 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.219074 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.218999 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-node-exporter-wtmp\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.219074 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.219063 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-node-exporter-tls\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.219229 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.219095 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-node-exporter-textfile\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.219229 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.219138 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzdng\" (UniqueName: \"kubernetes.io/projected/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-kube-api-access-pzdng\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.219229 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.219171 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-root\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.219229 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.219217 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-metrics-client-ca\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.219423 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.219247 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-sys\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.219423 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.219325 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-sys\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.219526 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.219440 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-node-exporter-textfile\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.219579 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:03:07.219522 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 00:03:07.219579 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:03:07.219573 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-node-exporter-tls podName:6a779937-d7a4-4bb4-a98f-3ea9b126efe8 nodeName:}" failed. No retries permitted until 2026-07-28 00:03:07.719557186 +0000 UTC m=+112.836062591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-node-exporter-tls") pod "node-exporter-lmjql" (UID: "6a779937-d7a4-4bb4-a98f-3ea9b126efe8") : secret "node-exporter-tls" not found Jul 28 00:03:07.219685 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.219653 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-root\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.219740 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.219715 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-node-exporter-accelerators-collector-config\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.220122 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.220102 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-metrics-client-ca\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.222095 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.222067 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.231728 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.231696 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzdng\" (UniqueName: \"kubernetes.io/projected/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-kube-api-access-pzdng\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.714718 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.714686 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5df5f45bbb-6rmzz" Jul 28 00:03:07.722879 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.722850 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-node-exporter-tls\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.725105 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.725086 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6a779937-d7a4-4bb4-a98f-3ea9b126efe8-node-exporter-tls\") pod \"node-exporter-lmjql\" (UID: \"6a779937-d7a4-4bb4-a98f-3ea9b126efe8\") " pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.811295 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.811253 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8dxf9" event={"ID":"5183a10e-9591-4737-94b4-fd2490a6adf3","Type":"ContainerStarted","Data":"9093e272a7901709bced6a6c246d1e4dfca483e77d362121dd39486cb5fa79f9"} Jul 28 00:03:07.838530 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.838467 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8dxf9" podStartSLOduration=33.861208824 podStartE2EDuration="46.838445769s" totalImagesPullingTime="12.977236945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:02:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:03:07.837604527 +0000 UTC m=+112.954109939" watchObservedRunningTime="2026-07-28 00:03:07.838445769 +0000 UTC m=+112.954951182" Jul 28 00:03:07.969153 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:07.969055 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lmjql" Jul 28 00:03:07.978972 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:03:07.978937 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a779937_d7a4_4bb4_a98f_3ea9b126efe8.slice/crio-43bd1691e43bccecab8902f5ea2ae6ba8cfc1eae3ca1ff1428b2a38e9bac4f31 WatchSource:0}: Error finding container 43bd1691e43bccecab8902f5ea2ae6ba8cfc1eae3ca1ff1428b2a38e9bac4f31: Status 404 returned error can't find the container with id 43bd1691e43bccecab8902f5ea2ae6ba8cfc1eae3ca1ff1428b2a38e9bac4f31 Jul 28 00:03:08.817077 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:08.817034 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lmjql" event={"ID":"6a779937-d7a4-4bb4-a98f-3ea9b126efe8","Type":"ContainerStarted","Data":"43bd1691e43bccecab8902f5ea2ae6ba8cfc1eae3ca1ff1428b2a38e9bac4f31"} Jul 28 00:03:09.822129 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:09.822089 2574 generic.go:356] "Generic (PLEG): container finished" podID="6a779937-d7a4-4bb4-a98f-3ea9b126efe8" containerID="01db076bc5b856098caefba04509d383853207ea868eb78d3f219e48a435ca22" exitCode=0 Jul 28 00:03:09.822523 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:09.822161 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lmjql" event={"ID":"6a779937-d7a4-4bb4-a98f-3ea9b126efe8","Type":"ContainerDied","Data":"01db076bc5b856098caefba04509d383853207ea868eb78d3f219e48a435ca22"} Jul 28 00:03:10.827549 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:10.827505 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lmjql" event={"ID":"6a779937-d7a4-4bb4-a98f-3ea9b126efe8","Type":"ContainerStarted","Data":"cff42b9495a7a8fc9260c938eb348581cc1ba706f9b33749c6c95ae3a4284cb7"} Jul 28 00:03:10.827982 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:10.827580 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lmjql" event={"ID":"6a779937-d7a4-4bb4-a98f-3ea9b126efe8","Type":"ContainerStarted","Data":"bc37e6b471bed04d7c67f4d4c2d2b11d1e66074d30c4e8889820df25a630e440"} Jul 28 00:03:10.852160 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:10.852105 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lmjql" podStartSLOduration=2.849290222 podStartE2EDuration="3.852088207s" totalImagesPullingTime="934.341224ms" totalInitContainerRuntime="68.456761ms" isStatefulPod=true podCreationTimestamp="2026-07-28 00:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:03:10.851245592 +0000 UTC m=+115.967751004" watchObservedRunningTime="2026-07-28 00:03:10.852088207 +0000 UTC m=+115.968593623" Jul 28 00:03:12.365077 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:12.365043 2574 scope.go:117] "RemoveContainer" containerID="542f7932260eed66e0305600bf395ef756d6752e0bc0ca05fac3262fd3b4d246" Jul 28 00:03:12.835849 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:12.835823 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6w6lx_8b547976-0a9f-481c-bb16-884e484d1b69/console-operator/2.log" Jul 28 00:03:12.836019 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:12.835926 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" event={"ID":"8b547976-0a9f-481c-bb16-884e484d1b69","Type":"ContainerStarted","Data":"e02bfa724d13ac780576d2cc68a156080b1950cd782205935718944dfc2585f7"} Jul 28 00:03:12.836230 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:12.836203 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" Jul 28 00:03:12.856754 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:12.856692 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" podStartSLOduration=54.447741424 podStartE2EDuration="56.856669262s" totalImagesPullingTime="2.408927838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:03:12.854983343 +0000 UTC m=+117.971488745" watchObservedRunningTime="2026-07-28 00:03:12.856669262 +0000 UTC m=+117.973174680" Jul 28 00:03:13.198602 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:13.198522 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-6w6lx" Jul 28 00:03:13.408503 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:13.408467 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-hc4q2"] Jul 28 00:03:13.413913 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:13.413872 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-hc4q2" Jul 28 00:03:13.417258 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:13.417225 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 00:03:13.417387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:13.417271 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 00:03:13.417387 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:13.417334 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-mf9c8\"" Jul 28 00:03:13.421733 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:13.421710 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-hc4q2"] Jul 28 00:03:13.471835 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:13.471711 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlw6z\" (UniqueName: \"kubernetes.io/projected/dd47d875-bbba-41f5-a65d-25a33ac94bbc-kube-api-access-vlw6z\") pod \"downloads-7c97dc4555-hc4q2\" (UID: \"dd47d875-bbba-41f5-a65d-25a33ac94bbc\") " pod="openshift-console/downloads-7c97dc4555-hc4q2" Jul 28 00:03:13.573171 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:13.573129 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlw6z\" (UniqueName: \"kubernetes.io/projected/dd47d875-bbba-41f5-a65d-25a33ac94bbc-kube-api-access-vlw6z\") pod \"downloads-7c97dc4555-hc4q2\" (UID: \"dd47d875-bbba-41f5-a65d-25a33ac94bbc\") " pod="openshift-console/downloads-7c97dc4555-hc4q2" Jul 28 00:03:13.586520 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:13.586487 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlw6z\" (UniqueName: \"kubernetes.io/projected/dd47d875-bbba-41f5-a65d-25a33ac94bbc-kube-api-access-vlw6z\") pod \"downloads-7c97dc4555-hc4q2\" (UID: \"dd47d875-bbba-41f5-a65d-25a33ac94bbc\") " pod="openshift-console/downloads-7c97dc4555-hc4q2" Jul 28 00:03:13.724734 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:13.724646 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-hc4q2" Jul 28 00:03:13.853068 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:13.853033 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-hc4q2"] Jul 28 00:03:13.856213 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:03:13.856180 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd47d875_bbba_41f5_a65d_25a33ac94bbc.slice/crio-b212273524957ace4f3620d9c47c8a5babcea618f814c6538c4a1ee622da693c WatchSource:0}: Error finding container b212273524957ace4f3620d9c47c8a5babcea618f814c6538c4a1ee622da693c: Status 404 returned error can't find the container with id b212273524957ace4f3620d9c47c8a5babcea618f814c6538c4a1ee622da693c Jul 28 00:03:14.847828 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:14.847718 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-hc4q2" event={"ID":"dd47d875-bbba-41f5-a65d-25a33ac94bbc","Type":"ContainerStarted","Data":"b212273524957ace4f3620d9c47c8a5babcea618f814c6538c4a1ee622da693c"} Jul 28 00:03:18.366918 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:03:18.366773 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:03:25.182107 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.182047 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs\") pod \"network-metrics-daemon-f29s8\" (UID: \"5894c611-99f4-4459-8619-63305e3d25d1\") " pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:03:25.184843 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.184816 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5894c611-99f4-4459-8619-63305e3d25d1-metrics-certs\") pod \"network-metrics-daemon-f29s8\" (UID: \"5894c611-99f4-4459-8619-63305e3d25d1\") " pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:03:25.196572 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.196547 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wccf\"" Jul 28 00:03:25.204264 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.204239 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f29s8" Jul 28 00:03:25.489348 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.489261 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-654c5864c-bq9hm"] Jul 28 00:03:25.491318 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.491296 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:25.495552 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.495450 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 00:03:25.495552 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.495450 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 00:03:25.495552 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.495494 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 00:03:25.495552 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.495523 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 00:03:25.495862 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.495450 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vh7p4\"" Jul 28 00:03:25.495862 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.495798 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 00:03:25.500316 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.500059 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 00:03:25.502295 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.502271 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-654c5864c-bq9hm"] Jul 28 00:03:25.585551 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.585504 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-oauth-serving-cert\") pod \"console-654c5864c-bq9hm\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:25.585742 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.585571 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/240b05b5-d6d6-4e3c-b205-abecefb20186-console-oauth-config\") pod \"console-654c5864c-bq9hm\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:25.585742 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.585611 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-trusted-ca-bundle\") pod \"console-654c5864c-bq9hm\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:25.585742 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.585648 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-console-config\") pod \"console-654c5864c-bq9hm\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:25.585742 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.585688 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95qxt\" (UniqueName: \"kubernetes.io/projected/240b05b5-d6d6-4e3c-b205-abecefb20186-kube-api-access-95qxt\") pod \"console-654c5864c-bq9hm\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:25.585956 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.585788 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/240b05b5-d6d6-4e3c-b205-abecefb20186-console-serving-cert\") pod \"console-654c5864c-bq9hm\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:25.585956 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.585830 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-service-ca\") pod \"console-654c5864c-bq9hm\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:25.686651 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.686612 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-console-config\") pod \"console-654c5864c-bq9hm\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:25.686651 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.686658 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95qxt\" (UniqueName: \"kubernetes.io/projected/240b05b5-d6d6-4e3c-b205-abecefb20186-kube-api-access-95qxt\") pod \"console-654c5864c-bq9hm\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:25.686925 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.686702 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/240b05b5-d6d6-4e3c-b205-abecefb20186-console-serving-cert\") pod \"console-654c5864c-bq9hm\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:25.686925 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.686740 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-service-ca\") pod \"console-654c5864c-bq9hm\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:25.686925 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.686781 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-oauth-serving-cert\") pod \"console-654c5864c-bq9hm\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:25.686925 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.686813 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/240b05b5-d6d6-4e3c-b205-abecefb20186-console-oauth-config\") pod \"console-654c5864c-bq9hm\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:25.686925 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.686847 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-trusted-ca-bundle\") pod \"console-654c5864c-bq9hm\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:25.687543 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.687473 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-console-config\") pod \"console-654c5864c-bq9hm\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:25.687686 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.687662 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-oauth-serving-cert\") pod \"console-654c5864c-bq9hm\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:25.687781 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.687662 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-trusted-ca-bundle\") pod \"console-654c5864c-bq9hm\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:25.687781 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.687720 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-service-ca\") pod \"console-654c5864c-bq9hm\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:25.689472 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.689452 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/240b05b5-d6d6-4e3c-b205-abecefb20186-console-serving-cert\") pod \"console-654c5864c-bq9hm\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:25.689747 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.689714 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/240b05b5-d6d6-4e3c-b205-abecefb20186-console-oauth-config\") pod \"console-654c5864c-bq9hm\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:25.695882 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.695856 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95qxt\" (UniqueName: \"kubernetes.io/projected/240b05b5-d6d6-4e3c-b205-abecefb20186-kube-api-access-95qxt\") pod \"console-654c5864c-bq9hm\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:25.803922 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:25.803811 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:30.240318 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:30.240283 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f29s8"] Jul 28 00:03:30.258215 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:30.258186 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-654c5864c-bq9hm"] Jul 28 00:03:30.371479 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:03:30.371394 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5894c611_99f4_4459_8619_63305e3d25d1.slice/crio-d7d7a51e7b83156156f81a12df3f2502123f7daf7b4d5e09b483d547319aa98a WatchSource:0}: Error finding container d7d7a51e7b83156156f81a12df3f2502123f7daf7b4d5e09b483d547319aa98a: Status 404 returned error can't find the container with id d7d7a51e7b83156156f81a12df3f2502123f7daf7b4d5e09b483d547319aa98a Jul 28 00:03:30.372312 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:03:30.372281 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod240b05b5_d6d6_4e3c_b205_abecefb20186.slice/crio-74e4f269704cc4e590af4e88fae9f063c98f380812b8896c5374ce90374c702a WatchSource:0}: Error finding container 74e4f269704cc4e590af4e88fae9f063c98f380812b8896c5374ce90374c702a: Status 404 returned error can't find the container with id 74e4f269704cc4e590af4e88fae9f063c98f380812b8896c5374ce90374c702a Jul 28 00:03:30.908515 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:30.908438 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f29s8" event={"ID":"5894c611-99f4-4459-8619-63305e3d25d1","Type":"ContainerStarted","Data":"d7d7a51e7b83156156f81a12df3f2502123f7daf7b4d5e09b483d547319aa98a"} Jul 28 00:03:30.909709 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:30.909671 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654c5864c-bq9hm" event={"ID":"240b05b5-d6d6-4e3c-b205-abecefb20186","Type":"ContainerStarted","Data":"74e4f269704cc4e590af4e88fae9f063c98f380812b8896c5374ce90374c702a"} Jul 28 00:03:30.911189 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:30.911152 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-hc4q2" event={"ID":"dd47d875-bbba-41f5-a65d-25a33ac94bbc","Type":"ContainerStarted","Data":"b3fd5f54e2d441b39a3d3d498c51327df796541b30938c8f10fecd8a2dd58249"} Jul 28 00:03:30.911418 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:30.911378 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-hc4q2" Jul 28 00:03:30.924111 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:30.924073 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-hc4q2" Jul 28 00:03:30.928935 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:30.928892 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-hc4q2" podStartSLOduration=1.336174547 podStartE2EDuration="17.928877853s" totalImagesPullingTime="16.592703306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:03:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:03:30.927711639 +0000 UTC m=+136.044217051" watchObservedRunningTime="2026-07-28 00:03:30.928877853 +0000 UTC m=+136.045383265" Jul 28 00:03:32.923122 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:32.923066 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f29s8" event={"ID":"5894c611-99f4-4459-8619-63305e3d25d1","Type":"ContainerStarted","Data":"8bb413efec7c3cc481cdcaeb345e7773bd6aab57a1ee02a46a733ca60411a816"} Jul 28 00:03:33.930251 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:33.930210 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f29s8" event={"ID":"5894c611-99f4-4459-8619-63305e3d25d1","Type":"ContainerStarted","Data":"e9226cefd6b0f07748b9f5fab8e89507b3c3db5955f827c9d183f54893618ae1"} Jul 28 00:03:33.947164 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:33.946680 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f29s8" podStartSLOduration=136.609338906 podStartE2EDuration="2m18.946657635s" totalImagesPullingTime="2.337318729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:03:33.946135068 +0000 UTC m=+139.062640481" watchObservedRunningTime="2026-07-28 00:03:33.946657635 +0000 UTC m=+139.063163048" Jul 28 00:03:34.214066 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:03:34.214009 2574 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc" Jul 28 00:03:34.214352 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:03:34.214164 2574 kuberuntime_manager.go:1459] "Unhandled Error" err="container acm-agent start failed in pod klusterlet-addon-workmgr-5c89c65d5c-p2l94_open-cluster-management-agent-addon(594d3f46-2f3c-4c40-a2ac-6597013cd069): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 28 00:03:34.214352 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:03:34.214221 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:03:34.936984 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:34.936906 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654c5864c-bq9hm" event={"ID":"240b05b5-d6d6-4e3c-b205-abecefb20186","Type":"ContainerStarted","Data":"c7146d3dcbb277a62d7ecc01d71e627fffccd306b909ec4ddb00653f16a10840"} Jul 28 00:03:34.957091 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:34.957027 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-654c5864c-bq9hm" podStartSLOduration=5.627877557 podStartE2EDuration="9.95700457s" totalImagesPullingTime="4.329127013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:03:34.955155871 +0000 UTC m=+140.071661295" watchObservedRunningTime="2026-07-28 00:03:34.95700457 +0000 UTC m=+140.073509982" Jul 28 00:03:35.804071 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:35.804027 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:35.804344 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:35.804100 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:35.809580 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:35.809553 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:35.945778 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:35.945730 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:03:44.977561 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:44.977475 2574 generic.go:356] "Generic (PLEG): container finished" podID="3a9aeaa9-bdff-44d6-85f4-06375e0c97ce" containerID="fc4c5efd8ab6b14e6b5d6b8fbdb175a71c7b44ba1cdf8fc576073938b09ddb5b" exitCode=0 Jul 28 00:03:44.977561 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:44.977546 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n" event={"ID":"3a9aeaa9-bdff-44d6-85f4-06375e0c97ce","Type":"ContainerDied","Data":"fc4c5efd8ab6b14e6b5d6b8fbdb175a71c7b44ba1cdf8fc576073938b09ddb5b"} Jul 28 00:03:44.978018 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:44.977902 2574 scope.go:117] "RemoveContainer" containerID="fc4c5efd8ab6b14e6b5d6b8fbdb175a71c7b44ba1cdf8fc576073938b09ddb5b" Jul 28 00:03:45.983094 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:03:45.983063 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n" event={"ID":"3a9aeaa9-bdff-44d6-85f4-06375e0c97ce","Type":"ContainerStarted","Data":"7510922e7f8a25ee7f6755b10167e07cc5250d260a6086c739e10d59038b0564"} Jul 28 00:03:46.366739 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:03:46.366668 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:04:01.365879 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:04:01.365721 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:04:13.366716 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:04:13.366594 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:04:35.134492 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.134457 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cb8dbb9f6-mxkhs"] Jul 28 00:04:35.137411 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.137387 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.149643 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.149605 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cb8dbb9f6-mxkhs"] Jul 28 00:04:35.173281 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.173245 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1e2d5a8-b157-4099-a7bb-6e468261cc64-console-oauth-config\") pod \"console-cb8dbb9f6-mxkhs\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.173281 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.173279 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-service-ca\") pod \"console-cb8dbb9f6-mxkhs\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.173484 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.173313 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7djbs\" (UniqueName: \"kubernetes.io/projected/b1e2d5a8-b157-4099-a7bb-6e468261cc64-kube-api-access-7djbs\") pod \"console-cb8dbb9f6-mxkhs\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.173484 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.173356 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-oauth-serving-cert\") pod \"console-cb8dbb9f6-mxkhs\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.173484 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.173376 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-trusted-ca-bundle\") pod \"console-cb8dbb9f6-mxkhs\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.173484 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.173413 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1e2d5a8-b157-4099-a7bb-6e468261cc64-console-serving-cert\") pod \"console-cb8dbb9f6-mxkhs\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.173484 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.173439 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-console-config\") pod \"console-cb8dbb9f6-mxkhs\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.273838 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.273801 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1e2d5a8-b157-4099-a7bb-6e468261cc64-console-oauth-config\") pod \"console-cb8dbb9f6-mxkhs\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.273838 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.273835 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-service-ca\") pod \"console-cb8dbb9f6-mxkhs\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.274084 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.273859 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7djbs\" (UniqueName: \"kubernetes.io/projected/b1e2d5a8-b157-4099-a7bb-6e468261cc64-kube-api-access-7djbs\") pod \"console-cb8dbb9f6-mxkhs\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.274084 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.273893 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-oauth-serving-cert\") pod \"console-cb8dbb9f6-mxkhs\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.274084 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.273924 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-trusted-ca-bundle\") pod \"console-cb8dbb9f6-mxkhs\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.274084 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.273966 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1e2d5a8-b157-4099-a7bb-6e468261cc64-console-serving-cert\") pod \"console-cb8dbb9f6-mxkhs\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.274301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.274106 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-console-config\") pod \"console-cb8dbb9f6-mxkhs\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.274747 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.274717 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-service-ca\") pod \"console-cb8dbb9f6-mxkhs\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.274891 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.274748 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-oauth-serving-cert\") pod \"console-cb8dbb9f6-mxkhs\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.274891 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.274808 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-console-config\") pod \"console-cb8dbb9f6-mxkhs\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.275049 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.275028 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-trusted-ca-bundle\") pod \"console-cb8dbb9f6-mxkhs\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.276234 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.276212 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1e2d5a8-b157-4099-a7bb-6e468261cc64-console-oauth-config\") pod \"console-cb8dbb9f6-mxkhs\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.276320 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.276308 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1e2d5a8-b157-4099-a7bb-6e468261cc64-console-serving-cert\") pod \"console-cb8dbb9f6-mxkhs\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.282390 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.282367 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7djbs\" (UniqueName: \"kubernetes.io/projected/b1e2d5a8-b157-4099-a7bb-6e468261cc64-kube-api-access-7djbs\") pod \"console-cb8dbb9f6-mxkhs\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.447820 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.447712 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:35.577894 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:35.577864 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cb8dbb9f6-mxkhs"] Jul 28 00:04:35.580220 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:04:35.580191 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1e2d5a8_b157_4099_a7bb_6e468261cc64.slice/crio-453d0cfc26c824efb26c795c5f0ed20fec1db20d39333e2a12d842e3a0d02e99 WatchSource:0}: Error finding container 453d0cfc26c824efb26c795c5f0ed20fec1db20d39333e2a12d842e3a0d02e99: Status 404 returned error can't find the container with id 453d0cfc26c824efb26c795c5f0ed20fec1db20d39333e2a12d842e3a0d02e99 Jul 28 00:04:36.161569 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:36.161526 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cb8dbb9f6-mxkhs" event={"ID":"b1e2d5a8-b157-4099-a7bb-6e468261cc64","Type":"ContainerStarted","Data":"f7c1817889f07037726fb2e8da309d94651ebf6dd0f09da8511c64029ee5f7be"} Jul 28 00:04:36.162097 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:36.161620 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cb8dbb9f6-mxkhs" event={"ID":"b1e2d5a8-b157-4099-a7bb-6e468261cc64","Type":"ContainerStarted","Data":"453d0cfc26c824efb26c795c5f0ed20fec1db20d39333e2a12d842e3a0d02e99"} Jul 28 00:04:36.181930 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:36.181879 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cb8dbb9f6-mxkhs" podStartSLOduration=1.181863344 podStartE2EDuration="1.181863344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:04:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:04:36.181355633 +0000 UTC m=+201.297861046" watchObservedRunningTime="2026-07-28 00:04:36.181863344 +0000 UTC m=+201.298368756" Jul 28 00:04:45.448160 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:45.448121 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:45.448671 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:45.448199 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:45.452951 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:45.452927 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:46.201074 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:46.201040 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:04:46.264212 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:04:46.264175 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-654c5864c-bq9hm"] Jul 28 00:05:11.285254 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.285191 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-654c5864c-bq9hm" podUID="240b05b5-d6d6-4e3c-b205-abecefb20186" containerName="console" containerID="cri-o://c7146d3dcbb277a62d7ecc01d71e627fffccd306b909ec4ddb00653f16a10840" gracePeriod=15 Jul 28 00:05:11.519562 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.519537 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:05:11.687294 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.687255 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-oauth-serving-cert\") pod \"240b05b5-d6d6-4e3c-b205-abecefb20186\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " Jul 28 00:05:11.687499 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.687302 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-trusted-ca-bundle\") pod \"240b05b5-d6d6-4e3c-b205-abecefb20186\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " Jul 28 00:05:11.687499 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.687325 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-service-ca\") pod \"240b05b5-d6d6-4e3c-b205-abecefb20186\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " Jul 28 00:05:11.687499 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.687375 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-console-config\") pod \"240b05b5-d6d6-4e3c-b205-abecefb20186\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " Jul 28 00:05:11.687499 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.687401 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/240b05b5-d6d6-4e3c-b205-abecefb20186-console-oauth-config\") pod \"240b05b5-d6d6-4e3c-b205-abecefb20186\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " Jul 28 00:05:11.687499 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.687422 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/240b05b5-d6d6-4e3c-b205-abecefb20186-console-serving-cert\") pod \"240b05b5-d6d6-4e3c-b205-abecefb20186\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " Jul 28 00:05:11.687804 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.687570 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95qxt\" (UniqueName: \"kubernetes.io/projected/240b05b5-d6d6-4e3c-b205-abecefb20186-kube-api-access-95qxt\") pod \"240b05b5-d6d6-4e3c-b205-abecefb20186\" (UID: \"240b05b5-d6d6-4e3c-b205-abecefb20186\") " Jul 28 00:05:11.687865 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.687838 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-service-ca" (OuterVolumeSpecName: "service-ca") pod "240b05b5-d6d6-4e3c-b205-abecefb20186" (UID: "240b05b5-d6d6-4e3c-b205-abecefb20186"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:05:11.687917 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.687895 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "240b05b5-d6d6-4e3c-b205-abecefb20186" (UID: "240b05b5-d6d6-4e3c-b205-abecefb20186"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:05:11.688023 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.687996 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "240b05b5-d6d6-4e3c-b205-abecefb20186" (UID: "240b05b5-d6d6-4e3c-b205-abecefb20186"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:05:11.688132 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.688111 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-console-config" (OuterVolumeSpecName: "console-config") pod "240b05b5-d6d6-4e3c-b205-abecefb20186" (UID: "240b05b5-d6d6-4e3c-b205-abecefb20186"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:05:11.689732 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.689698 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/240b05b5-d6d6-4e3c-b205-abecefb20186-kube-api-access-95qxt" (OuterVolumeSpecName: "kube-api-access-95qxt") pod "240b05b5-d6d6-4e3c-b205-abecefb20186" (UID: "240b05b5-d6d6-4e3c-b205-abecefb20186"). InnerVolumeSpecName "kube-api-access-95qxt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:05:11.689732 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.689711 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/240b05b5-d6d6-4e3c-b205-abecefb20186-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "240b05b5-d6d6-4e3c-b205-abecefb20186" (UID: "240b05b5-d6d6-4e3c-b205-abecefb20186"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:05:11.689889 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.689734 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/240b05b5-d6d6-4e3c-b205-abecefb20186-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "240b05b5-d6d6-4e3c-b205-abecefb20186" (UID: "240b05b5-d6d6-4e3c-b205-abecefb20186"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:05:11.788221 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.788183 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-service-ca\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jul 28 00:05:11.788221 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.788215 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-console-config\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jul 28 00:05:11.788221 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.788224 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/240b05b5-d6d6-4e3c-b205-abecefb20186-console-oauth-config\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jul 28 00:05:11.788446 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.788234 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/240b05b5-d6d6-4e3c-b205-abecefb20186-console-serving-cert\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jul 28 00:05:11.788446 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.788243 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95qxt\" (UniqueName: \"kubernetes.io/projected/240b05b5-d6d6-4e3c-b205-abecefb20186-kube-api-access-95qxt\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jul 28 00:05:11.788446 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.788253 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-oauth-serving-cert\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jul 28 00:05:11.788446 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:11.788261 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/240b05b5-d6d6-4e3c-b205-abecefb20186-trusted-ca-bundle\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jul 28 00:05:12.286373 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:12.286337 2574 generic.go:356] "Generic (PLEG): container finished" podID="240b05b5-d6d6-4e3c-b205-abecefb20186" containerID="c7146d3dcbb277a62d7ecc01d71e627fffccd306b909ec4ddb00653f16a10840" exitCode=0 Jul 28 00:05:12.286877 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:12.286387 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654c5864c-bq9hm" Jul 28 00:05:12.286877 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:12.286389 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654c5864c-bq9hm" event={"ID":"240b05b5-d6d6-4e3c-b205-abecefb20186","Type":"ContainerDied","Data":"c7146d3dcbb277a62d7ecc01d71e627fffccd306b909ec4ddb00653f16a10840"} Jul 28 00:05:12.286877 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:12.286516 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654c5864c-bq9hm" event={"ID":"240b05b5-d6d6-4e3c-b205-abecefb20186","Type":"ContainerDied","Data":"74e4f269704cc4e590af4e88fae9f063c98f380812b8896c5374ce90374c702a"} Jul 28 00:05:12.286877 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:12.286547 2574 scope.go:117] "RemoveContainer" containerID="c7146d3dcbb277a62d7ecc01d71e627fffccd306b909ec4ddb00653f16a10840" Jul 28 00:05:12.297355 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:12.297175 2574 scope.go:117] "RemoveContainer" containerID="c7146d3dcbb277a62d7ecc01d71e627fffccd306b909ec4ddb00653f16a10840" Jul 28 00:05:12.297513 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:05:12.297486 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7146d3dcbb277a62d7ecc01d71e627fffccd306b909ec4ddb00653f16a10840\": container with ID starting with c7146d3dcbb277a62d7ecc01d71e627fffccd306b909ec4ddb00653f16a10840 not found: ID does not exist" containerID="c7146d3dcbb277a62d7ecc01d71e627fffccd306b909ec4ddb00653f16a10840" Jul 28 00:05:12.297564 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:12.297528 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7146d3dcbb277a62d7ecc01d71e627fffccd306b909ec4ddb00653f16a10840"} err="failed to get container status \"c7146d3dcbb277a62d7ecc01d71e627fffccd306b909ec4ddb00653f16a10840\": rpc error: code = NotFound desc = could not find container \"c7146d3dcbb277a62d7ecc01d71e627fffccd306b909ec4ddb00653f16a10840\": container with ID starting with c7146d3dcbb277a62d7ecc01d71e627fffccd306b909ec4ddb00653f16a10840 not found: ID does not exist" Jul 28 00:05:12.311315 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:12.311287 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-654c5864c-bq9hm"] Jul 28 00:05:12.320883 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:12.320860 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-654c5864c-bq9hm"] Jul 28 00:05:13.369622 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:13.369586 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="240b05b5-d6d6-4e3c-b205-abecefb20186" path="/var/lib/kubelet/pods/240b05b5-d6d6-4e3c-b205-abecefb20186/volumes" Jul 28 00:05:25.039820 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:05:25.039749 2574 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc" Jul 28 00:05:25.040322 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:05:25.039886 2574 kuberuntime_manager.go:1459] "Unhandled Error" err="container acm-agent start failed in pod klusterlet-addon-workmgr-5c89c65d5c-p2l94_open-cluster-management-agent-addon(594d3f46-2f3c-4c40-a2ac-6597013cd069): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 28 00:05:25.040322 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:05:25.039925 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:05:38.366134 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:05:38.366070 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:05:52.366791 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:05:52.366723 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:05:52.372373 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:05:52.372345 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cb8dbb9f6-mxkhs"] Jul 28 00:06:05.367961 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:06:05.367818 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:06:15.300382 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:15.300353 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6w6lx_8b547976-0a9f-481c-bb16-884e484d1b69/console-operator/2.log" Jul 28 00:06:15.306254 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:15.306228 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6w6lx_8b547976-0a9f-481c-bb16-884e484d1b69/console-operator/2.log" Jul 28 00:06:15.309295 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:15.309275 2574 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 00:06:17.395095 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.395033 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cb8dbb9f6-mxkhs" podUID="b1e2d5a8-b157-4099-a7bb-6e468261cc64" containerName="console" containerID="cri-o://f7c1817889f07037726fb2e8da309d94651ebf6dd0f09da8511c64029ee5f7be" gracePeriod=15 Jul 28 00:06:17.511980 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.511951 2574 generic.go:356] "Generic (PLEG): container finished" podID="b1e2d5a8-b157-4099-a7bb-6e468261cc64" containerID="f7c1817889f07037726fb2e8da309d94651ebf6dd0f09da8511c64029ee5f7be" exitCode=0 Jul 28 00:06:17.512092 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.512023 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cb8dbb9f6-mxkhs" event={"ID":"b1e2d5a8-b157-4099-a7bb-6e468261cc64","Type":"ContainerDied","Data":"f7c1817889f07037726fb2e8da309d94651ebf6dd0f09da8511c64029ee5f7be"} Jul 28 00:06:17.626984 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.626956 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:06:17.711626 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.711528 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-oauth-serving-cert\") pod \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " Jul 28 00:06:17.711626 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.711576 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-service-ca\") pod \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " Jul 28 00:06:17.711626 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.711594 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-trusted-ca-bundle\") pod \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " Jul 28 00:06:17.711626 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.711619 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-console-config\") pod \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " Jul 28 00:06:17.711996 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.711640 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1e2d5a8-b157-4099-a7bb-6e468261cc64-console-serving-cert\") pod \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " Jul 28 00:06:17.711996 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.711671 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1e2d5a8-b157-4099-a7bb-6e468261cc64-console-oauth-config\") pod \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " Jul 28 00:06:17.711996 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.711739 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7djbs\" (UniqueName: \"kubernetes.io/projected/b1e2d5a8-b157-4099-a7bb-6e468261cc64-kube-api-access-7djbs\") pod \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\" (UID: \"b1e2d5a8-b157-4099-a7bb-6e468261cc64\") " Jul 28 00:06:17.711996 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.711986 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b1e2d5a8-b157-4099-a7bb-6e468261cc64" (UID: "b1e2d5a8-b157-4099-a7bb-6e468261cc64"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:06:17.712186 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.712154 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b1e2d5a8-b157-4099-a7bb-6e468261cc64" (UID: "b1e2d5a8-b157-4099-a7bb-6e468261cc64"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:06:17.712403 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.712376 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-console-config" (OuterVolumeSpecName: "console-config") pod "b1e2d5a8-b157-4099-a7bb-6e468261cc64" (UID: "b1e2d5a8-b157-4099-a7bb-6e468261cc64"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:06:17.712538 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.712495 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-service-ca" (OuterVolumeSpecName: "service-ca") pod "b1e2d5a8-b157-4099-a7bb-6e468261cc64" (UID: "b1e2d5a8-b157-4099-a7bb-6e468261cc64"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:06:17.713937 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.713902 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1e2d5a8-b157-4099-a7bb-6e468261cc64-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b1e2d5a8-b157-4099-a7bb-6e468261cc64" (UID: "b1e2d5a8-b157-4099-a7bb-6e468261cc64"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:06:17.714053 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.714023 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1e2d5a8-b157-4099-a7bb-6e468261cc64-kube-api-access-7djbs" (OuterVolumeSpecName: "kube-api-access-7djbs") pod "b1e2d5a8-b157-4099-a7bb-6e468261cc64" (UID: "b1e2d5a8-b157-4099-a7bb-6e468261cc64"). InnerVolumeSpecName "kube-api-access-7djbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:06:17.714266 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.714247 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1e2d5a8-b157-4099-a7bb-6e468261cc64-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b1e2d5a8-b157-4099-a7bb-6e468261cc64" (UID: "b1e2d5a8-b157-4099-a7bb-6e468261cc64"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:06:17.813083 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.813039 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7djbs\" (UniqueName: \"kubernetes.io/projected/b1e2d5a8-b157-4099-a7bb-6e468261cc64-kube-api-access-7djbs\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jul 28 00:06:17.813083 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.813071 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-oauth-serving-cert\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jul 28 00:06:17.813083 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.813085 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-service-ca\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jul 28 00:06:17.813330 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.813098 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-trusted-ca-bundle\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jul 28 00:06:17.813330 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.813113 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b1e2d5a8-b157-4099-a7bb-6e468261cc64-console-config\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jul 28 00:06:17.813330 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.813125 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b1e2d5a8-b157-4099-a7bb-6e468261cc64-console-serving-cert\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jul 28 00:06:17.813330 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:17.813136 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b1e2d5a8-b157-4099-a7bb-6e468261cc64-console-oauth-config\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jul 28 00:06:18.516780 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:18.516725 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cb8dbb9f6-mxkhs" Jul 28 00:06:18.517237 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:18.516727 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cb8dbb9f6-mxkhs" event={"ID":"b1e2d5a8-b157-4099-a7bb-6e468261cc64","Type":"ContainerDied","Data":"453d0cfc26c824efb26c795c5f0ed20fec1db20d39333e2a12d842e3a0d02e99"} Jul 28 00:06:18.517237 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:18.516876 2574 scope.go:117] "RemoveContainer" containerID="f7c1817889f07037726fb2e8da309d94651ebf6dd0f09da8511c64029ee5f7be" Jul 28 00:06:18.538667 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:18.538640 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cb8dbb9f6-mxkhs"] Jul 28 00:06:18.542451 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:18.542427 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cb8dbb9f6-mxkhs"] Jul 28 00:06:19.366811 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:19.366790 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 00:06:19.367025 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:06:19.366995 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:06:19.370111 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:06:19.370090 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1e2d5a8-b157-4099-a7bb-6e468261cc64" path="/var/lib/kubelet/pods/b1e2d5a8-b157-4099-a7bb-6e468261cc64/volumes" Jul 28 00:06:31.366295 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:06:31.366247 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:06:46.250399 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:06:46.250293 2574 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc" Jul 28 00:06:46.250863 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:06:46.250421 2574 kuberuntime_manager.go:1459] "Unhandled Error" err="container acm-agent start failed in pod klusterlet-addon-workmgr-5c89c65d5c-p2l94_open-cluster-management-agent-addon(594d3f46-2f3c-4c40-a2ac-6597013cd069): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 28 00:06:46.250863 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:06:46.250460 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:07:01.366242 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:07:01.366176 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:07:14.366005 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:07:14.365967 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:07:22.468089 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:07:22.468047 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq"] Jul 28 00:07:22.468658 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:07:22.468411 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="240b05b5-d6d6-4e3c-b205-abecefb20186" containerName="console" Jul 28 00:07:22.468658 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:07:22.468429 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="240b05b5-d6d6-4e3c-b205-abecefb20186" containerName="console" Jul 28 00:07:22.468658 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:07:22.468439 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1e2d5a8-b157-4099-a7bb-6e468261cc64" containerName="console" Jul 28 00:07:22.468658 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:07:22.468447 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1e2d5a8-b157-4099-a7bb-6e468261cc64" containerName="console" Jul 28 00:07:22.468658 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:07:22.468540 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="240b05b5-d6d6-4e3c-b205-abecefb20186" containerName="console" Jul 28 00:07:22.468658 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:07:22.468551 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1e2d5a8-b157-4099-a7bb-6e468261cc64" containerName="console" Jul 28 00:07:22.471774 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:07:22.471738 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" Jul 28 00:07:22.475109 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:07:22.475088 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-txwhp\"" Jul 28 00:07:22.475109 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:07:22.475097 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:07:22.475284 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:07:22.475138 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 28 00:07:22.488957 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:07:22.488929 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq"] Jul 28 00:07:22.599803 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:07:22.599751 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e75b3b2a-75f0-4d1b-a6f8-436dd205e79f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vlgcq\" (UID: \"e75b3b2a-75f0-4d1b-a6f8-436dd205e79f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" Jul 28 00:07:22.599951 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:07:22.599857 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxg6c\" (UniqueName: \"kubernetes.io/projected/e75b3b2a-75f0-4d1b-a6f8-436dd205e79f-kube-api-access-zxg6c\") pod \"cert-manager-operator-controller-manager-55c444bf86-vlgcq\" (UID: \"e75b3b2a-75f0-4d1b-a6f8-436dd205e79f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" Jul 28 00:07:22.700828 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:07:22.700788 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e75b3b2a-75f0-4d1b-a6f8-436dd205e79f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vlgcq\" (UID: \"e75b3b2a-75f0-4d1b-a6f8-436dd205e79f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" Jul 28 00:07:22.700960 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:07:22.700844 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxg6c\" (UniqueName: \"kubernetes.io/projected/e75b3b2a-75f0-4d1b-a6f8-436dd205e79f-kube-api-access-zxg6c\") pod \"cert-manager-operator-controller-manager-55c444bf86-vlgcq\" (UID: \"e75b3b2a-75f0-4d1b-a6f8-436dd205e79f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" Jul 28 00:07:22.701151 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:07:22.701128 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e75b3b2a-75f0-4d1b-a6f8-436dd205e79f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vlgcq\" (UID: \"e75b3b2a-75f0-4d1b-a6f8-436dd205e79f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" Jul 28 00:07:22.724204 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:07:22.724131 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxg6c\" (UniqueName: \"kubernetes.io/projected/e75b3b2a-75f0-4d1b-a6f8-436dd205e79f-kube-api-access-zxg6c\") pod \"cert-manager-operator-controller-manager-55c444bf86-vlgcq\" (UID: \"e75b3b2a-75f0-4d1b-a6f8-436dd205e79f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" Jul 28 00:07:22.780843 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:07:22.780806 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" Jul 28 00:07:22.914966 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:07:22.914943 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq"] Jul 28 00:07:22.918009 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:07:22.917981 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode75b3b2a_75f0_4d1b_a6f8_436dd205e79f.slice/crio-03b974fe5c2d25e5073d130b8f8c49abe0c71eb133ea2a9377cf56a8c1d442a7 WatchSource:0}: Error finding container 03b974fe5c2d25e5073d130b8f8c49abe0c71eb133ea2a9377cf56a8c1d442a7: Status 404 returned error can't find the container with id 03b974fe5c2d25e5073d130b8f8c49abe0c71eb133ea2a9377cf56a8c1d442a7 Jul 28 00:07:23.736777 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:07:23.736670 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" event={"ID":"e75b3b2a-75f0-4d1b-a6f8-436dd205e79f","Type":"ContainerStarted","Data":"03b974fe5c2d25e5073d130b8f8c49abe0c71eb133ea2a9377cf56a8c1d442a7"} Jul 28 00:07:23.854720 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:07:23.854676 2574 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481" Jul 28 00:07:23.854924 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:07:23.854809 2574 kuberuntime_manager.go:1459] "Unhandled Error" err="container cert-manager-operator start failed in pod cert-manager-operator-controller-manager-55c444bf86-vlgcq_cert-manager-operator(e75b3b2a-75f0-4d1b-a6f8-436dd205e79f): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 28 00:07:23.854924 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:07:23.854847 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" podUID="e75b3b2a-75f0-4d1b-a6f8-436dd205e79f" Jul 28 00:07:24.742406 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:07:24.742367 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" podUID="e75b3b2a-75f0-4d1b-a6f8-436dd205e79f" Jul 28 00:07:26.366815 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:07:26.366749 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:07:37.295753 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:07:37.295691 2574 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481" Jul 28 00:07:37.296165 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:07:37.295875 2574 kuberuntime_manager.go:1459] "Unhandled Error" err="container cert-manager-operator start failed in pod cert-manager-operator-controller-manager-55c444bf86-vlgcq_cert-manager-operator(e75b3b2a-75f0-4d1b-a6f8-436dd205e79f): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 28 00:07:37.296165 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:07:37.295915 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" podUID="e75b3b2a-75f0-4d1b-a6f8-436dd205e79f" Jul 28 00:07:37.366269 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:07:37.366220 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:07:51.366600 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:07:51.366551 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" podUID="e75b3b2a-75f0-4d1b-a6f8-436dd205e79f" Jul 28 00:07:52.366666 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:07:52.366631 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:08:04.366125 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:08:04.366063 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:08:04.387397 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:08:04.387342 2574 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481" Jul 28 00:08:04.387605 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:08:04.387523 2574 kuberuntime_manager.go:1459] "Unhandled Error" err="container cert-manager-operator start failed in pod cert-manager-operator-controller-manager-55c444bf86-vlgcq_cert-manager-operator(e75b3b2a-75f0-4d1b-a6f8-436dd205e79f): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 28 00:08:04.387605 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:08:04.387576 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" podUID="e75b3b2a-75f0-4d1b-a6f8-436dd205e79f" Jul 28 00:08:16.366260 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:08:16.366180 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:08:17.366896 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:08:17.366845 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" podUID="e75b3b2a-75f0-4d1b-a6f8-436dd205e79f" Jul 28 00:08:29.366386 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:08:29.366348 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:08:29.366653 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:08:29.366549 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" podUID="e75b3b2a-75f0-4d1b-a6f8-436dd205e79f" Jul 28 00:08:40.366414 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:08:40.366372 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" podUID="e75b3b2a-75f0-4d1b-a6f8-436dd205e79f" Jul 28 00:08:41.366847 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:08:41.366812 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:08:52.366754 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:08:52.366711 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:08:55.313202 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:08:55.313149 2574 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481" Jul 28 00:08:55.313630 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:08:55.313276 2574 kuberuntime_manager.go:1459] "Unhandled Error" err="container cert-manager-operator start failed in pod cert-manager-operator-controller-manager-55c444bf86-vlgcq_cert-manager-operator(e75b3b2a-75f0-4d1b-a6f8-436dd205e79f): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 28 00:08:55.313630 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:08:55.313321 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" podUID="e75b3b2a-75f0-4d1b-a6f8-436dd205e79f" Jul 28 00:09:03.366920 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:09:03.366718 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:09:07.366998 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:09:07.366951 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" podUID="e75b3b2a-75f0-4d1b-a6f8-436dd205e79f" Jul 28 00:09:14.366849 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:09:14.366815 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:09:18.366628 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:09:18.366589 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" podUID="e75b3b2a-75f0-4d1b-a6f8-436dd205e79f" Jul 28 00:09:25.368030 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:09:25.367984 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podUID="594d3f46-2f3c-4c40-a2ac-6597013cd069" Jul 28 00:09:30.366012 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:09:30.365971 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" podUID="e75b3b2a-75f0-4d1b-a6f8-436dd205e79f" Jul 28 00:09:44.366062 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:09:44.366027 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" podUID="e75b3b2a-75f0-4d1b-a6f8-436dd205e79f" Jul 28 00:09:55.711185 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:55.711129 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cbbf54857-sndwc"] Jul 28 00:09:55.714992 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:55.714966 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:55.718587 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:55.718564 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 00:09:55.718885 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:55.718860 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 00:09:55.719956 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:55.719913 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 00:09:55.720126 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:55.719971 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 00:09:55.720126 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:55.720024 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vh7p4\"" Jul 28 00:09:55.723233 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:55.723211 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 00:09:55.728118 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:55.728092 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 00:09:55.728728 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:55.728704 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbbf54857-sndwc"] Jul 28 00:09:55.905630 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:55.905586 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dee4bbf7-5ac7-40c3-bda2-88dc9fca24de-console-oauth-config\") pod \"console-5cbbf54857-sndwc\" (UID: \"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de\") " pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:55.905833 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:55.905642 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dee4bbf7-5ac7-40c3-bda2-88dc9fca24de-oauth-serving-cert\") pod \"console-5cbbf54857-sndwc\" (UID: \"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de\") " pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:55.905833 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:55.905677 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dee4bbf7-5ac7-40c3-bda2-88dc9fca24de-console-config\") pod \"console-5cbbf54857-sndwc\" (UID: \"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de\") " pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:55.905833 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:55.905708 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee4bbf7-5ac7-40c3-bda2-88dc9fca24de-trusted-ca-bundle\") pod \"console-5cbbf54857-sndwc\" (UID: \"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de\") " pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:55.905833 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:55.905731 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dee4bbf7-5ac7-40c3-bda2-88dc9fca24de-service-ca\") pod \"console-5cbbf54857-sndwc\" (UID: \"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de\") " pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:55.905978 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:55.905860 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dee4bbf7-5ac7-40c3-bda2-88dc9fca24de-console-serving-cert\") pod \"console-5cbbf54857-sndwc\" (UID: \"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de\") " pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:55.905978 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:55.905899 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxvpf\" (UniqueName: \"kubernetes.io/projected/dee4bbf7-5ac7-40c3-bda2-88dc9fca24de-kube-api-access-xxvpf\") pod \"console-5cbbf54857-sndwc\" (UID: \"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de\") " pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:56.007428 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:56.007337 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dee4bbf7-5ac7-40c3-bda2-88dc9fca24de-console-serving-cert\") pod \"console-5cbbf54857-sndwc\" (UID: \"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de\") " pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:56.007428 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:56.007400 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxvpf\" (UniqueName: \"kubernetes.io/projected/dee4bbf7-5ac7-40c3-bda2-88dc9fca24de-kube-api-access-xxvpf\") pod \"console-5cbbf54857-sndwc\" (UID: \"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de\") " pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:56.007681 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:56.007461 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dee4bbf7-5ac7-40c3-bda2-88dc9fca24de-console-oauth-config\") pod \"console-5cbbf54857-sndwc\" (UID: \"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de\") " pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:56.007681 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:56.007490 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dee4bbf7-5ac7-40c3-bda2-88dc9fca24de-oauth-serving-cert\") pod \"console-5cbbf54857-sndwc\" (UID: \"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de\") " pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:56.007681 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:56.007520 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dee4bbf7-5ac7-40c3-bda2-88dc9fca24de-console-config\") pod \"console-5cbbf54857-sndwc\" (UID: \"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de\") " pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:56.007681 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:56.007549 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee4bbf7-5ac7-40c3-bda2-88dc9fca24de-trusted-ca-bundle\") pod \"console-5cbbf54857-sndwc\" (UID: \"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de\") " pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:56.007681 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:56.007568 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dee4bbf7-5ac7-40c3-bda2-88dc9fca24de-service-ca\") pod \"console-5cbbf54857-sndwc\" (UID: \"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de\") " pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:56.008309 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:56.008278 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dee4bbf7-5ac7-40c3-bda2-88dc9fca24de-oauth-serving-cert\") pod \"console-5cbbf54857-sndwc\" (UID: \"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de\") " pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:56.008394 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:56.008356 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dee4bbf7-5ac7-40c3-bda2-88dc9fca24de-service-ca\") pod \"console-5cbbf54857-sndwc\" (UID: \"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de\") " pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:56.008525 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:56.008504 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dee4bbf7-5ac7-40c3-bda2-88dc9fca24de-console-config\") pod \"console-5cbbf54857-sndwc\" (UID: \"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de\") " pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:56.009135 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:56.009089 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dee4bbf7-5ac7-40c3-bda2-88dc9fca24de-trusted-ca-bundle\") pod \"console-5cbbf54857-sndwc\" (UID: \"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de\") " pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:56.010362 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:56.010343 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dee4bbf7-5ac7-40c3-bda2-88dc9fca24de-console-oauth-config\") pod \"console-5cbbf54857-sndwc\" (UID: \"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de\") " pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:56.010444 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:56.010379 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dee4bbf7-5ac7-40c3-bda2-88dc9fca24de-console-serving-cert\") pod \"console-5cbbf54857-sndwc\" (UID: \"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de\") " pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:56.017301 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:56.017270 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxvpf\" (UniqueName: \"kubernetes.io/projected/dee4bbf7-5ac7-40c3-bda2-88dc9fca24de-kube-api-access-xxvpf\") pod \"console-5cbbf54857-sndwc\" (UID: \"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de\") " pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:56.027057 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:56.027029 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:09:56.364271 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:56.364241 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbbf54857-sndwc"] Jul 28 00:09:56.366032 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:09:56.365986 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" podUID="e75b3b2a-75f0-4d1b-a6f8-436dd205e79f" Jul 28 00:09:56.368195 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:09:56.368167 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddee4bbf7_5ac7_40c3_bda2_88dc9fca24de.slice/crio-a50455312a2e1b7f2f2cfd6c709d5f6d5ec029d0313e50525cd414383904f129 WatchSource:0}: Error finding container a50455312a2e1b7f2f2cfd6c709d5f6d5ec029d0313e50525cd414383904f129: Status 404 returned error can't find the container with id a50455312a2e1b7f2f2cfd6c709d5f6d5ec029d0313e50525cd414383904f129 Jul 28 00:09:57.319086 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:57.319048 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" event={"ID":"594d3f46-2f3c-4c40-a2ac-6597013cd069","Type":"ContainerStarted","Data":"f9e7b58e5a7f61f3e4a9787a57adcb67563ee90910bc0a4ed2424025b532f51a"} Jul 28 00:09:57.319591 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:57.319424 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" Jul 28 00:09:57.320712 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:57.320682 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbbf54857-sndwc" event={"ID":"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de","Type":"ContainerStarted","Data":"ce5f0cea3dd6a1b8cf8a0d5b11dc920a9aea7b1c8e3dfcb62973b5e65c2e0308"} Jul 28 00:09:57.320880 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:57.320730 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbbf54857-sndwc" event={"ID":"dee4bbf7-5ac7-40c3-bda2-88dc9fca24de","Type":"ContainerStarted","Data":"a50455312a2e1b7f2f2cfd6c709d5f6d5ec029d0313e50525cd414383904f129"} Jul 28 00:09:57.321465 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:57.321448 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" Jul 28 00:09:57.336646 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:57.336591 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89c65d5c-p2l94" podStartSLOduration=2.411839913 podStartE2EDuration="7m12.336577702s" totalImagesPullingTime="7m9.924737789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=5 observedRunningTime="2026-07-28 00:09:57.335565034 +0000 UTC m=+522.452070446" watchObservedRunningTime="2026-07-28 00:09:57.336577702 +0000 UTC m=+522.453083113" Jul 28 00:09:57.373031 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:09:57.372980 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cbbf54857-sndwc" podStartSLOduration=2.372965258 podStartE2EDuration="2.372965258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:09:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:09:57.37206946 +0000 UTC m=+522.488574863" watchObservedRunningTime="2026-07-28 00:09:57.372965258 +0000 UTC m=+522.489470712" Jul 28 00:10:06.027496 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:10:06.027408 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:10:06.027496 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:10:06.027475 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:10:06.032219 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:10:06.032194 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:10:06.359812 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:10:06.359777 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cbbf54857-sndwc" Jul 28 00:10:07.366696 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:10:07.366540 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" podUID="e75b3b2a-75f0-4d1b-a6f8-436dd205e79f" Jul 28 00:11:15.323305 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:11:15.323273 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6w6lx_8b547976-0a9f-481c-bb16-884e484d1b69/console-operator/2.log" Jul 28 00:11:15.326781 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:11:15.326748 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6w6lx_8b547976-0a9f-481c-bb16-884e484d1b69/console-operator/2.log" Jul 28 00:12:00.641921 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:12:00.641868 2574 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481" Jul 28 00:12:00.642478 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:12:00.642018 2574 kuberuntime_manager.go:1459] "Unhandled Error" err="container cert-manager-operator start failed in pod cert-manager-operator-controller-manager-55c444bf86-vlgcq_cert-manager-operator(e75b3b2a-75f0-4d1b-a6f8-436dd205e79f): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 28 00:12:00.642478 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:12:00.642077 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" podUID="e75b3b2a-75f0-4d1b-a6f8-436dd205e79f" Jul 28 00:12:11.366219 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:11.366181 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 00:12:11.366451 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:12:11.366368 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" podUID="e75b3b2a-75f0-4d1b-a6f8-436dd205e79f" Jul 28 00:12:22.366755 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:12:22.366706 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" podUID="e75b3b2a-75f0-4d1b-a6f8-436dd205e79f" Jul 28 00:12:26.453250 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:26.453211 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-679f79d87c-8wpbk_57909377-68d5-4ecb-b1dc-3ebece8627a7/router/0.log" Jul 28 00:12:35.030203 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:35.030173 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n56zd_361a09af-a231-45f9-8332-fbd085df9a5f/global-pull-secret-syncer/0.log" Jul 28 00:12:35.179696 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:35.179656 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sx88w_a6a63750-e30c-4a77-bbbf-38498587808f/konnectivity-agent/0.log" Jul 28 00:12:35.204319 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:35.204288 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-253.ec2.internal_b1c9672097d54576fb7cce42c7e502c6/haproxy/0.log" Jul 28 00:12:37.366358 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:12:37.366233 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" podUID="e75b3b2a-75f0-4d1b-a6f8-436dd205e79f" Jul 28 00:12:39.151851 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:39.151821 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-svw4n_0674b82c-2b52-4f92-b1b9-adefc4f30141/cluster-monitoring-operator/0.log" Jul 28 00:12:39.492540 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:39.492508 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lmjql_6a779937-d7a4-4bb4-a98f-3ea9b126efe8/node-exporter/0.log" Jul 28 00:12:39.525339 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:39.525312 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lmjql_6a779937-d7a4-4bb4-a98f-3ea9b126efe8/kube-rbac-proxy/0.log" Jul 28 00:12:39.551717 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:39.551692 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lmjql_6a779937-d7a4-4bb4-a98f-3ea9b126efe8/init-textfile/0.log" Jul 28 00:12:42.223015 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:42.222991 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6w6lx_8b547976-0a9f-481c-bb16-884e484d1b69/console-operator/2.log" Jul 28 00:12:42.227015 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:42.226975 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6w6lx_8b547976-0a9f-481c-bb16-884e484d1b69/console-operator/3.log" Jul 28 00:12:42.630189 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:42.630151 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5cbbf54857-sndwc_dee4bbf7-5ac7-40c3-bda2-88dc9fca24de/console/0.log" Jul 28 00:12:42.663082 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:42.663035 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-hc4q2_dd47d875-bbba-41f5-a65d-25a33ac94bbc/download-server/0.log" Jul 28 00:12:43.053806 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.053719 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p"] Jul 28 00:12:43.056810 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.056789 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p" Jul 28 00:12:43.059906 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.059884 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qnmh4\"/\"openshift-service-ca.crt\"" Jul 28 00:12:43.061014 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.060998 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qnmh4\"/\"kube-root-ca.crt\"" Jul 28 00:12:43.061112 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.061060 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qnmh4\"/\"default-dockercfg-kmcm2\"" Jul 28 00:12:43.070781 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.070735 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p"] Jul 28 00:12:43.131590 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.131549 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c7e41da3-5d9f-4bd0-bf6a-a17afd72137b-proc\") pod \"perf-node-gather-daemonset-x6d4p\" (UID: \"c7e41da3-5d9f-4bd0-bf6a-a17afd72137b\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p" Jul 28 00:12:43.131590 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.131593 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c7e41da3-5d9f-4bd0-bf6a-a17afd72137b-lib-modules\") pod \"perf-node-gather-daemonset-x6d4p\" (UID: \"c7e41da3-5d9f-4bd0-bf6a-a17afd72137b\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p" Jul 28 00:12:43.131862 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.131610 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c7e41da3-5d9f-4bd0-bf6a-a17afd72137b-podres\") pod \"perf-node-gather-daemonset-x6d4p\" (UID: \"c7e41da3-5d9f-4bd0-bf6a-a17afd72137b\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p" Jul 28 00:12:43.131862 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.131637 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t42fs\" (UniqueName: \"kubernetes.io/projected/c7e41da3-5d9f-4bd0-bf6a-a17afd72137b-kube-api-access-t42fs\") pod \"perf-node-gather-daemonset-x6d4p\" (UID: \"c7e41da3-5d9f-4bd0-bf6a-a17afd72137b\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p" Jul 28 00:12:43.131862 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.131692 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7e41da3-5d9f-4bd0-bf6a-a17afd72137b-sys\") pod \"perf-node-gather-daemonset-x6d4p\" (UID: \"c7e41da3-5d9f-4bd0-bf6a-a17afd72137b\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p" Jul 28 00:12:43.206463 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.206432 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-vp982_a42da2e2-fca2-4f1b-b7e1-98d538dcf473/volume-data-source-validator/0.log" Jul 28 00:12:43.232742 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.232693 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c7e41da3-5d9f-4bd0-bf6a-a17afd72137b-proc\") pod \"perf-node-gather-daemonset-x6d4p\" (UID: \"c7e41da3-5d9f-4bd0-bf6a-a17afd72137b\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p" Jul 28 00:12:43.233196 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.232751 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c7e41da3-5d9f-4bd0-bf6a-a17afd72137b-lib-modules\") pod \"perf-node-gather-daemonset-x6d4p\" (UID: \"c7e41da3-5d9f-4bd0-bf6a-a17afd72137b\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p" Jul 28 00:12:43.233196 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.232805 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c7e41da3-5d9f-4bd0-bf6a-a17afd72137b-podres\") pod \"perf-node-gather-daemonset-x6d4p\" (UID: \"c7e41da3-5d9f-4bd0-bf6a-a17afd72137b\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p" Jul 28 00:12:43.233196 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.232850 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c7e41da3-5d9f-4bd0-bf6a-a17afd72137b-proc\") pod \"perf-node-gather-daemonset-x6d4p\" (UID: \"c7e41da3-5d9f-4bd0-bf6a-a17afd72137b\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p" Jul 28 00:12:43.233196 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.232831 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t42fs\" (UniqueName: \"kubernetes.io/projected/c7e41da3-5d9f-4bd0-bf6a-a17afd72137b-kube-api-access-t42fs\") pod \"perf-node-gather-daemonset-x6d4p\" (UID: \"c7e41da3-5d9f-4bd0-bf6a-a17afd72137b\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p" Jul 28 00:12:43.233196 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.232902 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7e41da3-5d9f-4bd0-bf6a-a17afd72137b-sys\") pod \"perf-node-gather-daemonset-x6d4p\" (UID: \"c7e41da3-5d9f-4bd0-bf6a-a17afd72137b\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p" Jul 28 00:12:43.233196 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.232973 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c7e41da3-5d9f-4bd0-bf6a-a17afd72137b-podres\") pod \"perf-node-gather-daemonset-x6d4p\" (UID: \"c7e41da3-5d9f-4bd0-bf6a-a17afd72137b\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p" Jul 28 00:12:43.233196 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.232984 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c7e41da3-5d9f-4bd0-bf6a-a17afd72137b-lib-modules\") pod \"perf-node-gather-daemonset-x6d4p\" (UID: \"c7e41da3-5d9f-4bd0-bf6a-a17afd72137b\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p" Jul 28 00:12:43.233196 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.233030 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7e41da3-5d9f-4bd0-bf6a-a17afd72137b-sys\") pod \"perf-node-gather-daemonset-x6d4p\" (UID: \"c7e41da3-5d9f-4bd0-bf6a-a17afd72137b\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p" Jul 28 00:12:43.241569 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.241534 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t42fs\" (UniqueName: \"kubernetes.io/projected/c7e41da3-5d9f-4bd0-bf6a-a17afd72137b-kube-api-access-t42fs\") pod \"perf-node-gather-daemonset-x6d4p\" (UID: \"c7e41da3-5d9f-4bd0-bf6a-a17afd72137b\") " pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p" Jul 28 00:12:43.366745 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.366701 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p" Jul 28 00:12:43.497065 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.497041 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p"] Jul 28 00:12:43.499463 ip-10-0-130-253 kubenswrapper[2574]: W0728 00:12:43.499427 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc7e41da3_5d9f_4bd0_bf6a_a17afd72137b.slice/crio-78abed7d1fa6e24708380b3991e37bfa0c29f2e34af0a426cba831a23af8de62 WatchSource:0}: Error finding container 78abed7d1fa6e24708380b3991e37bfa0c29f2e34af0a426cba831a23af8de62: Status 404 returned error can't find the container with id 78abed7d1fa6e24708380b3991e37bfa0c29f2e34af0a426cba831a23af8de62 Jul 28 00:12:43.973208 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.973172 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p" event={"ID":"c7e41da3-5d9f-4bd0-bf6a-a17afd72137b","Type":"ContainerStarted","Data":"191a5e22076ccf3dd8f0669ef3e01a0e0433cca93a6fe3eb1918e403168f1c4d"} Jul 28 00:12:43.973394 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.973223 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p" event={"ID":"c7e41da3-5d9f-4bd0-bf6a-a17afd72137b","Type":"ContainerStarted","Data":"78abed7d1fa6e24708380b3991e37bfa0c29f2e34af0a426cba831a23af8de62"} Jul 28 00:12:43.973394 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.973289 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p" Jul 28 00:12:43.992953 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:43.992730 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p" podStartSLOduration=0.9927081 podStartE2EDuration="992.7081ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:12:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:12:43.99264918 +0000 UTC m=+689.109154590" watchObservedRunningTime="2026-07-28 00:12:43.9927081 +0000 UTC m=+689.109213513" Jul 28 00:12:44.056849 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:44.056816 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7zf7v_e6289e83-59b7-439e-8461-6c85c6828ddb/dns/0.log" Jul 28 00:12:44.083957 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:44.083925 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7zf7v_e6289e83-59b7-439e-8461-6c85c6828ddb/kube-rbac-proxy/0.log" Jul 28 00:12:44.165990 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:44.165955 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-27gsr_cc43fba5-dd78-4101-88e2-58f00af58ef1/dns-node-resolver/0.log" Jul 28 00:12:44.660414 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:44.660384 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5df5f45bbb-6rmzz_5b1f8b4d-f1df-4e50-8c4a-ad21bd92cccf/registry/0.log" Jul 28 00:12:44.720527 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:44.720490 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ckjf9_0823e600-8868-4c59-b929-7d0a7ae34711/node-ca/0.log" Jul 28 00:12:45.496169 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:45.496135 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-679f79d87c-8wpbk_57909377-68d5-4ecb-b1dc-3ebece8627a7/router/0.log" Jul 28 00:12:45.904559 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:45.904530 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-stwkz_acbb6d5a-520b-4258-bea6-85a4c279d823/serve-healthcheck-canary/0.log" Jul 28 00:12:46.326245 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:46.326213 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8dxf9_5183a10e-9591-4737-94b4-fd2490a6adf3/kube-rbac-proxy/0.log" Jul 28 00:12:46.352654 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:46.352627 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8dxf9_5183a10e-9591-4737-94b4-fd2490a6adf3/exporter/0.log" Jul 28 00:12:46.376745 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:46.376718 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8dxf9_5183a10e-9591-4737-94b4-fd2490a6adf3/extractor/0.log" Jul 28 00:12:49.987721 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:49.987685 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qnmh4/perf-node-gather-daemonset-x6d4p" Jul 28 00:12:51.144996 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:51.144945 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n_3a9aeaa9-bdff-44d6-85f4-06375e0c97ce/kube-storage-version-migrator-operator/1.log" Jul 28 00:12:51.145519 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:51.145314 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-q9q4n_3a9aeaa9-bdff-44d6-85f4-06375e0c97ce/kube-storage-version-migrator-operator/0.log" Jul 28 00:12:51.366856 ip-10-0-130-253 kubenswrapper[2574]: E0728 00:12:51.366818 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cert-manager-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/cert-manager/cert-manager-operator-rhel9@sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 504 Gateway Time-out; artifact err: get manifest: build image source: reading manifest sha256:d8a14cf03a7872a88dd61e1aa6b2a84ce031a2044d0d4d129154041a1adaa481 in registry.redhat.io/cert-manager/cert-manager-operator-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vlgcq" podUID="e75b3b2a-75f0-4d1b-a6f8-436dd205e79f" Jul 28 00:12:52.335325 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:52.335297 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dl5vz_86091880-c298-4359-9ca1-b513f2af0889/kube-multus-additional-cni-plugins/0.log" Jul 28 00:12:52.364905 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:52.364874 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dl5vz_86091880-c298-4359-9ca1-b513f2af0889/egress-router-binary-copy/0.log" Jul 28 00:12:52.392828 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:52.392807 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dl5vz_86091880-c298-4359-9ca1-b513f2af0889/cni-plugins/0.log" Jul 28 00:12:52.423090 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:52.423064 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dl5vz_86091880-c298-4359-9ca1-b513f2af0889/bond-cni-plugin/0.log" Jul 28 00:12:52.449792 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:52.449688 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dl5vz_86091880-c298-4359-9ca1-b513f2af0889/routeoverride-cni/0.log" Jul 28 00:12:52.481823 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:52.481788 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dl5vz_86091880-c298-4359-9ca1-b513f2af0889/whereabouts-cni-bincopy/0.log" Jul 28 00:12:52.511121 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:52.511094 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dl5vz_86091880-c298-4359-9ca1-b513f2af0889/whereabouts-cni/0.log" Jul 28 00:12:52.811841 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:52.811812 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gpmnb_43ed315f-8fbe-4ed0-bec3-53df8ab99e50/kube-multus/0.log" Jul 28 00:12:52.841484 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:52.841453 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f29s8_5894c611-99f4-4459-8619-63305e3d25d1/network-metrics-daemon/0.log" Jul 28 00:12:52.865703 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:52.865678 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f29s8_5894c611-99f4-4459-8619-63305e3d25d1/kube-rbac-proxy/0.log" Jul 28 00:12:53.962573 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:53.962541 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-md25x_184b7c0e-0bee-4207-a828-2b9df804266b/ovn-controller/0.log" Jul 28 00:12:53.986741 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:53.986696 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-md25x_184b7c0e-0bee-4207-a828-2b9df804266b/ovn-acl-logging/0.log" Jul 28 00:12:54.015372 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:54.015343 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-md25x_184b7c0e-0bee-4207-a828-2b9df804266b/kube-rbac-proxy-node/0.log" Jul 28 00:12:54.042688 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:54.042645 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-md25x_184b7c0e-0bee-4207-a828-2b9df804266b/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 00:12:54.065488 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:54.065462 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-md25x_184b7c0e-0bee-4207-a828-2b9df804266b/northd/0.log" Jul 28 00:12:54.090268 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:54.090239 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-md25x_184b7c0e-0bee-4207-a828-2b9df804266b/nbdb/0.log" Jul 28 00:12:54.119445 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:54.119414 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-md25x_184b7c0e-0bee-4207-a828-2b9df804266b/sbdb/0.log" Jul 28 00:12:54.163593 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:54.163514 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-md25x_184b7c0e-0bee-4207-a828-2b9df804266b/ovnkube-controller/0.log" Jul 28 00:12:55.440084 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:55.440050 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-dflsn_65d808ec-5de9-4dfa-9c3e-e45a41f3ccde/network-check-target-container/0.log" Jul 28 00:12:56.480624 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:56.480599 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-hdmsb_413bb2d5-d73f-4e81-b7fb-33dd3de573c2/iptables-alerter/0.log" Jul 28 00:12:57.173899 ip-10-0-130-253 kubenswrapper[2574]: I0728 00:12:57.173860 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-45jgc_75ab6b83-7e76-44aa-b4a0-0766b1c60382/tuned/0.log"