Jul 28 00:01:07.795871 ip-10-0-132-108 systemd[1]: Starting Kubernetes Kubelet... Jul 28 00:01:08.207498 ip-10-0-132-108 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 00:01:08.207498 ip-10-0-132-108 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 00:01:08.207498 ip-10-0-132-108 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 00:01:08.207498 ip-10-0-132-108 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 00:01:08.207498 ip-10-0-132-108 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 00:01:08.208124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.207553 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 00:01:08.211875 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211859 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:01:08.211875 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211873 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:01:08.211940 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211877 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:01:08.211940 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211880 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:01:08.211940 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211883 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:01:08.211940 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211887 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:01:08.211940 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211890 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:01:08.211940 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211893 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:01:08.211940 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211896 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:01:08.211940 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211899 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:01:08.211940 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211901 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:01:08.211940 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211904 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:01:08.211940 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211907 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:01:08.211940 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211910 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:01:08.211940 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211912 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:01:08.211940 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211915 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:01:08.211940 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211917 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:01:08.211940 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211925 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:01:08.211940 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211928 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:01:08.211940 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211930 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:01:08.211940 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211933 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:01:08.211940 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211935 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:01:08.212452 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211938 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:01:08.212452 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211941 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:01:08.212452 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211943 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:01:08.212452 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211946 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:01:08.212452 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211949 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:01:08.212452 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211952 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:01:08.212452 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211955 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:01:08.212452 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211957 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:01:08.212452 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211959 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:01:08.212452 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211962 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:01:08.212452 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211964 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:01:08.212452 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211967 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:01:08.212452 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211972 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:01:08.212452 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211976 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:01:08.212452 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211979 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:01:08.212452 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211982 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:01:08.212452 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211985 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:01:08.212452 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211987 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:01:08.212452 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211990 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:01:08.212452 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211992 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:01:08.212967 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211994 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:01:08.212967 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211997 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:01:08.212967 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.211999 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:01:08.212967 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212001 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:01:08.212967 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212004 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:01:08.212967 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212006 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:01:08.212967 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212009 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:01:08.212967 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212011 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:01:08.212967 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212013 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:01:08.212967 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212016 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:01:08.212967 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212018 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:01:08.212967 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212021 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:01:08.212967 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212024 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:01:08.212967 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212027 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:01:08.212967 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212030 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:01:08.212967 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212032 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:01:08.212967 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212035 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:01:08.212967 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212038 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:01:08.212967 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212040 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:01:08.212967 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212044 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:01:08.213460 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212047 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:01:08.213460 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212050 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:01:08.213460 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212052 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:01:08.213460 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212055 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:01:08.213460 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212057 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:01:08.213460 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212060 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:01:08.213460 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212064 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:01:08.213460 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212066 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:01:08.213460 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212069 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:01:08.213460 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212072 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:01:08.213460 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212074 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:01:08.213460 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212077 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:01:08.213460 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212079 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:01:08.213460 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212083 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:01:08.213460 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212087 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:01:08.213460 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212090 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:01:08.213460 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212093 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:01:08.213460 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212095 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:01:08.213460 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212098 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:01:08.213934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212100 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:01:08.213934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212103 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:01:08.213934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212105 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:01:08.213934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212108 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:01:08.213934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212110 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:01:08.213934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212113 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:01:08.213934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212115 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:01:08.213934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212118 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:01:08.213934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212121 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:01:08.213934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212123 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:01:08.213934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212125 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:01:08.213934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212128 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:01:08.213934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212130 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:01:08.213934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212133 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:01:08.213934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212135 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:01:08.213934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212137 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:01:08.213934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212140 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:01:08.213934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.212142 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:01:08.214540 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214528 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:01:08.214540 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214540 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:01:08.214608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214543 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:01:08.214608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214546 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:01:08.214608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214549 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:01:08.214608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214558 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:01:08.214608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214562 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:01:08.214608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214564 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:01:08.214608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214568 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:01:08.214608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214583 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:01:08.214608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214586 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:01:08.214608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214589 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:01:08.214608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214592 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:01:08.214608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214595 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:01:08.214608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214597 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:01:08.214608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214600 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:01:08.214608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214603 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:01:08.214608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214605 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:01:08.214608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214608 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:01:08.214608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214610 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:01:08.214608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214613 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:01:08.214608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214616 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:01:08.215140 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214619 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:01:08.215140 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214622 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:01:08.215140 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214624 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:01:08.215140 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214628 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:01:08.215140 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214632 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:01:08.215140 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214635 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:01:08.215140 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214638 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:01:08.215140 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214640 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:01:08.215140 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214643 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:01:08.215140 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214646 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:01:08.215140 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214649 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:01:08.215140 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214652 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:01:08.215140 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214655 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:01:08.215140 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214658 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:01:08.215140 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214661 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:01:08.215140 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214663 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:01:08.215140 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214667 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:01:08.215140 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214669 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:01:08.215140 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214672 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:01:08.215662 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214674 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:01:08.215662 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214677 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:01:08.215662 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214679 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:01:08.215662 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214682 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:01:08.215662 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214684 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:01:08.215662 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214687 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:01:08.215662 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214689 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:01:08.215662 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214692 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:01:08.215662 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214694 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:01:08.215662 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214696 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:01:08.215662 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214699 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:01:08.215662 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214701 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:01:08.215662 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214704 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:01:08.215662 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214706 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:01:08.215662 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214711 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:01:08.215662 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214715 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:01:08.215662 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214718 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:01:08.215662 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214721 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:01:08.215662 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214724 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:01:08.215662 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214726 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:01:08.216151 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214728 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:01:08.216151 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214731 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:01:08.216151 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214733 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:01:08.216151 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214736 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:01:08.216151 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214738 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:01:08.216151 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214741 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:01:08.216151 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214743 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:01:08.216151 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214746 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:01:08.216151 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214748 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:01:08.216151 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214750 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:01:08.216151 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214753 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:01:08.216151 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214757 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:01:08.216151 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214761 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:01:08.216151 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214765 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:01:08.216151 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214767 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:01:08.216151 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214770 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:01:08.216151 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214772 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:01:08.216151 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214775 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:01:08.216151 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214778 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:01:08.216645 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214780 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:01:08.216645 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214782 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:01:08.216645 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214785 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:01:08.216645 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214787 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:01:08.216645 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214790 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:01:08.216645 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214792 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:01:08.216645 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214795 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:01:08.216645 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214798 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:01:08.216645 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214801 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:01:08.216645 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214804 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:01:08.216645 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214806 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:01:08.216645 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214808 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:01:08.216645 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214811 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:01:08.216645 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214813 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:01:08.216645 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214816 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:01:08.216645 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214818 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:01:08.216645 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214821 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:01:08.216645 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214824 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:01:08.216645 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.214826 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:01:08.216645 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215173 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:01:08.217128 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215177 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:01:08.217128 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215180 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:01:08.217128 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215183 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:01:08.217128 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215186 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:01:08.217128 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215188 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:01:08.217128 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215193 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:01:08.217128 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215196 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:01:08.217128 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215200 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:01:08.217128 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215203 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:01:08.217128 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215205 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:01:08.217128 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215208 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:01:08.217128 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215211 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:01:08.217128 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215214 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:01:08.217128 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215217 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:01:08.217128 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215219 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:01:08.217128 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215222 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:01:08.217128 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215226 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:01:08.217128 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215229 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:01:08.217128 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215232 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:01:08.217608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215235 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:01:08.217608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215238 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:01:08.217608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215240 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:01:08.217608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215243 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:01:08.217608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215245 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:01:08.217608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215248 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:01:08.217608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215250 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:01:08.217608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215253 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:01:08.217608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215255 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:01:08.217608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215257 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:01:08.217608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215260 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:01:08.217608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215263 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:01:08.217608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215266 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:01:08.217608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215268 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:01:08.217608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215271 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:01:08.217608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215273 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:01:08.217608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215275 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:01:08.217608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215278 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:01:08.217608 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215281 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:01:08.218072 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215283 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:01:08.218072 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215286 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:01:08.218072 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215288 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:01:08.218072 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215291 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:01:08.218072 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215294 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:01:08.218072 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215296 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:01:08.218072 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215299 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:01:08.218072 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215301 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:01:08.218072 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215305 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:01:08.218072 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215307 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:01:08.218072 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215310 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:01:08.218072 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215313 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:01:08.218072 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215316 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:01:08.218072 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215318 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:01:08.218072 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215321 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:01:08.218072 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215324 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:01:08.218072 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215326 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:01:08.218072 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215328 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:01:08.218072 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215331 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:01:08.218072 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215333 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:01:08.218562 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215336 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:01:08.218562 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215338 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:01:08.218562 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215341 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:01:08.218562 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215343 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:01:08.218562 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215345 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:01:08.218562 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215348 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:01:08.218562 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215350 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:01:08.218562 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215353 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:01:08.218562 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215356 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:01:08.218562 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215358 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:01:08.218562 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215361 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:01:08.218562 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215363 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:01:08.218562 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215366 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:01:08.218562 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215368 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:01:08.218562 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215370 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:01:08.218562 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215373 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:01:08.218562 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215375 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:01:08.218562 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215378 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:01:08.218562 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215380 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:01:08.218562 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215382 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:01:08.219054 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215385 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:01:08.219054 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215387 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:01:08.219054 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215389 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:01:08.219054 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215394 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:01:08.219054 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215396 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:01:08.219054 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215399 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:01:08.219054 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215402 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:01:08.219054 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215404 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:01:08.219054 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215407 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:01:08.219054 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215410 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:01:08.219054 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215412 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:01:08.219054 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215415 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:01:08.219054 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215417 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:01:08.219054 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215420 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:01:08.219054 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215422 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:01:08.219054 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215425 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:01:08.219054 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215427 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:01:08.219054 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215429 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:01:08.219054 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215432 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:01:08.219054 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.215434 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215500 2562 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215506 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215512 2562 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215515 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215520 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215523 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215527 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215530 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215533 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215536 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215539 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215542 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215545 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215548 2562 flags.go:64] FLAG: --cgroup-root="" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215550 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215555 2562 flags.go:64] FLAG: --client-ca-file="" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215557 2562 flags.go:64] FLAG: --cloud-provider="external" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215561 2562 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215564 2562 flags.go:64] FLAG: --cluster-domain="" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215567 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215583 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215587 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215590 2562 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 00:01:08.219530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215594 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215596 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215599 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215602 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215605 2562 flags.go:64] FLAG: --contention-profiling="false" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215608 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215611 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215614 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215617 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215620 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215623 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215626 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215629 2562 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215632 2562 flags.go:64] FLAG: --enable-server="true" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215635 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215640 2562 flags.go:64] FLAG: --event-burst="100" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215643 2562 flags.go:64] FLAG: --event-qps="50" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215645 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215648 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215651 2562 flags.go:64] FLAG: --eviction-hard="" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215659 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215662 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215664 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215667 2562 flags.go:64] FLAG: --eviction-soft="" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215672 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 00:01:08.220124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215675 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215678 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215681 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215684 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215686 2562 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215689 2562 flags.go:64] FLAG: --feature-gates="" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215692 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215695 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215698 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215701 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215703 2562 flags.go:64] FLAG: --healthz-port="10248" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215706 2562 flags.go:64] FLAG: --help="false" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215709 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-132-108.ec2.internal" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215712 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215715 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215717 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215720 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215724 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215726 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215729 2562 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215732 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215734 2562 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215737 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215740 2562 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 00:01:08.220807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215743 2562 flags.go:64] FLAG: --kube-reserved="" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215746 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215748 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215751 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215754 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215756 2562 flags.go:64] FLAG: --lock-file="" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215759 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215763 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215766 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215772 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215774 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215777 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215780 2562 flags.go:64] FLAG: --logging-format="text" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215783 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215786 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215789 2562 flags.go:64] FLAG: --manifest-url="" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215791 2562 flags.go:64] FLAG: --manifest-url-header="" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215796 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215799 2562 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215807 2562 flags.go:64] FLAG: --max-pods="110" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215810 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215812 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215815 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215818 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215820 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 00:01:08.221392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215823 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215826 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215833 2562 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215836 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215839 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215841 2562 flags.go:64] FLAG: --pod-cidr="" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215844 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215850 2562 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215852 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215855 2562 flags.go:64] FLAG: --pods-per-core="0" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215858 2562 flags.go:64] FLAG: --port="10250" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215861 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215864 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0893ca21d85ce170d" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215866 2562 flags.go:64] FLAG: --qos-reserved="" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215870 2562 flags.go:64] FLAG: --read-only-port="10255" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215874 2562 flags.go:64] FLAG: --register-node="true" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215877 2562 flags.go:64] FLAG: --register-with-taints="" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215880 2562 flags.go:64] FLAG: --registry-burst="10" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215883 2562 flags.go:64] FLAG: --registry-qps="5" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215886 2562 flags.go:64] FLAG: --reserved-cpus="" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215888 2562 flags.go:64] FLAG: --reserved-memory="" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215892 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215894 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215897 2562 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215900 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 00:01:08.222016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215903 2562 flags.go:64] FLAG: --runonce="false" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215905 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215908 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215911 2562 flags.go:64] FLAG: --seccomp-default="false" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215914 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215917 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215919 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215922 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215925 2562 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215928 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215930 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215933 2562 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215936 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215939 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215944 2562 flags.go:64] FLAG: --system-cgroups="" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215947 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215951 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215954 2562 flags.go:64] FLAG: --tls-cert-file="" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215956 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215960 2562 flags.go:64] FLAG: --tls-min-version="" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215963 2562 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215966 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215969 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215972 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215975 2562 flags.go:64] FLAG: --v="2" Jul 28 00:01:08.222628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215979 2562 flags.go:64] FLAG: --version="false" Jul 28 00:01:08.223228 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215982 2562 flags.go:64] FLAG: --vmodule="" Jul 28 00:01:08.223228 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215986 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 00:01:08.223228 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.215989 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 00:01:08.223228 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216101 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:01:08.223228 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216105 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:01:08.223228 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216108 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:01:08.223228 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216110 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:01:08.223228 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216113 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:01:08.223228 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216116 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:01:08.223228 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216119 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:01:08.223228 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216121 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:01:08.223228 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216124 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:01:08.223228 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216126 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:01:08.223228 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216129 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:01:08.223228 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216131 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:01:08.223228 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216134 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:01:08.223228 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216136 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:01:08.223228 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216138 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:01:08.223228 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216141 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:01:08.223228 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216143 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:01:08.223772 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216146 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:01:08.223772 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216148 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:01:08.223772 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216151 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:01:08.223772 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216154 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:01:08.223772 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216156 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:01:08.223772 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216159 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:01:08.223772 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216161 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:01:08.223772 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216164 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:01:08.223772 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216167 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:01:08.223772 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216170 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:01:08.223772 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216172 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:01:08.223772 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216175 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:01:08.223772 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216178 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:01:08.223772 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216180 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:01:08.223772 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216182 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:01:08.223772 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216185 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:01:08.223772 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216188 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:01:08.223772 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216191 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:01:08.223772 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216193 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:01:08.223772 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216196 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:01:08.224527 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216201 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:01:08.224527 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216204 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:01:08.224527 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216207 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:01:08.224527 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216210 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:01:08.224527 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216213 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:01:08.224527 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216215 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:01:08.224527 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216218 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:01:08.224527 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216221 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:01:08.224527 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216225 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:01:08.224527 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216227 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:01:08.224527 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216230 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:01:08.224527 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216232 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:01:08.224527 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216234 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:01:08.224527 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216237 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:01:08.224527 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216240 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:01:08.224527 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216242 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:01:08.224527 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216245 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:01:08.224527 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216248 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:01:08.224527 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216250 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:01:08.225172 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216254 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:01:08.225172 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216258 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:01:08.225172 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216260 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:01:08.225172 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216263 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:01:08.225172 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216265 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:01:08.225172 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216268 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:01:08.225172 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216271 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:01:08.225172 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216273 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:01:08.225172 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216276 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:01:08.225172 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216278 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:01:08.225172 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216281 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:01:08.225172 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216283 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:01:08.225172 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216285 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:01:08.225172 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216288 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:01:08.225172 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216291 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:01:08.225172 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216293 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:01:08.225172 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216295 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:01:08.225172 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216298 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:01:08.225172 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216300 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:01:08.225172 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216303 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:01:08.225682 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216305 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:01:08.225682 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216308 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:01:08.225682 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216310 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:01:08.225682 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216313 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:01:08.225682 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216315 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:01:08.225682 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216318 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:01:08.225682 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216320 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:01:08.225682 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216323 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:01:08.225682 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216325 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:01:08.225682 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216328 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:01:08.225682 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216331 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:01:08.225682 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216333 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:01:08.225682 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216338 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:01:08.225682 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216342 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:01:08.225682 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216346 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:01:08.225682 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216348 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:01:08.225682 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216351 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:01:08.225682 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216354 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:01:08.225682 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216357 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:01:08.226149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216360 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:01:08.226149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216363 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:01:08.226149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216365 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:01:08.226149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.216368 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:01:08.226149 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.217105 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 00:01:08.226149 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.225250 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 00:01:08.226149 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.225264 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 00:01:08.226149 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.225277 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 00:01:08.226149 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.225283 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 00:01:08.226149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225336 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:01:08.226149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225341 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:01:08.226149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225345 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:01:08.226149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225348 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:01:08.226149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225351 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:01:08.226149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225353 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:01:08.226523 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225356 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:01:08.226523 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225359 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:01:08.226523 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225361 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:01:08.226523 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225364 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:01:08.226523 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225367 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:01:08.226523 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225369 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:01:08.226523 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225372 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:01:08.226523 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225374 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:01:08.226523 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225377 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:01:08.226523 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225380 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:01:08.226523 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225382 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:01:08.226523 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225385 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:01:08.226523 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225388 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:01:08.226523 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225390 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:01:08.226523 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225393 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:01:08.226523 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225395 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:01:08.226523 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225398 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:01:08.226523 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225400 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:01:08.226523 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225403 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:01:08.226523 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225406 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:01:08.227019 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225409 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:01:08.227019 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225411 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:01:08.227019 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225414 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:01:08.227019 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225417 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:01:08.227019 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225419 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:01:08.227019 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225422 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:01:08.227019 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225424 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:01:08.227019 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225427 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:01:08.227019 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225431 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:01:08.227019 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225434 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:01:08.227019 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225437 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:01:08.227019 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225440 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:01:08.227019 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225443 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:01:08.227019 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225446 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:01:08.227019 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225448 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:01:08.227019 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225451 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:01:08.227019 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225454 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:01:08.227019 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225457 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:01:08.227019 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225459 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:01:08.227019 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225461 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:01:08.227510 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225464 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:01:08.227510 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225466 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:01:08.227510 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225468 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:01:08.227510 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225471 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:01:08.227510 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225473 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:01:08.227510 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225476 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:01:08.227510 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225478 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:01:08.227510 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225481 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:01:08.227510 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225483 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:01:08.227510 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225485 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:01:08.227510 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225488 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:01:08.227510 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225490 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:01:08.227510 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225493 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:01:08.227510 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225495 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:01:08.227510 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225498 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:01:08.227510 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225500 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:01:08.227510 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225503 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:01:08.227510 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225505 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:01:08.227510 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225508 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:01:08.227510 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225510 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:01:08.228149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225513 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:01:08.228149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225515 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:01:08.228149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225517 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:01:08.228149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225520 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:01:08.228149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225522 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:01:08.228149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225524 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:01:08.228149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225527 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:01:08.228149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225529 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:01:08.228149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225532 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:01:08.228149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225534 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:01:08.228149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225537 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:01:08.228149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225539 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:01:08.228149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225541 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:01:08.228149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225545 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:01:08.228149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225547 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:01:08.228149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225550 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:01:08.228149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225552 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:01:08.228149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225555 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:01:08.228149 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225557 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:01:08.228627 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225559 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:01:08.228627 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225563 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:01:08.228627 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225566 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:01:08.228627 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225569 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:01:08.228627 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225591 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:01:08.228627 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225596 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:01:08.228627 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225599 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:01:08.228627 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225602 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:01:08.228627 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225605 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:01:08.228627 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225607 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:01:08.228627 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225611 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:01:08.228627 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225615 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:01:08.228627 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225618 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:01:08.228627 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225620 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:01:08.228627 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.225625 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 00:01:08.228990 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225761 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:01:08.228990 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225767 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:01:08.228990 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225770 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:01:08.228990 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225773 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:01:08.228990 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225775 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:01:08.228990 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225778 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:01:08.228990 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225781 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:01:08.228990 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225783 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:01:08.228990 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225785 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:01:08.228990 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225788 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:01:08.228990 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225790 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:01:08.228990 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225794 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:01:08.228990 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225799 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:01:08.228990 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225802 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:01:08.228990 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225805 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:01:08.228990 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225808 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:01:08.228990 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225810 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:01:08.228990 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225813 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:01:08.228990 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225815 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:01:08.229442 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225818 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:01:08.229442 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225820 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:01:08.229442 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225823 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:01:08.229442 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225825 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:01:08.229442 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225827 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:01:08.229442 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225831 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:01:08.229442 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225835 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:01:08.229442 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225837 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:01:08.229442 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225840 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:01:08.229442 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225842 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:01:08.229442 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225844 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:01:08.229442 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225847 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:01:08.229442 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225849 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:01:08.229442 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225852 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:01:08.229442 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225854 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:01:08.229442 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225856 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:01:08.229442 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225859 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:01:08.229442 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225861 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:01:08.229442 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225863 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:01:08.229442 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225865 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:01:08.229935 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225868 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:01:08.229935 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225870 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:01:08.229935 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225873 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:01:08.229935 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225875 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:01:08.229935 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225878 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:01:08.229935 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225880 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:01:08.229935 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225883 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:01:08.229935 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225885 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:01:08.229935 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225888 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:01:08.229935 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225891 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:01:08.229935 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225893 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:01:08.229935 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225895 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:01:08.229935 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225898 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:01:08.229935 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225900 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:01:08.229935 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225903 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:01:08.229935 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225905 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:01:08.229935 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225907 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:01:08.229935 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225910 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:01:08.229935 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225912 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:01:08.229935 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225914 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:01:08.230409 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225917 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:01:08.230409 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225919 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:01:08.230409 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225921 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:01:08.230409 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225924 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:01:08.230409 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225926 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:01:08.230409 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225928 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:01:08.230409 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225931 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:01:08.230409 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225933 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:01:08.230409 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225936 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:01:08.230409 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225938 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:01:08.230409 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225941 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:01:08.230409 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225943 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:01:08.230409 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225945 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:01:08.230409 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225948 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:01:08.230409 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225950 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:01:08.230409 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225953 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:01:08.230409 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225955 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:01:08.230409 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225958 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:01:08.230409 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225960 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:01:08.230409 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225963 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:01:08.230409 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225966 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:01:08.230934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225968 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:01:08.230934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225971 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:01:08.230934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225973 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:01:08.230934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225975 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:01:08.230934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225978 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:01:08.230934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225980 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:01:08.230934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225982 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:01:08.230934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225987 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:01:08.230934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225989 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:01:08.230934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225992 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:01:08.230934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225994 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:01:08.230934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.225998 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:01:08.230934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.226001 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:01:08.230934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.226004 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:01:08.230934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.226006 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:01:08.230934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.226009 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:01:08.230934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.226012 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:01:08.230934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.226015 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:01:08.230934 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:08.226017 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:01:08.231394 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.226022 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 00:01:08.231394 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.226111 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 00:01:08.231394 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.228134 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 00:01:08.231394 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.229401 2562 server.go:1019] "Starting client certificate rotation" Jul 28 00:01:08.231394 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.229495 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 00:01:08.231394 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.229529 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 00:01:08.231771 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.231757 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 00:01:08.235413 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.235397 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 00:01:08.246200 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.246185 2562 log.go:25] "Validated CRI v1 runtime API" Jul 28 00:01:08.248946 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.248929 2562 log.go:25] "Validated CRI v1 image API" Jul 28 00:01:08.250457 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.250441 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 00:01:08.253676 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.253655 2562 fs.go:135] Filesystem UUIDs: map[3810dcda-11d5-4997-a718-d376e12dcd63:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9c122be3-736e-4f20-8afa-056a09634334:/dev/nvme0n1p4] Jul 28 00:01:08.253751 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.253675 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 00:01:08.260491 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.260371 2562 manager.go:216] Machine: {Timestamp:2026-07-28 00:01:08.258973844 +0000 UTC m=+0.345985705 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096226 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2585b40a4151b889c008336aa091fc SystemUUID:ec2585b4-0a41-51b8-89c0-08336aa091fc BootID:3fd94f16-9748-49fd-9cb8-eeaa265913c2 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b0:77:d4:03:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b0:77:d4:03:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:b2:61:55:d4:98 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 00:01:08.260491 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.260478 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 00:01:08.260670 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.260566 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 00:01:08.263058 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.263043 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 00:01:08.264528 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.264505 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 00:01:08.264670 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.264533 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-108.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 00:01:08.265341 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.265329 2562 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 00:01:08.265381 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.265345 2562 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 00:01:08.265381 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.265352 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 00:01:08.266924 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.266914 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 00:01:08.268497 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.268487 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 00:01:08.272330 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.272307 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 28 00:01:08.272430 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.272420 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 00:01:08.272473 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.272449 2562 kubelet.go:486] "Attempting to sync node with API server" Jul 28 00:01:08.272473 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.272459 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 00:01:08.272473 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.272472 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 00:01:08.272604 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.272480 2562 kubelet.go:398] "Adding apiserver pod source" Jul 28 00:01:08.272604 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.272488 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 00:01:08.272897 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.272886 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 00:01:08.272935 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.272904 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 00:01:08.275109 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.275095 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 00:01:08.276991 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.276977 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 00:01:08.277047 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.277007 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 00:01:08.278847 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.278834 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 00:01:08.278898 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.278858 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 00:01:08.278898 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.278868 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 00:01:08.278898 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.278874 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 00:01:08.278898 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.278882 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 00:01:08.278898 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.278887 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 00:01:08.278898 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.278895 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 00:01:08.279115 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.278899 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 00:01:08.279115 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.278916 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 00:01:08.279115 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.278924 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 00:01:08.279115 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.278932 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 00:01:08.279115 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.278940 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 00:01:08.280371 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:08.280341 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-108.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 00:01:08.280444 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:08.280369 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 00:01:08.280540 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.280529 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 00:01:08.280586 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.280542 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 00:01:08.283481 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.283469 2562 server.go:1268] "Started kubelet" Jul 28 00:01:08.283615 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.283589 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 00:01:08.283673 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.283640 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 00:01:08.283878 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.283780 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 00:01:08.284191 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.284137 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-psq22" Jul 28 00:01:08.284378 ip-10-0-132-108 systemd[1]: Started Kubernetes Kubelet. Jul 28 00:01:08.284694 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.284678 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 00:01:08.285547 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.285482 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-108.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 00:01:08.286377 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.286360 2562 server.go:310] "Adding debug handlers to kubelet server" Jul 28 00:01:08.292173 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.292154 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-psq22" Jul 28 00:01:08.292402 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:08.292373 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 00:01:08.293099 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:08.290737 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-108.ec2.internal.18c64b17e42c923b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-108.ec2.internal,UID:ip-10-0-132-108.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-108.ec2.internal,},FirstTimestamp:2026-07-28 00:01:08.283437627 +0000 UTC m=+0.370449488,LastTimestamp:2026-07-28 00:01:08.283437627 +0000 UTC m=+0.370449488,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-108.ec2.internal,}" Jul 28 00:01:08.293928 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.293914 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 00:01:08.293928 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.293921 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 00:01:08.294038 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:08.294002 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found" Jul 28 00:01:08.294552 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.294535 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 00:01:08.294690 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.294538 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 00:01:08.294782 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.294693 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 00:01:08.294782 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.294698 2562 factory.go:55] Registering systemd factory Jul 28 00:01:08.294782 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.294710 2562 factory.go:223] Registration of the systemd container factory successfully Jul 28 00:01:08.294891 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.294801 2562 reconstruct.go:97] "Volume reconstruction finished" Jul 28 00:01:08.294891 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.294807 2562 reconciler.go:29] "Reconciler: start to sync state" Jul 28 00:01:08.294977 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.294902 2562 factory.go:153] Registering CRI-O factory Jul 28 00:01:08.294977 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.294913 2562 factory.go:223] Registration of the crio container factory successfully Jul 28 00:01:08.295062 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.294994 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 00:01:08.295062 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.295018 2562 factory.go:103] Registering Raw factory Jul 28 00:01:08.295062 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.295037 2562 manager.go:1196] Started watching for new ooms in manager Jul 28 00:01:08.295483 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.295466 2562 manager.go:349] Starting recovery of all containers Jul 28 00:01:08.295707 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:08.295677 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-108.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 00:01:08.295846 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:08.295829 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 00:01:08.308233 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.308108 2562 manager.go:354] Recovery completed Jul 28 00:01:08.312094 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.312077 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:01:08.313829 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.313814 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:01:08.313901 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.313845 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:01:08.313901 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.313859 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:01:08.314396 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.314382 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 00:01:08.314396 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.314395 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 00:01:08.314473 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.314412 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 28 00:01:08.314501 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.314412 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:01:08.315102 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.315088 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:01:08.315155 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.315116 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:01:08.315155 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.315129 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:01:08.316151 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.316139 2562 policy_none.go:49] "None policy: Start" Jul 28 00:01:08.316198 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.316154 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 00:01:08.316198 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.316164 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 00:01:08.317135 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.317124 2562 policy_none.go:47] "Start" Jul 28 00:01:08.359110 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.359093 2562 manager.go:337] "Starting Device Plugin manager" Jul 28 00:01:08.359187 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:08.359119 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 00:01:08.359187 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.359127 2562 server.go:87] "Starting device plugin registration server" Jul 28 00:01:08.359334 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.359321 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 00:01:08.359372 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.359338 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 00:01:08.359477 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.359459 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 00:01:08.359647 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.359536 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 00:01:08.359647 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.359550 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 00:01:08.359986 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:08.359961 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 00:01:08.360053 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:08.360009 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-108.ec2.internal\" not found" Jul 28 00:01:08.459845 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.459805 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:01:08.461255 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.460677 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:01:08.461255 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.460701 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:01:08.461255 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.460712 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:01:08.461255 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.460735 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-108.ec2.internal" Jul 28 00:01:08.469489 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.469474 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-108.ec2.internal" Jul 28 00:01:08.469555 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:08.469494 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-108.ec2.internal\": node \"ip-10-0-132-108.ec2.internal\" not found" Jul 28 00:01:08.484258 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:08.484223 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found" Jul 28 00:01:08.491263 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.491234 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 00:01:08.492607 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.492591 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 00:01:08.492682 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.492632 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 00:01:08.492682 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.492655 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 00:01:08.492779 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:08.492693 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 00:01:08.495366 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.495350 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:01:08.584863 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:08.584834 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found" Jul 28 00:01:08.593000 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.592973 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-108.ec2.internal"] Jul 28 00:01:08.593049 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.593037 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:01:08.593811 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.593793 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:01:08.593892 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.593819 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:01:08.593892 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.593829 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:01:08.595087 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.595075 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:01:08.595189 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.595174 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal" Jul 28 00:01:08.595230 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.595202 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:01:08.595495 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.595478 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b1c69b06c584a83e8ec1af8c2a37a7f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal\" (UID: \"1b1c69b06c584a83e8ec1af8c2a37a7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal" Jul 28 00:01:08.595495 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.595501 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b1c69b06c584a83e8ec1af8c2a37a7f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal\" (UID: \"1b1c69b06c584a83e8ec1af8c2a37a7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal" Jul 28 00:01:08.595715 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.595699 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:01:08.595768 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.595713 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:01:08.595768 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.595733 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:01:08.595768 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.595740 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:01:08.595768 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.595746 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:01:08.595768 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.595754 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:01:08.596853 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.596840 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-108.ec2.internal" Jul 28 00:01:08.596910 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.596862 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:01:08.597507 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.597492 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:01:08.597558 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.597522 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:01:08.597558 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.597532 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:01:08.620246 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:08.620226 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-108.ec2.internal\" not found" node="ip-10-0-132-108.ec2.internal" Jul 28 00:01:08.624601 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:08.624587 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-108.ec2.internal\" not found" node="ip-10-0-132-108.ec2.internal" Jul 28 00:01:08.685941 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:08.685920 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found" Jul 28 00:01:08.696321 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.696302 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b1c69b06c584a83e8ec1af8c2a37a7f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal\" (UID: \"1b1c69b06c584a83e8ec1af8c2a37a7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal" Jul 28 00:01:08.696407 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.696325 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b1c69b06c584a83e8ec1af8c2a37a7f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal\" (UID: \"1b1c69b06c584a83e8ec1af8c2a37a7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal" Jul 28 00:01:08.696407 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.696344 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/30f65fb00ad2053bc625f5a773e5d6b7-config\") pod \"kube-apiserver-proxy-ip-10-0-132-108.ec2.internal\" (UID: \"30f65fb00ad2053bc625f5a773e5d6b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-108.ec2.internal" Jul 28 00:01:08.696485 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.696420 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b1c69b06c584a83e8ec1af8c2a37a7f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal\" (UID: \"1b1c69b06c584a83e8ec1af8c2a37a7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal" Jul 28 00:01:08.696485 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.696423 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b1c69b06c584a83e8ec1af8c2a37a7f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal\" (UID: \"1b1c69b06c584a83e8ec1af8c2a37a7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal" Jul 28 00:01:08.786870 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:08.786826 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found" Jul 28 00:01:08.797177 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.797156 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/30f65fb00ad2053bc625f5a773e5d6b7-config\") pod \"kube-apiserver-proxy-ip-10-0-132-108.ec2.internal\" (UID: \"30f65fb00ad2053bc625f5a773e5d6b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-108.ec2.internal" Jul 28 00:01:08.797229 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.797189 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/30f65fb00ad2053bc625f5a773e5d6b7-config\") pod \"kube-apiserver-proxy-ip-10-0-132-108.ec2.internal\" (UID: \"30f65fb00ad2053bc625f5a773e5d6b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-108.ec2.internal" Jul 28 00:01:08.887326 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:08.887310 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found" Jul 28 00:01:08.921806 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.921785 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal" Jul 28 00:01:08.928839 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:08.928815 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-108.ec2.internal" Jul 28 00:01:08.987410 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:08.987389 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found" Jul 28 00:01:09.087933 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:09.087915 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found" Jul 28 00:01:09.188423 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:09.188390 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found" Jul 28 00:01:09.228925 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:09.228899 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 00:01:09.229360 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:09.229046 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 00:01:09.289282 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:09.289257 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found" Jul 28 00:01:09.297726 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:09.297658 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 23:56:08 +0000 UTC" deadline="2028-05-02 15:17:08.519981706 +0000 UTC" Jul 28 00:01:09.297726 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:09.297725 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15471h15m59.222261288s" Jul 28 00:01:09.371274 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:09.371212 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:01:09.390059 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:09.390038 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found" Jul 28 00:01:09.491149 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:09.491119 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found" Jul 28 00:01:09.506321 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:09.506293 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f65fb00ad2053bc625f5a773e5d6b7.slice/crio-9a0d9a30d0a8b200aee168efe0cede58b50323c6b91588f2ca4301b3c0d0fbea WatchSource:0}: Error finding container 9a0d9a30d0a8b200aee168efe0cede58b50323c6b91588f2ca4301b3c0d0fbea: Status 404 returned error can't find the container with id 9a0d9a30d0a8b200aee168efe0cede58b50323c6b91588f2ca4301b3c0d0fbea Jul 28 00:01:09.506795 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:09.506772 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b1c69b06c584a83e8ec1af8c2a37a7f.slice/crio-87c284610228609a4ad46308570a671352755488e131c32bc5fbfe095fd173d7 WatchSource:0}: Error finding container 87c284610228609a4ad46308570a671352755488e131c32bc5fbfe095fd173d7: Status 404 returned error can't find the container with id 87c284610228609a4ad46308570a671352755488e131c32bc5fbfe095fd173d7 Jul 28 00:01:09.511195 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:09.511182 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 00:01:09.593008 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:09.592976 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found" Jul 28 00:01:09.700665 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:09.700616 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found" Jul 28 00:01:09.733738 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:09.733718 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:01:09.794775 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:09.794753 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:01:09.900156 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:09.900132 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal" Jul 28 00:01:09.913645 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:09.913627 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 00:01:09.914835 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:09.914820 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-108.ec2.internal" Jul 28 00:01:09.920942 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:09.920921 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 00:01:10.258201 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.258160 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:01:10.274124 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.274100 2562 apiserver.go:52] "Watching apiserver" Jul 28 00:01:10.281979 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.281950 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 00:01:10.282642 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.282345 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-ttcz2","openshift-ovn-kubernetes/ovnkube-node-tvrbh","kube-system/konnectivity-agent-qk4l8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5","openshift-cluster-node-tuning-operator/tuned-rlgt4","openshift-dns/node-resolver-wj95q","openshift-multus/multus-additional-cni-plugins-9vdmc","openshift-network-diagnostics/network-check-target-n4nkt","kube-system/global-pull-secret-syncer-6fn66","kube-system/kube-apiserver-proxy-ip-10-0-132-108.ec2.internal","openshift-image-registry/node-ca-psqlm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal","openshift-multus/multus-sblhp","openshift-multus/network-metrics-daemon-jqdhz"] Jul 28 00:01:10.284303 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.284272 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.285820 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.285799 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.287273 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.287018 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qk4l8" Jul 28 00:01:10.287478 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.287459 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 00:01:10.287697 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.287638 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 00:01:10.287924 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.287821 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ccq6d\"" Jul 28 00:01:10.287924 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.287864 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 00:01:10.288026 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.287953 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 00:01:10.288026 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.287994 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 00:01:10.289406 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.288217 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7wn8v\"" Jul 28 00:01:10.289406 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.288281 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 00:01:10.289406 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.288959 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.289546 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.289414 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 00:01:10.292279 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.292051 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pjqgq\"" Jul 28 00:01:10.293019 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.292782 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 00:01:10.294461 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.293430 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 00:01:10.294461 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.293760 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 00:01:10.294461 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.293898 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nns64\"" Jul 28 00:01:10.295904 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.295888 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 00:01:10.296691 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.296670 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.296784 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.296697 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 00:01:10.297988 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.297967 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wj95q" Jul 28 00:01:10.299982 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.299956 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:10.300102 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:10.300032 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fn66" podUID="8d81b605-7b6c-4482-bf3c-e9be07ece7a1" Jul 28 00:01:10.300900 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.300879 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mbrnn\"" Jul 28 00:01:10.301110 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.301093 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wjxtz\"" Jul 28 00:01:10.301225 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.301203 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:01:10.301277 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.300913 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 00:01:10.301335 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.301324 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 00:01:10.301515 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.301503 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 00:01:10.301793 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.301776 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ttcz2" Jul 28 00:01:10.303447 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.303430 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.305011 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.304990 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-multus-conf-dir\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.305103 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305028 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-etc-kubernetes\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.305103 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305055 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-sys\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.305103 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305081 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37a8f118-b676-45df-bb06-468b904da361-cnibin\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.305261 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305112 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37a8f118-b676-45df-bb06-468b904da361-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.305261 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-system-cni-dir\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.305261 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305163 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-os-release\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.305261 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305189 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a267ae2d-361c-4e6b-9c8d-c80fe11793c9-agent-certs\") pod \"konnectivity-agent-qk4l8\" (UID: \"a267ae2d-361c-4e6b-9c8d-c80fe11793c9\") " pod="kube-system/konnectivity-agent-qk4l8" Jul 28 00:01:10.305261 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305218 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-etc-sysctl-conf\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.305517 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305256 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-host-run-k8s-cni-cncf-io\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.305517 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305284 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0ae09989-8e9a-43e6-b8b4-ffbab28fafb8-socket-dir\") pod \"aws-ebs-csi-driver-node-vsdr5\" (UID: \"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.305517 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305300 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0ae09989-8e9a-43e6-b8b4-ffbab28fafb8-registration-dir\") pod \"aws-ebs-csi-driver-node-vsdr5\" (UID: \"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.305517 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305328 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0ae09989-8e9a-43e6-b8b4-ffbab28fafb8-device-dir\") pod \"aws-ebs-csi-driver-node-vsdr5\" (UID: \"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.305517 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305343 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37a8f118-b676-45df-bb06-468b904da361-os-release\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.305517 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305359 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-multus-cni-dir\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.305517 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305376 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-host-var-lib-cni-multus\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.305517 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305397 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-host-run-multus-certs\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.305517 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305415 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-etc-kubernetes\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.305517 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a267ae2d-361c-4e6b-9c8d-c80fe11793c9-konnectivity-ca\") pod \"konnectivity-agent-qk4l8\" (UID: \"a267ae2d-361c-4e6b-9c8d-c80fe11793c9\") " pod="kube-system/konnectivity-agent-qk4l8" Jul 28 00:01:10.305517 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305462 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0ae09989-8e9a-43e6-b8b4-ffbab28fafb8-etc-selinux\") pod \"aws-ebs-csi-driver-node-vsdr5\" (UID: \"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.305517 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305488 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-etc-modprobe-d\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.305517 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305503 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-etc-sysconfig\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.306173 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305522 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-tmp\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.306173 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305543 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/651aa53e-86d5-4e25-8d15-18b49e507a78-multus-daemon-config\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.306173 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305563 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-host-run-netns\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.306173 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305578 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-host-var-lib-kubelet\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.306173 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305603 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0ae09989-8e9a-43e6-b8b4-ffbab28fafb8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vsdr5\" (UID: \"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.306173 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305619 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx7wv\" (UniqueName: \"kubernetes.io/projected/0ae09989-8e9a-43e6-b8b4-ffbab28fafb8-kube-api-access-qx7wv\") pod \"aws-ebs-csi-driver-node-vsdr5\" (UID: \"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.306173 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305638 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-etc-systemd\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.306173 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305678 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-etc-tuned\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.306173 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305705 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37a8f118-b676-45df-bb06-468b904da361-system-cni-dir\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.306173 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305728 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37a8f118-b676-45df-bb06-468b904da361-cni-binary-copy\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.306173 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305757 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-cnibin\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.306173 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/651aa53e-86d5-4e25-8d15-18b49e507a78-cni-binary-copy\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.306173 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305816 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-multus-socket-dir-parent\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.306173 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305842 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0ae09989-8e9a-43e6-b8b4-ffbab28fafb8-sys-fs\") pod \"aws-ebs-csi-driver-node-vsdr5\" (UID: \"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.306173 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305868 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-var-lib-kubelet\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.306173 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305893 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-host\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.307004 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305920 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bwc7\" (UniqueName: \"kubernetes.io/projected/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-kube-api-access-6bwc7\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.307004 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305948 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmxm6\" (UniqueName: \"kubernetes.io/projected/37a8f118-b676-45df-bb06-468b904da361-kube-api-access-nmxm6\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.307004 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.305975 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-host-var-lib-cni-bin\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.307004 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.306009 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfk56\" (UniqueName: \"kubernetes.io/projected/651aa53e-86d5-4e25-8d15-18b49e507a78-kube-api-access-nfk56\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.307004 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.306038 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-lib-modules\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.307004 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.306066 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-etc-sysctl-d\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.307004 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.306104 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-run\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.307004 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.306133 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37a8f118-b676-45df-bb06-468b904da361-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.307004 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.306162 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37a8f118-b676-45df-bb06-468b904da361-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.307004 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.306191 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-hostroot\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.307004 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.306763 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 00:01:10.307004 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.306831 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 00:01:10.307004 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.306862 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 00:01:10.307004 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.306927 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 00:01:10.307004 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.306957 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 00:01:10.307509 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.307034 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:10.307509 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.307037 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:01:10.307509 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.307106 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-psqlm" Jul 28 00:01:10.307509 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:10.307090 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqdhz" podUID="ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71" Jul 28 00:01:10.307509 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.307155 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 00:01:10.307509 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.307239 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 00:01:10.307779 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.307587 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fwvxj\"" Jul 28 00:01:10.307779 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.307597 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 00:01:10.307779 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.307761 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:10.307930 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.307826 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jrr74\"" Jul 28 00:01:10.307930 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:10.307826 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4nkt" podUID="898d09b0-dd59-4773-a4a2-74618b9015d9" Jul 28 00:01:10.308398 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.308375 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 00:01:10.312666 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.312628 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xvwpk\"" Jul 28 00:01:10.312769 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.312636 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 00:01:10.312769 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.312712 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 00:01:10.312769 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.312721 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 00:01:10.330155 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.330027 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6ffrw" Jul 28 00:01:10.336665 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.336631 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6ffrw" Jul 28 00:01:10.396095 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.396072 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 00:01:10.407069 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407043 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a267ae2d-361c-4e6b-9c8d-c80fe11793c9-konnectivity-ca\") pod \"konnectivity-agent-qk4l8\" (UID: \"a267ae2d-361c-4e6b-9c8d-c80fe11793c9\") " pod="kube-system/konnectivity-agent-qk4l8" Jul 28 00:01:10.407183 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407085 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-lib-modules\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.407183 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407117 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37a8f118-b676-45df-bb06-468b904da361-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.407183 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407146 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-hostroot\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.407183 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407171 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-multus-conf-dir\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.407398 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407203 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret\") pod \"global-pull-secret-syncer-6fn66\" (UID: \"8d81b605-7b6c-4482-bf3c-e9be07ece7a1\") " pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:10.407398 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407233 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-host-run-ovn-kubernetes\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.407398 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407262 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37a8f118-b676-45df-bb06-468b904da361-cnibin\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.407398 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407290 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-system-cni-dir\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.407398 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-os-release\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.407398 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407345 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a267ae2d-361c-4e6b-9c8d-c80fe11793c9-agent-certs\") pod \"konnectivity-agent-qk4l8\" (UID: \"a267ae2d-361c-4e6b-9c8d-c80fe11793c9\") " pod="kube-system/konnectivity-agent-qk4l8" Jul 28 00:01:10.407398 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407374 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0ae09989-8e9a-43e6-b8b4-ffbab28fafb8-device-dir\") pod \"aws-ebs-csi-driver-node-vsdr5\" (UID: \"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.407867 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407401 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-log-socket\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.407867 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407428 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be369c59-0b1a-4743-a91e-6365573fe326-host\") pod \"node-ca-psqlm\" (UID: \"be369c59-0b1a-4743-a91e-6365573fe326\") " pod="openshift-image-registry/node-ca-psqlm" Jul 28 00:01:10.407867 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407455 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vntdj\" (UniqueName: \"kubernetes.io/projected/35f7c804-20c6-4b56-91bc-e4e9546926f1-kube-api-access-vntdj\") pod \"node-resolver-wj95q\" (UID: \"35f7c804-20c6-4b56-91bc-e4e9546926f1\") " pod="openshift-dns/node-resolver-wj95q" Jul 28 00:01:10.407867 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407482 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-kubelet-config\") pod \"global-pull-secret-syncer-6fn66\" (UID: \"8d81b605-7b6c-4482-bf3c-e9be07ece7a1\") " pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:10.407867 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407509 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9330a140-5213-4bff-9bbd-eab56d087ae6-host-slash\") pod \"iptables-alerter-ttcz2\" (UID: \"9330a140-5213-4bff-9bbd-eab56d087ae6\") " pod="openshift-network-operator/iptables-alerter-ttcz2" Jul 28 00:01:10.407867 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407534 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-run-ovn\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.407867 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407558 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-node-log\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.407867 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407587 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-multus-cni-dir\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.407867 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407615 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0ae09989-8e9a-43e6-b8b4-ffbab28fafb8-etc-selinux\") pod \"aws-ebs-csi-driver-node-vsdr5\" (UID: \"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.407867 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407698 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-os-release\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.407867 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407718 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-multus-conf-dir\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.407867 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407702 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j8v8\" (UniqueName: \"kubernetes.io/projected/9330a140-5213-4bff-9bbd-eab56d087ae6-kube-api-access-8j8v8\") pod \"iptables-alerter-ttcz2\" (UID: \"9330a140-5213-4bff-9bbd-eab56d087ae6\") " pod="openshift-network-operator/iptables-alerter-ttcz2" Jul 28 00:01:10.407867 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407797 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0ae09989-8e9a-43e6-b8b4-ffbab28fafb8-etc-selinux\") pod \"aws-ebs-csi-driver-node-vsdr5\" (UID: \"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.408519 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407881 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.408519 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407916 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99d4672b-07d4-467a-a989-1f3e2db65e4a-ovnkube-config\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.408519 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407963 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-etc-sysconfig\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.408519 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407978 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-lib-modules\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.408519 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.407993 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-tmp\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.408519 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408022 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/651aa53e-86d5-4e25-8d15-18b49e507a78-multus-daemon-config\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.408519 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408033 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0ae09989-8e9a-43e6-b8b4-ffbab28fafb8-device-dir\") pod \"aws-ebs-csi-driver-node-vsdr5\" (UID: \"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.408519 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408061 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35f7c804-20c6-4b56-91bc-e4e9546926f1-tmp-dir\") pod \"node-resolver-wj95q\" (UID: \"35f7c804-20c6-4b56-91bc-e4e9546926f1\") " pod="openshift-dns/node-resolver-wj95q" Jul 28 00:01:10.408519 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408085 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-system-cni-dir\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.408519 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408092 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-host-cni-netd\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.408519 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408142 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-host-var-lib-kubelet\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.408519 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408150 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37a8f118-b676-45df-bb06-468b904da361-cnibin\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.408519 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408173 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx7wv\" (UniqueName: \"kubernetes.io/projected/0ae09989-8e9a-43e6-b8b4-ffbab28fafb8-kube-api-access-qx7wv\") pod \"aws-ebs-csi-driver-node-vsdr5\" (UID: \"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.408519 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408204 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-dbus\") pod \"global-pull-secret-syncer-6fn66\" (UID: \"8d81b605-7b6c-4482-bf3c-e9be07ece7a1\") " pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:10.408519 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408231 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-run-systemd\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.408519 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408296 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99d4672b-07d4-467a-a989-1f3e2db65e4a-ovnkube-script-lib\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.408519 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408326 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzltj\" (UniqueName: \"kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj\") pod \"network-check-target-n4nkt\" (UID: \"898d09b0-dd59-4773-a4a2-74618b9015d9\") " pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:10.409318 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408352 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-cnibin\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.409318 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408380 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-multus-socket-dir-parent\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.409318 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408408 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8b5d\" (UniqueName: \"kubernetes.io/projected/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-kube-api-access-v8b5d\") pod \"network-metrics-daemon-jqdhz\" (UID: \"ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71\") " pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:10.409318 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408434 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9330a140-5213-4bff-9bbd-eab56d087ae6-iptables-alerter-script\") pod \"iptables-alerter-ttcz2\" (UID: \"9330a140-5213-4bff-9bbd-eab56d087ae6\") " pod="openshift-network-operator/iptables-alerter-ttcz2" Jul 28 00:01:10.409318 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408460 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-var-lib-kubelet\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.409318 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408455 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37a8f118-b676-45df-bb06-468b904da361-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.409318 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408495 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 00:01:10.409318 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408559 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-cnibin\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.409318 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408587 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-multus-cni-dir\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.409318 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408613 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-host\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.409318 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408501 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-host-var-lib-kubelet\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.409318 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408920 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-multus-socket-dir-parent\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.409318 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408940 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bwc7\" (UniqueName: \"kubernetes.io/projected/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-kube-api-access-6bwc7\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.409318 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408967 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmxm6\" (UniqueName: \"kubernetes.io/projected/37a8f118-b676-45df-bb06-468b904da361-kube-api-access-nmxm6\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.409318 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.408988 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-host-var-lib-cni-bin\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.409318 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409017 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-run-openvswitch\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.409318 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409066 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-etc-sysctl-d\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.409318 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409083 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-run\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.410426 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409100 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37a8f118-b676-45df-bb06-468b904da361-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.410426 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409117 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/35f7c804-20c6-4b56-91bc-e4e9546926f1-hosts-file\") pod \"node-resolver-wj95q\" (UID: \"35f7c804-20c6-4b56-91bc-e4e9546926f1\") " pod="openshift-dns/node-resolver-wj95q" Jul 28 00:01:10.410426 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409134 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99d4672b-07d4-467a-a989-1f3e2db65e4a-ovn-node-metrics-cert\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.410426 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409151 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-etc-kubernetes\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.410426 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409253 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-sys\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.410426 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409280 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37a8f118-b676-45df-bb06-468b904da361-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.410426 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0ae09989-8e9a-43e6-b8b4-ffbab28fafb8-socket-dir\") pod \"aws-ebs-csi-driver-node-vsdr5\" (UID: \"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.410426 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409345 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0ae09989-8e9a-43e6-b8b4-ffbab28fafb8-registration-dir\") pod \"aws-ebs-csi-driver-node-vsdr5\" (UID: \"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.410426 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409372 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-host-kubelet\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.410426 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409398 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-var-lib-openvswitch\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.410426 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409426 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-etc-sysctl-conf\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.410426 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409453 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-host-run-k8s-cni-cncf-io\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.410426 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409481 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37a8f118-b676-45df-bb06-468b904da361-os-release\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.410426 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409499 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-host\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.410426 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409507 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-host-var-lib-cni-multus\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.410426 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409556 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-etc-sysconfig\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.410426 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409559 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-host-var-lib-cni-multus\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.411307 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409585 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-host-run-multus-certs\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.411307 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409606 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-etc-kubernetes\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.411307 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409617 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-etc-kubernetes\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.411307 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409667 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-etc-modprobe-d\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.411307 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409680 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-var-lib-kubelet\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.411307 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409696 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be369c59-0b1a-4743-a91e-6365573fe326-serviceca\") pod \"node-ca-psqlm\" (UID: \"be369c59-0b1a-4743-a91e-6365573fe326\") " pod="openshift-image-registry/node-ca-psqlm" Jul 28 00:01:10.411307 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409726 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-host-slash\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.411307 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409757 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-host-run-netns\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.411307 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409787 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0ae09989-8e9a-43e6-b8b4-ffbab28fafb8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vsdr5\" (UID: \"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.411307 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409814 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cc25\" (UniqueName: \"kubernetes.io/projected/be369c59-0b1a-4743-a91e-6365573fe326-kube-api-access-8cc25\") pod \"node-ca-psqlm\" (UID: \"be369c59-0b1a-4743-a91e-6365573fe326\") " pod="openshift-image-registry/node-ca-psqlm" Jul 28 00:01:10.411307 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409843 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-host-run-netns\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.411307 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409870 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-host-cni-bin\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.411307 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409897 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99d4672b-07d4-467a-a989-1f3e2db65e4a-env-overrides\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.411307 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409924 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-etc-systemd\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.411307 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.410033 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-etc-tuned\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.411307 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.410069 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37a8f118-b676-45df-bb06-468b904da361-system-cni-dir\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.411307 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.410100 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37a8f118-b676-45df-bb06-468b904da361-cni-binary-copy\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.412170 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.410129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/651aa53e-86d5-4e25-8d15-18b49e507a78-cni-binary-copy\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.412170 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.410144 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a267ae2d-361c-4e6b-9c8d-c80fe11793c9-konnectivity-ca\") pod \"konnectivity-agent-qk4l8\" (UID: \"a267ae2d-361c-4e6b-9c8d-c80fe11793c9\") " pod="kube-system/konnectivity-agent-qk4l8" Jul 28 00:01:10.412170 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.410156 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0ae09989-8e9a-43e6-b8b4-ffbab28fafb8-sys-fs\") pod \"aws-ebs-csi-driver-node-vsdr5\" (UID: \"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.412170 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.410187 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs\") pod \"network-metrics-daemon-jqdhz\" (UID: \"ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71\") " pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:10.412170 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.410215 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-etc-openvswitch\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.412170 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.410245 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfk56\" (UniqueName: \"kubernetes.io/projected/651aa53e-86d5-4e25-8d15-18b49e507a78-kube-api-access-nfk56\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.412170 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.410274 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-systemd-units\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.412170 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.410301 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxpns\" (UniqueName: \"kubernetes.io/projected/99d4672b-07d4-467a-a989-1f3e2db65e4a-kube-api-access-hxpns\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.412170 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.410394 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-etc-systemd\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.412170 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.410432 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-host-run-multus-certs\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.412170 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.410470 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-etc-kubernetes\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.412170 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.410546 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-etc-modprobe-d\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.412170 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.410558 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-host-var-lib-cni-bin\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.412170 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.410597 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-host-run-netns\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.412170 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.410743 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-etc-sysctl-conf\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.412170 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.410792 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0ae09989-8e9a-43e6-b8b4-ffbab28fafb8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vsdr5\" (UID: \"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.412170 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.410832 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-host-run-k8s-cni-cncf-io\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.413026 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.409451 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/651aa53e-86d5-4e25-8d15-18b49e507a78-multus-daemon-config\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.413026 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.410902 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37a8f118-b676-45df-bb06-468b904da361-os-release\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.413026 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.411075 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-etc-sysctl-d\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.413026 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.411129 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37a8f118-b676-45df-bb06-468b904da361-system-cni-dir\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.413026 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.411472 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37a8f118-b676-45df-bb06-468b904da361-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.413026 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.411508 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-run\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.413026 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.411589 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37a8f118-b676-45df-bb06-468b904da361-cni-binary-copy\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.413026 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.411746 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0ae09989-8e9a-43e6-b8b4-ffbab28fafb8-sys-fs\") pod \"aws-ebs-csi-driver-node-vsdr5\" (UID: \"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.413026 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.410188 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/651aa53e-86d5-4e25-8d15-18b49e507a78-hostroot\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.413026 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.411868 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37a8f118-b676-45df-bb06-468b904da361-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.413026 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.411871 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0ae09989-8e9a-43e6-b8b4-ffbab28fafb8-socket-dir\") pod \"aws-ebs-csi-driver-node-vsdr5\" (UID: \"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.413026 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.411897 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0ae09989-8e9a-43e6-b8b4-ffbab28fafb8-registration-dir\") pod \"aws-ebs-csi-driver-node-vsdr5\" (UID: \"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.413026 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.411910 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-sys\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.413026 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.412070 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/651aa53e-86d5-4e25-8d15-18b49e507a78-cni-binary-copy\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.413026 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.412626 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-tmp\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.413952 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.413058 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a267ae2d-361c-4e6b-9c8d-c80fe11793c9-agent-certs\") pod \"konnectivity-agent-qk4l8\" (UID: \"a267ae2d-361c-4e6b-9c8d-c80fe11793c9\") " pod="kube-system/konnectivity-agent-qk4l8" Jul 28 00:01:10.416956 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.416932 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-etc-tuned\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.421371 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.421348 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmxm6\" (UniqueName: \"kubernetes.io/projected/37a8f118-b676-45df-bb06-468b904da361-kube-api-access-nmxm6\") pod \"multus-additional-cni-plugins-9vdmc\" (UID: \"37a8f118-b676-45df-bb06-468b904da361\") " pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.422320 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.422287 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx7wv\" (UniqueName: \"kubernetes.io/projected/0ae09989-8e9a-43e6-b8b4-ffbab28fafb8-kube-api-access-qx7wv\") pod \"aws-ebs-csi-driver-node-vsdr5\" (UID: \"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.423952 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.423925 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfk56\" (UniqueName: \"kubernetes.io/projected/651aa53e-86d5-4e25-8d15-18b49e507a78-kube-api-access-nfk56\") pod \"multus-sblhp\" (UID: \"651aa53e-86d5-4e25-8d15-18b49e507a78\") " pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.424644 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.424416 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bwc7\" (UniqueName: \"kubernetes.io/projected/3ec44345-cfc8-4a43-bdf7-0f13b7c9f843-kube-api-access-6bwc7\") pod \"tuned-rlgt4\" (UID: \"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843\") " pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.497845 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.497792 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-108.ec2.internal" event={"ID":"30f65fb00ad2053bc625f5a773e5d6b7","Type":"ContainerStarted","Data":"9a0d9a30d0a8b200aee168efe0cede58b50323c6b91588f2ca4301b3c0d0fbea"} Jul 28 00:01:10.500017 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.499969 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal" event={"ID":"1b1c69b06c584a83e8ec1af8c2a37a7f","Type":"ContainerStarted","Data":"87c284610228609a4ad46308570a671352755488e131c32bc5fbfe095fd173d7"} Jul 28 00:01:10.510658 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.510576 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/35f7c804-20c6-4b56-91bc-e4e9546926f1-hosts-file\") pod \"node-resolver-wj95q\" (UID: \"35f7c804-20c6-4b56-91bc-e4e9546926f1\") " pod="openshift-dns/node-resolver-wj95q" Jul 28 00:01:10.510658 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.510635 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99d4672b-07d4-467a-a989-1f3e2db65e4a-ovn-node-metrics-cert\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.510861 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.510664 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-host-kubelet\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.510861 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.510692 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-var-lib-openvswitch\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.510861 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.510723 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be369c59-0b1a-4743-a91e-6365573fe326-serviceca\") pod \"node-ca-psqlm\" (UID: \"be369c59-0b1a-4743-a91e-6365573fe326\") " pod="openshift-image-registry/node-ca-psqlm" Jul 28 00:01:10.510861 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.510731 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/35f7c804-20c6-4b56-91bc-e4e9546926f1-hosts-file\") pod \"node-resolver-wj95q\" (UID: \"35f7c804-20c6-4b56-91bc-e4e9546926f1\") " pod="openshift-dns/node-resolver-wj95q" Jul 28 00:01:10.510861 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.510747 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-host-slash\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.510861 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.510775 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cc25\" (UniqueName: \"kubernetes.io/projected/be369c59-0b1a-4743-a91e-6365573fe326-kube-api-access-8cc25\") pod \"node-ca-psqlm\" (UID: \"be369c59-0b1a-4743-a91e-6365573fe326\") " pod="openshift-image-registry/node-ca-psqlm" Jul 28 00:01:10.510861 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.510791 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-var-lib-openvswitch\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.510861 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.510800 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-host-run-netns\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.510861 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.510745 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-host-kubelet\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.510861 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.510827 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-host-cni-bin\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.511376 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.510865 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-host-slash\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.511376 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.510878 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-host-cni-bin\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.511376 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.510897 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99d4672b-07d4-467a-a989-1f3e2db65e4a-env-overrides\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.511376 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511064 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-host-run-netns\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.511376 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511109 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs\") pod \"network-metrics-daemon-jqdhz\" (UID: \"ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71\") " pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:10.511376 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511137 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-etc-openvswitch\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.511376 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511169 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-systemd-units\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.511376 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511183 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be369c59-0b1a-4743-a91e-6365573fe326-serviceca\") pod \"node-ca-psqlm\" (UID: \"be369c59-0b1a-4743-a91e-6365573fe326\") " pod="openshift-image-registry/node-ca-psqlm" Jul 28 00:01:10.511376 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511195 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxpns\" (UniqueName: \"kubernetes.io/projected/99d4672b-07d4-467a-a989-1f3e2db65e4a-kube-api-access-hxpns\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.511376 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511241 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret\") pod \"global-pull-secret-syncer-6fn66\" (UID: \"8d81b605-7b6c-4482-bf3c-e9be07ece7a1\") " pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:10.511376 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:10.511253 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:10.511376 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511272 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-host-run-ovn-kubernetes\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.511376 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511305 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-log-socket\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.511376 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:10.511349 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs podName:ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:11.011306583 +0000 UTC m=+3.098318457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs") pod "network-metrics-daemon-jqdhz" (UID: "ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:10.511376 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511349 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-log-socket\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.511376 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511377 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be369c59-0b1a-4743-a91e-6365573fe326-host\") pod \"node-ca-psqlm\" (UID: \"be369c59-0b1a-4743-a91e-6365573fe326\") " pod="openshift-image-registry/node-ca-psqlm" Jul 28 00:01:10.512214 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511385 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99d4672b-07d4-467a-a989-1f3e2db65e4a-env-overrides\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.512214 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511409 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vntdj\" (UniqueName: \"kubernetes.io/projected/35f7c804-20c6-4b56-91bc-e4e9546926f1-kube-api-access-vntdj\") pod \"node-resolver-wj95q\" (UID: \"35f7c804-20c6-4b56-91bc-e4e9546926f1\") " pod="openshift-dns/node-resolver-wj95q" Jul 28 00:01:10.512214 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:10.511417 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:10.512214 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511430 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-etc-openvswitch\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.512214 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:10.511455 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret podName:8d81b605-7b6c-4482-bf3c-e9be07ece7a1 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:11.011442626 +0000 UTC m=+3.098454476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret") pod "global-pull-secret-syncer-6fn66" (UID: "8d81b605-7b6c-4482-bf3c-e9be07ece7a1") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:10.512214 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511464 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-systemd-units\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.512214 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511492 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-host-run-ovn-kubernetes\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.512214 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511450 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-kubelet-config\") pod \"global-pull-secret-syncer-6fn66\" (UID: \"8d81b605-7b6c-4482-bf3c-e9be07ece7a1\") " pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:10.512214 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511532 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9330a140-5213-4bff-9bbd-eab56d087ae6-host-slash\") pod \"iptables-alerter-ttcz2\" (UID: \"9330a140-5213-4bff-9bbd-eab56d087ae6\") " pod="openshift-network-operator/iptables-alerter-ttcz2" Jul 28 00:01:10.512214 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511540 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be369c59-0b1a-4743-a91e-6365573fe326-host\") pod \"node-ca-psqlm\" (UID: \"be369c59-0b1a-4743-a91e-6365573fe326\") " pod="openshift-image-registry/node-ca-psqlm" Jul 28 00:01:10.512214 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511504 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-kubelet-config\") pod \"global-pull-secret-syncer-6fn66\" (UID: \"8d81b605-7b6c-4482-bf3c-e9be07ece7a1\") " pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:10.512214 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511564 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-run-ovn\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.512214 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511587 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9330a140-5213-4bff-9bbd-eab56d087ae6-host-slash\") pod \"iptables-alerter-ttcz2\" (UID: \"9330a140-5213-4bff-9bbd-eab56d087ae6\") " pod="openshift-network-operator/iptables-alerter-ttcz2" Jul 28 00:01:10.512214 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511589 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-node-log\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.512214 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511623 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-node-log\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.512214 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511679 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j8v8\" (UniqueName: \"kubernetes.io/projected/9330a140-5213-4bff-9bbd-eab56d087ae6-kube-api-access-8j8v8\") pod \"iptables-alerter-ttcz2\" (UID: \"9330a140-5213-4bff-9bbd-eab56d087ae6\") " pod="openshift-network-operator/iptables-alerter-ttcz2" Jul 28 00:01:10.512214 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511693 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-run-ovn\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.513136 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511710 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.513136 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511747 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99d4672b-07d4-467a-a989-1f3e2db65e4a-ovnkube-config\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.513136 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511777 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35f7c804-20c6-4b56-91bc-e4e9546926f1-tmp-dir\") pod \"node-resolver-wj95q\" (UID: \"35f7c804-20c6-4b56-91bc-e4e9546926f1\") " pod="openshift-dns/node-resolver-wj95q" Jul 28 00:01:10.513136 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511802 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-host-cni-netd\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.513136 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511809 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.513136 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511827 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-dbus\") pod \"global-pull-secret-syncer-6fn66\" (UID: \"8d81b605-7b6c-4482-bf3c-e9be07ece7a1\") " pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:10.513136 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511853 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-run-systemd\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.513136 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511879 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99d4672b-07d4-467a-a989-1f3e2db65e4a-ovnkube-script-lib\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.513136 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511914 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzltj\" (UniqueName: \"kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj\") pod \"network-check-target-n4nkt\" (UID: \"898d09b0-dd59-4773-a4a2-74618b9015d9\") " pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:10.513136 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511941 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8b5d\" (UniqueName: \"kubernetes.io/projected/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-kube-api-access-v8b5d\") pod \"network-metrics-daemon-jqdhz\" (UID: \"ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71\") " pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:10.513136 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.511966 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9330a140-5213-4bff-9bbd-eab56d087ae6-iptables-alerter-script\") pod \"iptables-alerter-ttcz2\" (UID: \"9330a140-5213-4bff-9bbd-eab56d087ae6\") " pod="openshift-network-operator/iptables-alerter-ttcz2" Jul 28 00:01:10.513136 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.512006 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-run-openvswitch\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.513136 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.512080 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-run-openvswitch\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.513136 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.512103 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35f7c804-20c6-4b56-91bc-e4e9546926f1-tmp-dir\") pod \"node-resolver-wj95q\" (UID: \"35f7c804-20c6-4b56-91bc-e4e9546926f1\") " pod="openshift-dns/node-resolver-wj95q" Jul 28 00:01:10.513136 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.512224 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-dbus\") pod \"global-pull-secret-syncer-6fn66\" (UID: \"8d81b605-7b6c-4482-bf3c-e9be07ece7a1\") " pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:10.513136 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.512280 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-run-systemd\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.513136 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.512306 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99d4672b-07d4-467a-a989-1f3e2db65e4a-ovnkube-config\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.514010 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.512441 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99d4672b-07d4-467a-a989-1f3e2db65e4a-host-cni-netd\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.514010 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.512525 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9330a140-5213-4bff-9bbd-eab56d087ae6-iptables-alerter-script\") pod \"iptables-alerter-ttcz2\" (UID: \"9330a140-5213-4bff-9bbd-eab56d087ae6\") " pod="openshift-network-operator/iptables-alerter-ttcz2" Jul 28 00:01:10.514010 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.512812 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99d4672b-07d4-467a-a989-1f3e2db65e4a-ovnkube-script-lib\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.514010 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.513928 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99d4672b-07d4-467a-a989-1f3e2db65e4a-ovn-node-metrics-cert\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.521395 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:10.521265 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:10.521395 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:10.521290 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:10.521395 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:10.521304 2562 projected.go:196] Error preparing data for projected volume kube-api-access-kzltj for pod openshift-network-diagnostics/network-check-target-n4nkt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:10.521395 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:10.521370 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj podName:898d09b0-dd59-4773-a4a2-74618b9015d9 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:11.021353103 +0000 UTC m=+3.108364973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kzltj" (UniqueName: "kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj") pod "network-check-target-n4nkt" (UID: "898d09b0-dd59-4773-a4a2-74618b9015d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:10.522916 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.522891 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxpns\" (UniqueName: \"kubernetes.io/projected/99d4672b-07d4-467a-a989-1f3e2db65e4a-kube-api-access-hxpns\") pod \"ovnkube-node-tvrbh\" (UID: \"99d4672b-07d4-467a-a989-1f3e2db65e4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.523210 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.523185 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vntdj\" (UniqueName: \"kubernetes.io/projected/35f7c804-20c6-4b56-91bc-e4e9546926f1-kube-api-access-vntdj\") pod \"node-resolver-wj95q\" (UID: \"35f7c804-20c6-4b56-91bc-e4e9546926f1\") " pod="openshift-dns/node-resolver-wj95q" Jul 28 00:01:10.524924 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.524816 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j8v8\" (UniqueName: \"kubernetes.io/projected/9330a140-5213-4bff-9bbd-eab56d087ae6-kube-api-access-8j8v8\") pod \"iptables-alerter-ttcz2\" (UID: \"9330a140-5213-4bff-9bbd-eab56d087ae6\") " pod="openshift-network-operator/iptables-alerter-ttcz2" Jul 28 00:01:10.525060 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.525037 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cc25\" (UniqueName: \"kubernetes.io/projected/be369c59-0b1a-4743-a91e-6365573fe326-kube-api-access-8cc25\") pod \"node-ca-psqlm\" (UID: \"be369c59-0b1a-4743-a91e-6365573fe326\") " pod="openshift-image-registry/node-ca-psqlm" Jul 28 00:01:10.525417 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.525392 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8b5d\" (UniqueName: \"kubernetes.io/projected/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-kube-api-access-v8b5d\") pod \"network-metrics-daemon-jqdhz\" (UID: \"ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71\") " pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:10.600331 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.600307 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9vdmc" Jul 28 00:01:10.617738 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.617708 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sblhp" Jul 28 00:01:10.626755 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.626731 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ttcz2" Jul 28 00:01:10.634736 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.634713 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qk4l8" Jul 28 00:01:10.642687 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.642668 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" Jul 28 00:01:10.651672 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.651651 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" Jul 28 00:01:10.660719 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.660702 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wj95q" Jul 28 00:01:10.668867 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.668842 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:10.673557 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:10.673533 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-psqlm" Jul 28 00:01:11.015004 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:11.014967 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs\") pod \"network-metrics-daemon-jqdhz\" (UID: \"ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71\") " pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:11.015170 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:11.015011 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret\") pod \"global-pull-secret-syncer-6fn66\" (UID: \"8d81b605-7b6c-4482-bf3c-e9be07ece7a1\") " pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:11.015170 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:11.015131 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:11.015170 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:11.015132 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:11.015354 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:11.015197 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret podName:8d81b605-7b6c-4482-bf3c-e9be07ece7a1 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:12.015179142 +0000 UTC m=+4.102191009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret") pod "global-pull-secret-syncer-6fn66" (UID: "8d81b605-7b6c-4482-bf3c-e9be07ece7a1") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:11.015354 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:11.015218 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs podName:ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:12.015208499 +0000 UTC m=+4.102220347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs") pod "network-metrics-daemon-jqdhz" (UID: "ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:11.115974 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:11.115943 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzltj\" (UniqueName: \"kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj\") pod \"network-check-target-n4nkt\" (UID: \"898d09b0-dd59-4773-a4a2-74618b9015d9\") " pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:11.116150 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:11.116091 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:11.116150 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:11.116115 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:11.116150 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:11.116127 2562 projected.go:196] Error preparing data for projected volume kube-api-access-kzltj for pod openshift-network-diagnostics/network-check-target-n4nkt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:11.116314 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:11.116190 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj podName:898d09b0-dd59-4773-a4a2-74618b9015d9 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:12.116170649 +0000 UTC m=+4.203182520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzltj" (UniqueName: "kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj") pod "network-check-target-n4nkt" (UID: "898d09b0-dd59-4773-a4a2-74618b9015d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:11.338870 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:11.338776 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 23:56:10 +0000 UTC" deadline="2028-03-08 17:26:34.241346719 +0000 UTC" Jul 28 00:01:11.338870 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:11.338814 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14153h25m22.902537808s" Jul 28 00:01:11.492940 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:11.492907 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:11.492940 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:11.492944 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:11.493186 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:11.493028 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4nkt" podUID="898d09b0-dd59-4773-a4a2-74618b9015d9" Jul 28 00:01:11.493186 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:11.493154 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fn66" podUID="8d81b605-7b6c-4482-bf3c-e9be07ece7a1" Jul 28 00:01:11.685132 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:11.685101 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37a8f118_b676_45df_bb06_468b904da361.slice/crio-4bf9f1052cf28fc6fbeb70225e796e05db687f485d254a6df5baa15c0eb2f1a7 WatchSource:0}: Error finding container 4bf9f1052cf28fc6fbeb70225e796e05db687f485d254a6df5baa15c0eb2f1a7: Status 404 returned error can't find the container with id 4bf9f1052cf28fc6fbeb70225e796e05db687f485d254a6df5baa15c0eb2f1a7 Jul 28 00:01:11.687667 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:11.687624 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99d4672b_07d4_467a_a989_1f3e2db65e4a.slice/crio-18e56fa4a46edd465cc5f15caba8ecd0d4c994bf18fc244d2f4d69909caa4e62 WatchSource:0}: Error finding container 18e56fa4a46edd465cc5f15caba8ecd0d4c994bf18fc244d2f4d69909caa4e62: Status 404 returned error can't find the container with id 18e56fa4a46edd465cc5f15caba8ecd0d4c994bf18fc244d2f4d69909caa4e62 Jul 28 00:01:11.691878 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:11.691858 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod651aa53e_86d5_4e25_8d15_18b49e507a78.slice/crio-5d50558453d1875b69169e1839d56988b4e16b67988a38bf7d25c40a49592816 WatchSource:0}: Error finding container 5d50558453d1875b69169e1839d56988b4e16b67988a38bf7d25c40a49592816: Status 404 returned error can't find the container with id 5d50558453d1875b69169e1839d56988b4e16b67988a38bf7d25c40a49592816 Jul 28 00:01:11.693209 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:11.693179 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35f7c804_20c6_4b56_91bc_e4e9546926f1.slice/crio-ea503a275295ca8ae2d0f49020a84d37ae20abf576cf1aad4573bf6da63b67cd WatchSource:0}: Error finding container ea503a275295ca8ae2d0f49020a84d37ae20abf576cf1aad4573bf6da63b67cd: Status 404 returned error can't find the container with id ea503a275295ca8ae2d0f49020a84d37ae20abf576cf1aad4573bf6da63b67cd Jul 28 00:01:11.694569 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:11.694544 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ec44345_cfc8_4a43_bdf7_0f13b7c9f843.slice/crio-6f2109a12def38442b4c4d49a347f4b2cdd970ec80f55389fdc8593ef1dc9e40 WatchSource:0}: Error finding container 6f2109a12def38442b4c4d49a347f4b2cdd970ec80f55389fdc8593ef1dc9e40: Status 404 returned error can't find the container with id 6f2109a12def38442b4c4d49a347f4b2cdd970ec80f55389fdc8593ef1dc9e40 Jul 28 00:01:11.697862 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:11.697792 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ae09989_8e9a_43e6_b8b4_ffbab28fafb8.slice/crio-8d7f0500fb062f767c7ad1986ea90117dcfd97a81998594ee6c25f6b4d386998 WatchSource:0}: Error finding container 8d7f0500fb062f767c7ad1986ea90117dcfd97a81998594ee6c25f6b4d386998: Status 404 returned error can't find the container with id 8d7f0500fb062f767c7ad1986ea90117dcfd97a81998594ee6c25f6b4d386998 Jul 28 00:01:11.699344 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:11.699318 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9330a140_5213_4bff_9bbd_eab56d087ae6.slice/crio-6b29d66e1a50a024e0c16be351e2acafe165cfbc9b30938f4816bf8312f53e18 WatchSource:0}: Error finding container 6b29d66e1a50a024e0c16be351e2acafe165cfbc9b30938f4816bf8312f53e18: Status 404 returned error can't find the container with id 6b29d66e1a50a024e0c16be351e2acafe165cfbc9b30938f4816bf8312f53e18 Jul 28 00:01:11.701376 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:11.701248 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda267ae2d_361c_4e6b_9c8d_c80fe11793c9.slice/crio-704710a767772553989591948ab35c81f6c579977412f5c39ff27fc28ef15de5 WatchSource:0}: Error finding container 704710a767772553989591948ab35c81f6c579977412f5c39ff27fc28ef15de5: Status 404 returned error can't find the container with id 704710a767772553989591948ab35c81f6c579977412f5c39ff27fc28ef15de5 Jul 28 00:01:11.702935 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:11.702843 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe369c59_0b1a_4743_a91e_6365573fe326.slice/crio-ca7172d1000460845fb9a059a701a268f18585cc3e0355a6f15c093b43eb2a9c WatchSource:0}: Error finding container ca7172d1000460845fb9a059a701a268f18585cc3e0355a6f15c093b43eb2a9c: Status 404 returned error can't find the container with id ca7172d1000460845fb9a059a701a268f18585cc3e0355a6f15c093b43eb2a9c Jul 28 00:01:12.024046 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:12.024012 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs\") pod \"network-metrics-daemon-jqdhz\" (UID: \"ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71\") " pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:12.024160 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:12.024062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret\") pod \"global-pull-secret-syncer-6fn66\" (UID: \"8d81b605-7b6c-4482-bf3c-e9be07ece7a1\") " pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:12.024160 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:12.024151 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:12.024276 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:12.024203 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:12.024276 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:12.024213 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs podName:ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:14.024196023 +0000 UTC m=+6.111207874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs") pod "network-metrics-daemon-jqdhz" (UID: "ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:12.024276 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:12.024256 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret podName:8d81b605-7b6c-4482-bf3c-e9be07ece7a1 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:14.024239446 +0000 UTC m=+6.111251319 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret") pod "global-pull-secret-syncer-6fn66" (UID: "8d81b605-7b6c-4482-bf3c-e9be07ece7a1") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:12.125024 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:12.124999 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzltj\" (UniqueName: \"kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj\") pod \"network-check-target-n4nkt\" (UID: \"898d09b0-dd59-4773-a4a2-74618b9015d9\") " pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:12.125156 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:12.125139 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:12.125248 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:12.125166 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:12.125248 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:12.125178 2562 projected.go:196] Error preparing data for projected volume kube-api-access-kzltj for pod openshift-network-diagnostics/network-check-target-n4nkt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:12.125248 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:12.125226 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj podName:898d09b0-dd59-4773-a4a2-74618b9015d9 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:14.125211358 +0000 UTC m=+6.212223206 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzltj" (UniqueName: "kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj") pod "network-check-target-n4nkt" (UID: "898d09b0-dd59-4773-a4a2-74618b9015d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:12.339469 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:12.339403 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 23:56:10 +0000 UTC" deadline="2028-01-24 23:36:32.163867437 +0000 UTC" Jul 28 00:01:12.339469 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:12.339466 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13103h35m19.824405344s" Jul 28 00:01:12.495638 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:12.495529 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:12.495790 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:12.495699 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqdhz" podUID="ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71" Jul 28 00:01:12.513356 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:12.513320 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" event={"ID":"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843","Type":"ContainerStarted","Data":"6f2109a12def38442b4c4d49a347f4b2cdd970ec80f55389fdc8593ef1dc9e40"} Jul 28 00:01:12.519858 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:12.519796 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wj95q" event={"ID":"35f7c804-20c6-4b56-91bc-e4e9546926f1","Type":"ContainerStarted","Data":"ea503a275295ca8ae2d0f49020a84d37ae20abf576cf1aad4573bf6da63b67cd"} Jul 28 00:01:12.523701 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:12.523428 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-108.ec2.internal" event={"ID":"30f65fb00ad2053bc625f5a773e5d6b7","Type":"ContainerStarted","Data":"7899be2c7a30d34e109b223f54000e656bf466c09e82d9b39c53e114cc4c650a"} Jul 28 00:01:12.530773 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:12.530712 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-psqlm" event={"ID":"be369c59-0b1a-4743-a91e-6365573fe326","Type":"ContainerStarted","Data":"ca7172d1000460845fb9a059a701a268f18585cc3e0355a6f15c093b43eb2a9c"} Jul 28 00:01:12.533685 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:12.533632 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" event={"ID":"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8","Type":"ContainerStarted","Data":"8d7f0500fb062f767c7ad1986ea90117dcfd97a81998594ee6c25f6b4d386998"} Jul 28 00:01:12.536990 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:12.536914 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sblhp" event={"ID":"651aa53e-86d5-4e25-8d15-18b49e507a78","Type":"ContainerStarted","Data":"5d50558453d1875b69169e1839d56988b4e16b67988a38bf7d25c40a49592816"} Jul 28 00:01:12.542307 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:12.542197 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" event={"ID":"99d4672b-07d4-467a-a989-1f3e2db65e4a","Type":"ContainerStarted","Data":"18e56fa4a46edd465cc5f15caba8ecd0d4c994bf18fc244d2f4d69909caa4e62"} Jul 28 00:01:12.551899 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:12.551818 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vdmc" event={"ID":"37a8f118-b676-45df-bb06-468b904da361","Type":"ContainerStarted","Data":"4bf9f1052cf28fc6fbeb70225e796e05db687f485d254a6df5baa15c0eb2f1a7"} Jul 28 00:01:12.564919 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:12.564856 2562 generic.go:356] "Generic (PLEG): container finished" podID="1b1c69b06c584a83e8ec1af8c2a37a7f" containerID="2acd44dea8db1e9b611bcd988b10dd9449e8250e0db7378032067ec120ed3fb0" exitCode=0 Jul 28 00:01:12.565301 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:12.565129 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal" event={"ID":"1b1c69b06c584a83e8ec1af8c2a37a7f","Type":"ContainerDied","Data":"2acd44dea8db1e9b611bcd988b10dd9449e8250e0db7378032067ec120ed3fb0"} Jul 28 00:01:12.580460 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:12.580398 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-108.ec2.internal" podStartSLOduration=2.580380484 podStartE2EDuration="2.580380484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:12.540643587 +0000 UTC m=+4.627655462" watchObservedRunningTime="2026-07-28 00:01:12.580380484 +0000 UTC m=+4.667392356" Jul 28 00:01:12.584868 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:12.584841 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qk4l8" event={"ID":"a267ae2d-361c-4e6b-9c8d-c80fe11793c9","Type":"ContainerStarted","Data":"704710a767772553989591948ab35c81f6c579977412f5c39ff27fc28ef15de5"} Jul 28 00:01:12.587597 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:12.587530 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ttcz2" event={"ID":"9330a140-5213-4bff-9bbd-eab56d087ae6","Type":"ContainerStarted","Data":"6b29d66e1a50a024e0c16be351e2acafe165cfbc9b30938f4816bf8312f53e18"} Jul 28 00:01:13.494099 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:13.493350 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:13.494099 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:13.493496 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4nkt" podUID="898d09b0-dd59-4773-a4a2-74618b9015d9" Jul 28 00:01:13.494099 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:13.493895 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:13.494099 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:13.493993 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fn66" podUID="8d81b605-7b6c-4482-bf3c-e9be07ece7a1" Jul 28 00:01:13.610621 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:13.610533 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal" event={"ID":"1b1c69b06c584a83e8ec1af8c2a37a7f","Type":"ContainerStarted","Data":"ee027a1c318f36ec73ec1bb4a4c6c842ed7b06d2230e18585eb4f37e4326acdf"} Jul 28 00:01:14.041003 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:14.040730 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs\") pod \"network-metrics-daemon-jqdhz\" (UID: \"ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71\") " pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:14.041003 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:14.040778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret\") pod \"global-pull-secret-syncer-6fn66\" (UID: \"8d81b605-7b6c-4482-bf3c-e9be07ece7a1\") " pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:14.041003 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:14.040871 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:14.041003 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:14.040921 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:14.041003 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:14.040932 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs podName:ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:18.04091279 +0000 UTC m=+10.127924639 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs") pod "network-metrics-daemon-jqdhz" (UID: "ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:14.041003 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:14.040970 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret podName:8d81b605-7b6c-4482-bf3c-e9be07ece7a1 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:18.040954475 +0000 UTC m=+10.127966323 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret") pod "global-pull-secret-syncer-6fn66" (UID: "8d81b605-7b6c-4482-bf3c-e9be07ece7a1") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:14.142241 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:14.142141 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzltj\" (UniqueName: \"kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj\") pod \"network-check-target-n4nkt\" (UID: \"898d09b0-dd59-4773-a4a2-74618b9015d9\") " pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:14.142411 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:14.142320 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:14.142411 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:14.142347 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:14.142411 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:14.142360 2562 projected.go:196] Error preparing data for projected volume kube-api-access-kzltj for pod openshift-network-diagnostics/network-check-target-n4nkt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:14.142627 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:14.142423 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj podName:898d09b0-dd59-4773-a4a2-74618b9015d9 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:18.142403489 +0000 UTC m=+10.229415337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzltj" (UniqueName: "kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj") pod "network-check-target-n4nkt" (UID: "898d09b0-dd59-4773-a4a2-74618b9015d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:14.495538 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:14.495509 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:14.495979 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:14.495664 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqdhz" podUID="ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71" Jul 28 00:01:15.493530 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:15.493491 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:15.493736 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:15.493630 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4nkt" podUID="898d09b0-dd59-4773-a4a2-74618b9015d9" Jul 28 00:01:15.494078 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:15.494059 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:15.494175 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:15.494156 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fn66" podUID="8d81b605-7b6c-4482-bf3c-e9be07ece7a1" Jul 28 00:01:16.493832 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:16.493764 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:16.494234 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:16.493916 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqdhz" podUID="ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71" Jul 28 00:01:17.493543 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:17.493507 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:17.493739 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:17.493648 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4nkt" podUID="898d09b0-dd59-4773-a4a2-74618b9015d9" Jul 28 00:01:17.493976 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:17.493956 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:17.494290 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:17.494031 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fn66" podUID="8d81b605-7b6c-4482-bf3c-e9be07ece7a1" Jul 28 00:01:18.074721 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:18.074685 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs\") pod \"network-metrics-daemon-jqdhz\" (UID: \"ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71\") " pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:18.074869 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:18.074738 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret\") pod \"global-pull-secret-syncer-6fn66\" (UID: \"8d81b605-7b6c-4482-bf3c-e9be07ece7a1\") " pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:18.074907 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:18.074899 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:18.074956 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:18.074945 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret podName:8d81b605-7b6c-4482-bf3c-e9be07ece7a1 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:26.074931205 +0000 UTC m=+18.161943053 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret") pod "global-pull-secret-syncer-6fn66" (UID: "8d81b605-7b6c-4482-bf3c-e9be07ece7a1") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:18.075003 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:18.074994 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:18.075039 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:18.075018 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs podName:ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:26.075011584 +0000 UTC m=+18.162023430 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs") pod "network-metrics-daemon-jqdhz" (UID: "ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:18.175799 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:18.175760 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzltj\" (UniqueName: \"kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj\") pod \"network-check-target-n4nkt\" (UID: \"898d09b0-dd59-4773-a4a2-74618b9015d9\") " pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:18.175951 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:18.175922 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:18.175951 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:18.175945 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:18.176045 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:18.175959 2562 projected.go:196] Error preparing data for projected volume kube-api-access-kzltj for pod openshift-network-diagnostics/network-check-target-n4nkt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:18.176045 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:18.176011 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj podName:898d09b0-dd59-4773-a4a2-74618b9015d9 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:26.175992129 +0000 UTC m=+18.263003991 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzltj" (UniqueName: "kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj") pod "network-check-target-n4nkt" (UID: "898d09b0-dd59-4773-a4a2-74618b9015d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:18.493788 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:18.493717 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:18.493935 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:18.493818 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqdhz" podUID="ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71" Jul 28 00:01:19.493760 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:19.493731 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:19.494213 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:19.493836 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fn66" podUID="8d81b605-7b6c-4482-bf3c-e9be07ece7a1" Jul 28 00:01:19.494213 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:19.494166 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:19.494339 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:19.494241 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4nkt" podUID="898d09b0-dd59-4773-a4a2-74618b9015d9" Jul 28 00:01:20.495218 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:20.495183 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:20.495704 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:20.495287 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqdhz" podUID="ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71" Jul 28 00:01:21.493397 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:21.493368 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:21.493547 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:21.493368 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:21.493547 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:21.493468 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fn66" podUID="8d81b605-7b6c-4482-bf3c-e9be07ece7a1" Jul 28 00:01:21.493547 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:21.493539 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4nkt" podUID="898d09b0-dd59-4773-a4a2-74618b9015d9" Jul 28 00:01:22.493241 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:22.493211 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:22.493610 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:22.493353 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqdhz" podUID="ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71" Jul 28 00:01:23.492886 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:23.492856 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:23.493037 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:23.492947 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4nkt" podUID="898d09b0-dd59-4773-a4a2-74618b9015d9" Jul 28 00:01:23.493260 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:23.493246 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:23.493540 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:23.493313 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fn66" podUID="8d81b605-7b6c-4482-bf3c-e9be07ece7a1" Jul 28 00:01:24.493615 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:24.493567 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:24.494024 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:24.493727 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqdhz" podUID="ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71" Jul 28 00:01:25.494021 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:25.493707 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:25.494021 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:25.493827 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4nkt" podUID="898d09b0-dd59-4773-a4a2-74618b9015d9" Jul 28 00:01:25.494021 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:25.493886 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:25.494021 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:25.493999 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fn66" podUID="8d81b605-7b6c-4482-bf3c-e9be07ece7a1" Jul 28 00:01:26.134895 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:26.134859 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs\") pod \"network-metrics-daemon-jqdhz\" (UID: \"ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71\") " pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:26.134895 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:26.134902 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret\") pod \"global-pull-secret-syncer-6fn66\" (UID: \"8d81b605-7b6c-4482-bf3c-e9be07ece7a1\") " pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:26.135113 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:26.134974 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:26.135113 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:26.134996 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:26.135113 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:26.135031 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs podName:ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:42.135015513 +0000 UTC m=+34.222027360 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs") pod "network-metrics-daemon-jqdhz" (UID: "ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:26.135113 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:26.135045 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret podName:8d81b605-7b6c-4482-bf3c-e9be07ece7a1 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:42.135038762 +0000 UTC m=+34.222050609 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret") pod "global-pull-secret-syncer-6fn66" (UID: "8d81b605-7b6c-4482-bf3c-e9be07ece7a1") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:26.236095 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:26.236055 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzltj\" (UniqueName: \"kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj\") pod \"network-check-target-n4nkt\" (UID: \"898d09b0-dd59-4773-a4a2-74618b9015d9\") " pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:26.236238 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:26.236181 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:26.236238 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:26.236196 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:26.236238 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:26.236205 2562 projected.go:196] Error preparing data for projected volume kube-api-access-kzltj for pod openshift-network-diagnostics/network-check-target-n4nkt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:26.236368 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:26.236249 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj podName:898d09b0-dd59-4773-a4a2-74618b9015d9 nodeName:}" failed. No retries permitted until 2026-07-28 00:01:42.236237614 +0000 UTC m=+34.323249461 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzltj" (UniqueName: "kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj") pod "network-check-target-n4nkt" (UID: "898d09b0-dd59-4773-a4a2-74618b9015d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:26.493408 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:26.493351 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:26.493530 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:26.493504 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqdhz" podUID="ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71" Jul 28 00:01:27.493822 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:27.493789 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:27.493822 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:27.493809 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:27.494281 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:27.493897 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4nkt" podUID="898d09b0-dd59-4773-a4a2-74618b9015d9" Jul 28 00:01:27.494281 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:27.494030 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fn66" podUID="8d81b605-7b6c-4482-bf3c-e9be07ece7a1" Jul 28 00:01:28.494194 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:28.494157 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:28.494628 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:28.494284 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqdhz" podUID="ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71" Jul 28 00:01:29.492816 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:29.492784 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:29.492816 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:29.492795 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:29.493044 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:29.492954 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4nkt" podUID="898d09b0-dd59-4773-a4a2-74618b9015d9" Jul 28 00:01:29.493044 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:29.492965 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fn66" podUID="8d81b605-7b6c-4482-bf3c-e9be07ece7a1" Jul 28 00:01:30.494091 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:30.493524 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:30.494091 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:30.493773 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqdhz" podUID="ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71" Jul 28 00:01:30.651009 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:30.650845 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qk4l8" event={"ID":"a267ae2d-361c-4e6b-9c8d-c80fe11793c9","Type":"ContainerStarted","Data":"934eb4e7589395ddb7e9b7d4fb10b48b9778d17cd954481aa841f56a711956a9"} Jul 28 00:01:30.652949 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:30.652927 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" event={"ID":"3ec44345-cfc8-4a43-bdf7-0f13b7c9f843","Type":"ContainerStarted","Data":"25898baa62352c3fdc4cb459341b3c5cad02c73bb7b922b44f4aebc7e138b17a"} Jul 28 00:01:30.654682 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:30.654657 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wj95q" event={"ID":"35f7c804-20c6-4b56-91bc-e4e9546926f1","Type":"ContainerStarted","Data":"f8aeb1470f952751a08e1fa625e4907092b27de431700b40c0dc674ff81dc204"} Jul 28 00:01:30.656290 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:30.656261 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-psqlm" event={"ID":"be369c59-0b1a-4743-a91e-6365573fe326","Type":"ContainerStarted","Data":"c88078fd8d7391079350c220838ccbd02a930ef929aa98fceecd6977c42c104b"} Jul 28 00:01:30.659890 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:30.659865 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" event={"ID":"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8","Type":"ContainerStarted","Data":"e771fe3bd8f6bdb8a58f1b2c3f1e8b3c2b2dd447f57941f9fb8db447127f14d3"} Jul 28 00:01:30.661828 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:30.661807 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sblhp" event={"ID":"651aa53e-86d5-4e25-8d15-18b49e507a78","Type":"ContainerStarted","Data":"1346b0885ffb7fe807f3133723126f716d4c034abcb3b65fe4fb41622142c0cb"} Jul 28 00:01:30.664011 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:30.663992 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" event={"ID":"99d4672b-07d4-467a-a989-1f3e2db65e4a","Type":"ContainerStarted","Data":"4cb173208431875a40510df90edd1cbdd4ff040ac5fb9a51b69b8450d26de984"} Jul 28 00:01:30.664088 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:30.664064 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" event={"ID":"99d4672b-07d4-467a-a989-1f3e2db65e4a","Type":"ContainerStarted","Data":"588eb45315f49bb740e567e6ce849052ca42deb1d798b842331e1dc971819d8d"} Jul 28 00:01:30.665614 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:30.665594 2562 generic.go:356] "Generic (PLEG): container finished" podID="37a8f118-b676-45df-bb06-468b904da361" containerID="31e380eaee2811a78fd788aa26f7342d69793e8fc554b83c48e1d6341ded7cbe" exitCode=0 Jul 28 00:01:30.665694 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:30.665627 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vdmc" event={"ID":"37a8f118-b676-45df-bb06-468b904da361","Type":"ContainerDied","Data":"31e380eaee2811a78fd788aa26f7342d69793e8fc554b83c48e1d6341ded7cbe"} Jul 28 00:01:30.665937 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:30.665889 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal" podStartSLOduration=20.665871708 podStartE2EDuration="20.665871708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:13.647007515 +0000 UTC m=+5.734019387" watchObservedRunningTime="2026-07-28 00:01:30.665871708 +0000 UTC m=+22.752883580" Jul 28 00:01:30.666608 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:30.666374 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qk4l8" podStartSLOduration=3.995318295 podStartE2EDuration="22.666360143s" totalImagesPullingTime="18.671041848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:30.665816057 +0000 UTC m=+22.752827927" watchObservedRunningTime="2026-07-28 00:01:30.666360143 +0000 UTC m=+22.753372013" Jul 28 00:01:30.684449 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:30.684412 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rlgt4" podStartSLOduration=4.00761045 podStartE2EDuration="22.684398561s" totalImagesPullingTime="18.676788111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:30.68411842 +0000 UTC m=+22.771130288" watchObservedRunningTime="2026-07-28 00:01:30.684398561 +0000 UTC m=+22.771410427" Jul 28 00:01:30.710963 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:30.710913 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wj95q" podStartSLOduration=4.011148549 podStartE2EDuration="22.710893002s" totalImagesPullingTime="18.699744453s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:30.698395169 +0000 UTC m=+22.785407061" watchObservedRunningTime="2026-07-28 00:01:30.710893002 +0000 UTC m=+22.797904875" Jul 28 00:01:30.711291 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:30.711257 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-psqlm" podStartSLOduration=4.036956535 podStartE2EDuration="22.711249868s" totalImagesPullingTime="18.674293333s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:30.711032176 +0000 UTC m=+22.798044027" watchObservedRunningTime="2026-07-28 00:01:30.711249868 +0000 UTC m=+22.798261738" Jul 28 00:01:30.749850 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:30.749812 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sblhp" podStartSLOduration=4.019630934 podStartE2EDuration="22.749797864s" totalImagesPullingTime="18.73016693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:30.749662801 +0000 UTC m=+22.836674669" watchObservedRunningTime="2026-07-28 00:01:30.749797864 +0000 UTC m=+22.836809733" Jul 28 00:01:31.493614 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:31.493595 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:31.493614 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:31.493607 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:31.493780 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:31.493693 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fn66" podUID="8d81b605-7b6c-4482-bf3c-e9be07ece7a1" Jul 28 00:01:31.493815 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:31.493796 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4nkt" podUID="898d09b0-dd59-4773-a4a2-74618b9015d9" Jul 28 00:01:31.668847 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:31.668784 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ttcz2" event={"ID":"9330a140-5213-4bff-9bbd-eab56d087ae6","Type":"ContainerStarted","Data":"82601cc791dc57dca27aa6230f79fa703fd1edf32ff2490e2513984ca55fe7af"} Jul 28 00:01:31.671640 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:31.671614 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" event={"ID":"99d4672b-07d4-467a-a989-1f3e2db65e4a","Type":"ContainerStarted","Data":"82478acd3af93bb00856cd2b15895403fe04fb32677ac702ee6be98b06d682b9"} Jul 28 00:01:31.671778 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:31.671679 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" event={"ID":"99d4672b-07d4-467a-a989-1f3e2db65e4a","Type":"ContainerStarted","Data":"9744b00c6a57c5a83e02d8e0a907bf794c66db6917688aec2ba40a4d2148c0b5"} Jul 28 00:01:31.671778 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:31.671716 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" event={"ID":"99d4672b-07d4-467a-a989-1f3e2db65e4a","Type":"ContainerStarted","Data":"513be71034634f3f76b504986c5a9832e4cbc48c6257e7222d8d0d72703d8634"} Jul 28 00:01:31.672047 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:31.672023 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" event={"ID":"99d4672b-07d4-467a-a989-1f3e2db65e4a","Type":"ContainerStarted","Data":"42bb8f9f144d928f2beb86145f342c1fdd380f4c7343badf3691a341c404d31f"} Jul 28 00:01:31.687689 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:31.687651 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ttcz2" podStartSLOduration=5.013752042 podStartE2EDuration="23.687639333s" totalImagesPullingTime="18.673887291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:31.687149407 +0000 UTC m=+23.774161275" watchObservedRunningTime="2026-07-28 00:01:31.687639333 +0000 UTC m=+23.774651202" Jul 28 00:01:32.493437 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:32.493299 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:32.493764 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:32.493736 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqdhz" podUID="ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71" Jul 28 00:01:32.687716 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:32.687412 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 00:01:32.845420 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:32.845394 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qk4l8" Jul 28 00:01:32.846038 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:32.846022 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qk4l8" Jul 28 00:01:33.379742 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:33.379604 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T00:01:32.68743062Z","UUID":"b88cf56c-0f88-4a56-b6ef-2b08ad8bb3a0","Handler":null,"Name":"","Endpoint":""} Jul 28 00:01:33.381258 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:33.381239 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 00:01:33.381389 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:33.381278 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 00:01:33.493746 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:33.493722 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:33.493896 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:33.493831 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:33.493964 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:33.493916 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4nkt" podUID="898d09b0-dd59-4773-a4a2-74618b9015d9" Jul 28 00:01:33.493964 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:33.493923 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fn66" podUID="8d81b605-7b6c-4482-bf3c-e9be07ece7a1" Jul 28 00:01:33.682165 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:33.682056 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" event={"ID":"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8","Type":"ContainerStarted","Data":"cb4cdf5bb37200b843866e94204936f4f59315aeb419aaeac1b1b518c5e71ab7"} Jul 28 00:01:33.686791 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:33.686759 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" event={"ID":"99d4672b-07d4-467a-a989-1f3e2db65e4a","Type":"ContainerStarted","Data":"c292c3d3a5a219950e49f5c98401e1d43408c73d54196ab016b426d7d5317e09"} Jul 28 00:01:33.687027 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:33.687007 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qk4l8" Jul 28 00:01:33.687496 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:33.687478 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qk4l8" Jul 28 00:01:34.493755 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:34.493722 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:34.494193 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:34.493865 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqdhz" podUID="ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71" Jul 28 00:01:35.493228 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:35.493155 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:35.493385 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:35.493161 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:35.493385 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:35.493279 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fn66" podUID="8d81b605-7b6c-4482-bf3c-e9be07ece7a1" Jul 28 00:01:35.493385 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:35.493322 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4nkt" podUID="898d09b0-dd59-4773-a4a2-74618b9015d9" Jul 28 00:01:35.693276 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:35.693130 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" event={"ID":"0ae09989-8e9a-43e6-b8b4-ffbab28fafb8","Type":"ContainerStarted","Data":"338e25ec2bea9a8573f978cbe653dcf22118d01d53fe3a5df91b36e0d47e04d8"} Jul 28 00:01:35.696555 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:35.696523 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" event={"ID":"99d4672b-07d4-467a-a989-1f3e2db65e4a","Type":"ContainerStarted","Data":"22f13ac9a9093bc98b3ea431a3cc5551e50061545de5c6246b3985dc98c21dcf"} Jul 28 00:01:35.696767 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:35.696745 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:35.696867 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:35.696844 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:35.712226 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:35.712206 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:35.733946 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:35.733907 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" podStartSLOduration=8.963532645 podStartE2EDuration="27.733893761s" totalImagesPullingTime="18.770361116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:35.733516429 +0000 UTC m=+27.820528297" watchObservedRunningTime="2026-07-28 00:01:35.733893761 +0000 UTC m=+27.820905629" Jul 28 00:01:35.734121 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:35.734099 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsdr5" podStartSLOduration=4.269428293 podStartE2EDuration="27.734094537s" totalImagesPullingTime="23.464666244s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:35.710863951 +0000 UTC m=+27.797875820" watchObservedRunningTime="2026-07-28 00:01:35.734094537 +0000 UTC m=+27.821106407" Jul 28 00:01:36.493268 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:36.493217 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:36.493382 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:36.493318 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqdhz" podUID="ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71" Jul 28 00:01:36.699804 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:36.699773 2562 generic.go:356] "Generic (PLEG): container finished" podID="37a8f118-b676-45df-bb06-468b904da361" containerID="8acf29afe3a1add4726f18dafe5c04ee6e8655fffe1d03ef24aa62b0d64c390d" exitCode=0 Jul 28 00:01:36.700349 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:36.699860 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vdmc" event={"ID":"37a8f118-b676-45df-bb06-468b904da361","Type":"ContainerDied","Data":"8acf29afe3a1add4726f18dafe5c04ee6e8655fffe1d03ef24aa62b0d64c390d"} Jul 28 00:01:36.700602 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:36.700563 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:36.715935 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:36.715786 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:01:37.493834 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:37.493804 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:37.494012 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:37.493920 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4nkt" podUID="898d09b0-dd59-4773-a4a2-74618b9015d9" Jul 28 00:01:37.494309 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:37.494288 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:37.494427 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:37.494379 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fn66" podUID="8d81b605-7b6c-4482-bf3c-e9be07ece7a1" Jul 28 00:01:37.840503 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:37.840466 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6fn66"] Jul 28 00:01:37.840953 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:37.840597 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:37.840953 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:37.840719 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fn66" podUID="8d81b605-7b6c-4482-bf3c-e9be07ece7a1" Jul 28 00:01:37.840953 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:37.840798 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n4nkt"] Jul 28 00:01:37.840953 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:37.840880 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:37.841169 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:37.840953 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4nkt" podUID="898d09b0-dd59-4773-a4a2-74618b9015d9" Jul 28 00:01:37.841445 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:37.841412 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jqdhz"] Jul 28 00:01:37.841541 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:37.841485 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:37.841634 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:37.841564 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqdhz" podUID="ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71" Jul 28 00:01:38.706019 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:38.705988 2562 generic.go:356] "Generic (PLEG): container finished" podID="37a8f118-b676-45df-bb06-468b904da361" containerID="836f5c589a2413df0c03da7f58fef4a9433fc6ef0f4a93000f0a72022704a379" exitCode=0 Jul 28 00:01:38.706148 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:38.706067 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vdmc" event={"ID":"37a8f118-b676-45df-bb06-468b904da361","Type":"ContainerDied","Data":"836f5c589a2413df0c03da7f58fef4a9433fc6ef0f4a93000f0a72022704a379"} Jul 28 00:01:39.493397 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:39.493372 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:39.493768 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:39.493417 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:39.493768 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:39.493430 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:39.493768 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:39.493498 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4nkt" podUID="898d09b0-dd59-4773-a4a2-74618b9015d9" Jul 28 00:01:39.493768 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:39.493594 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqdhz" podUID="ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71" Jul 28 00:01:39.493768 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:39.493660 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fn66" podUID="8d81b605-7b6c-4482-bf3c-e9be07ece7a1" Jul 28 00:01:40.713009 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:40.712978 2562 generic.go:356] "Generic (PLEG): container finished" podID="37a8f118-b676-45df-bb06-468b904da361" containerID="9ac548d3557b0ead61cac4996687af5b05fc0f99f89bea3d60c6c7f2017a4597" exitCode=0 Jul 28 00:01:40.713377 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:40.713025 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vdmc" event={"ID":"37a8f118-b676-45df-bb06-468b904da361","Type":"ContainerDied","Data":"9ac548d3557b0ead61cac4996687af5b05fc0f99f89bea3d60c6c7f2017a4597"} Jul 28 00:01:41.493416 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:41.493246 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:41.493614 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:41.493251 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:41.493614 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:41.493501 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4nkt" podUID="898d09b0-dd59-4773-a4a2-74618b9015d9" Jul 28 00:01:41.493614 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:41.493253 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:41.493614 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:41.493597 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fn66" podUID="8d81b605-7b6c-4482-bf3c-e9be07ece7a1" Jul 28 00:01:41.493774 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:41.493714 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqdhz" podUID="ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71" Jul 28 00:01:42.156185 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:42.156105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs\") pod \"network-metrics-daemon-jqdhz\" (UID: \"ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71\") " pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:42.156185 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:42.156155 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret\") pod \"global-pull-secret-syncer-6fn66\" (UID: \"8d81b605-7b6c-4482-bf3c-e9be07ece7a1\") " pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:42.156698 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:42.156277 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:42.156698 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:42.156278 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:42.156698 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:42.156335 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret podName:8d81b605-7b6c-4482-bf3c-e9be07ece7a1 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:14.156316028 +0000 UTC m=+66.243327889 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret") pod "global-pull-secret-syncer-6fn66" (UID: "8d81b605-7b6c-4482-bf3c-e9be07ece7a1") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:01:42.156698 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:42.156353 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs podName:ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:14.156343853 +0000 UTC m=+66.243355720 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs") pod "network-metrics-daemon-jqdhz" (UID: "ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:01:42.257408 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:42.257377 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzltj\" (UniqueName: \"kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj\") pod \"network-check-target-n4nkt\" (UID: \"898d09b0-dd59-4773-a4a2-74618b9015d9\") " pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:42.257560 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:42.257526 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:01:42.257560 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:42.257544 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:01:42.257560 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:42.257556 2562 projected.go:196] Error preparing data for projected volume kube-api-access-kzltj for pod openshift-network-diagnostics/network-check-target-n4nkt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:42.257715 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:42.257621 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj podName:898d09b0-dd59-4773-a4a2-74618b9015d9 nodeName:}" failed. No retries permitted until 2026-07-28 00:02:14.257609414 +0000 UTC m=+66.344621265 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzltj" (UniqueName: "kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj") pod "network-check-target-n4nkt" (UID: "898d09b0-dd59-4773-a4a2-74618b9015d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:01:43.493411 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:43.492871 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:43.493411 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:43.492907 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:43.493411 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:43.492907 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:43.493411 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:43.492985 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4nkt" podUID="898d09b0-dd59-4773-a4a2-74618b9015d9" Jul 28 00:01:43.493411 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:43.493090 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqdhz" podUID="ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71" Jul 28 00:01:43.493411 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:43.493181 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fn66" podUID="8d81b605-7b6c-4482-bf3c-e9be07ece7a1" Jul 28 00:01:44.232845 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.232764 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeReady" Jul 28 00:01:44.233002 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.232901 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 00:01:44.280652 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.280625 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dvgml"] Jul 28 00:01:44.283215 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.283193 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dvgml" Jul 28 00:01:44.285717 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.285696 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 00:01:44.285852 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.285700 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wxjjr\"" Jul 28 00:01:44.285852 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.285700 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 00:01:44.287880 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.287862 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fvx4b"] Jul 28 00:01:44.289642 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.289625 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fvx4b" Jul 28 00:01:44.292194 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.292166 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 00:01:44.292286 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.292212 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ztr5f\"" Jul 28 00:01:44.292347 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.292335 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 00:01:44.292444 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.292421 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 00:01:44.297799 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.297781 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dvgml"] Jul 28 00:01:44.300432 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.300393 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fvx4b"] Jul 28 00:01:44.375691 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.375653 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-config-volume\") pod \"dns-default-dvgml\" (UID: \"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee\") " pod="openshift-dns/dns-default-dvgml" Jul 28 00:01:44.375691 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.375686 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bc6ef2e-56e8-4822-a0aa-72c4b47991e5-cert\") pod \"ingress-canary-fvx4b\" (UID: \"0bc6ef2e-56e8-4822-a0aa-72c4b47991e5\") " pod="openshift-ingress-canary/ingress-canary-fvx4b" Jul 28 00:01:44.375883 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.375738 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltcnr\" (UniqueName: \"kubernetes.io/projected/0bc6ef2e-56e8-4822-a0aa-72c4b47991e5-kube-api-access-ltcnr\") pod \"ingress-canary-fvx4b\" (UID: \"0bc6ef2e-56e8-4822-a0aa-72c4b47991e5\") " pod="openshift-ingress-canary/ingress-canary-fvx4b" Jul 28 00:01:44.375883 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.375762 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-tmp-dir\") pod \"dns-default-dvgml\" (UID: \"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee\") " pod="openshift-dns/dns-default-dvgml" Jul 28 00:01:44.375883 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.375790 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls\") pod \"dns-default-dvgml\" (UID: \"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee\") " pod="openshift-dns/dns-default-dvgml" Jul 28 00:01:44.375883 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.375816 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtp5c\" (UniqueName: \"kubernetes.io/projected/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-kube-api-access-wtp5c\") pod \"dns-default-dvgml\" (UID: \"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee\") " pod="openshift-dns/dns-default-dvgml" Jul 28 00:01:44.477090 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.477063 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltcnr\" (UniqueName: \"kubernetes.io/projected/0bc6ef2e-56e8-4822-a0aa-72c4b47991e5-kube-api-access-ltcnr\") pod \"ingress-canary-fvx4b\" (UID: \"0bc6ef2e-56e8-4822-a0aa-72c4b47991e5\") " pod="openshift-ingress-canary/ingress-canary-fvx4b" Jul 28 00:01:44.477230 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.477101 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-tmp-dir\") pod \"dns-default-dvgml\" (UID: \"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee\") " pod="openshift-dns/dns-default-dvgml" Jul 28 00:01:44.477230 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.477130 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls\") pod \"dns-default-dvgml\" (UID: \"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee\") " pod="openshift-dns/dns-default-dvgml" Jul 28 00:01:44.477230 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.477152 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtp5c\" (UniqueName: \"kubernetes.io/projected/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-kube-api-access-wtp5c\") pod \"dns-default-dvgml\" (UID: \"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee\") " pod="openshift-dns/dns-default-dvgml" Jul 28 00:01:44.477230 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.477216 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-config-volume\") pod \"dns-default-dvgml\" (UID: \"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee\") " pod="openshift-dns/dns-default-dvgml" Jul 28 00:01:44.477476 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.477244 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bc6ef2e-56e8-4822-a0aa-72c4b47991e5-cert\") pod \"ingress-canary-fvx4b\" (UID: \"0bc6ef2e-56e8-4822-a0aa-72c4b47991e5\") " pod="openshift-ingress-canary/ingress-canary-fvx4b" Jul 28 00:01:44.477476 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:44.477272 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:01:44.477476 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:44.477322 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls podName:f26cd91d-63b8-4b8c-94e6-6b3062ad83ee nodeName:}" failed. No retries permitted until 2026-07-28 00:01:44.977308188 +0000 UTC m=+37.064320035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls") pod "dns-default-dvgml" (UID: "f26cd91d-63b8-4b8c-94e6-6b3062ad83ee") : secret "dns-default-metrics-tls" not found Jul 28 00:01:44.477650 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.477493 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-tmp-dir\") pod \"dns-default-dvgml\" (UID: \"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee\") " pod="openshift-dns/dns-default-dvgml" Jul 28 00:01:44.477836 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.477816 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-config-volume\") pod \"dns-default-dvgml\" (UID: \"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee\") " pod="openshift-dns/dns-default-dvgml" Jul 28 00:01:44.482699 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.482673 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0bc6ef2e-56e8-4822-a0aa-72c4b47991e5-cert\") pod \"ingress-canary-fvx4b\" (UID: \"0bc6ef2e-56e8-4822-a0aa-72c4b47991e5\") " pod="openshift-ingress-canary/ingress-canary-fvx4b" Jul 28 00:01:44.486717 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.486666 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtp5c\" (UniqueName: \"kubernetes.io/projected/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-kube-api-access-wtp5c\") pod \"dns-default-dvgml\" (UID: \"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee\") " pod="openshift-dns/dns-default-dvgml" Jul 28 00:01:44.486717 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.486707 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltcnr\" (UniqueName: \"kubernetes.io/projected/0bc6ef2e-56e8-4822-a0aa-72c4b47991e5-kube-api-access-ltcnr\") pod \"ingress-canary-fvx4b\" (UID: \"0bc6ef2e-56e8-4822-a0aa-72c4b47991e5\") " pod="openshift-ingress-canary/ingress-canary-fvx4b" Jul 28 00:01:44.602295 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.602270 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fvx4b" Jul 28 00:01:44.825461 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.825232 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fvx4b"] Jul 28 00:01:44.828958 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:01:44.828936 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc6ef2e_56e8_4822_a0aa_72c4b47991e5.slice/crio-f5797cfa74acfc00e373f0ced33f3961f0322d65a40fd0a9657e34b25c232671 WatchSource:0}: Error finding container f5797cfa74acfc00e373f0ced33f3961f0322d65a40fd0a9657e34b25c232671: Status 404 returned error can't find the container with id f5797cfa74acfc00e373f0ced33f3961f0322d65a40fd0a9657e34b25c232671 Jul 28 00:01:44.980645 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:44.980620 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls\") pod \"dns-default-dvgml\" (UID: \"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee\") " pod="openshift-dns/dns-default-dvgml" Jul 28 00:01:44.980737 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:44.980726 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:01:44.980798 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:44.980789 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls podName:f26cd91d-63b8-4b8c-94e6-6b3062ad83ee nodeName:}" failed. No retries permitted until 2026-07-28 00:01:45.980776192 +0000 UTC m=+38.067788040 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls") pod "dns-default-dvgml" (UID: "f26cd91d-63b8-4b8c-94e6-6b3062ad83ee") : secret "dns-default-metrics-tls" not found Jul 28 00:01:45.493448 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:45.493416 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:01:45.493598 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:45.493451 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:01:45.493598 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:45.493451 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:01:45.496511 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:45.496489 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 00:01:45.496511 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:45.496508 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-shf5w\"" Jul 28 00:01:45.496707 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:45.496511 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 00:01:45.496707 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:45.496548 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 00:01:45.496817 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:45.496765 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 00:01:45.496873 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:45.496835 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8t2hm\"" Jul 28 00:01:45.747106 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:45.747019 2562 generic.go:356] "Generic (PLEG): container finished" podID="37a8f118-b676-45df-bb06-468b904da361" containerID="c0e326372e071c523a308abc06924b0df2cc1e82f38d8afd7a43845a00134d46" exitCode=0 Jul 28 00:01:45.747634 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:45.747102 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vdmc" event={"ID":"37a8f118-b676-45df-bb06-468b904da361","Type":"ContainerDied","Data":"c0e326372e071c523a308abc06924b0df2cc1e82f38d8afd7a43845a00134d46"} Jul 28 00:01:45.748949 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:45.748924 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fvx4b" event={"ID":"0bc6ef2e-56e8-4822-a0aa-72c4b47991e5","Type":"ContainerStarted","Data":"f5797cfa74acfc00e373f0ced33f3961f0322d65a40fd0a9657e34b25c232671"} Jul 28 00:01:45.989903 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:45.989874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls\") pod \"dns-default-dvgml\" (UID: \"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee\") " pod="openshift-dns/dns-default-dvgml" Jul 28 00:01:45.990024 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:45.990008 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:01:45.990075 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:45.990064 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls podName:f26cd91d-63b8-4b8c-94e6-6b3062ad83ee nodeName:}" failed. No retries permitted until 2026-07-28 00:01:47.990048954 +0000 UTC m=+40.077060801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls") pod "dns-default-dvgml" (UID: "f26cd91d-63b8-4b8c-94e6-6b3062ad83ee") : secret "dns-default-metrics-tls" not found Jul 28 00:01:46.754938 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:46.754901 2562 generic.go:356] "Generic (PLEG): container finished" podID="37a8f118-b676-45df-bb06-468b904da361" containerID="57217e66af70b28ba96facdee7621815b41c7ee8dbbf5e6f577485ac9dfe496f" exitCode=0 Jul 28 00:01:46.755334 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:46.754965 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vdmc" event={"ID":"37a8f118-b676-45df-bb06-468b904da361","Type":"ContainerDied","Data":"57217e66af70b28ba96facdee7621815b41c7ee8dbbf5e6f577485ac9dfe496f"} Jul 28 00:01:47.760940 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:47.760864 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vdmc" event={"ID":"37a8f118-b676-45df-bb06-468b904da361","Type":"ContainerStarted","Data":"1520953581da193a68635af32d900cada02f78e1279aa44c48ec266caa311751"} Jul 28 00:01:47.762332 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:47.762308 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fvx4b" event={"ID":"0bc6ef2e-56e8-4822-a0aa-72c4b47991e5","Type":"ContainerStarted","Data":"62ce943dc46db15ea9af17acf6b07603aca5a6c7667820c377d772668b9645f7"} Jul 28 00:01:47.781092 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:47.781055 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9vdmc" podStartSLOduration=9.490030313 podStartE2EDuration="39.781040124s" totalImagesPullingTime="30.291009811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:47.780724804 +0000 UTC m=+39.867736670" watchObservedRunningTime="2026-07-28 00:01:47.781040124 +0000 UTC m=+39.868051993" Jul 28 00:01:47.797828 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:47.797789 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fvx4b" podStartSLOduration=1.4839358 podStartE2EDuration="3.797778104s" totalImagesPullingTime="2.313842304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:01:47.797429409 +0000 UTC m=+39.884441279" watchObservedRunningTime="2026-07-28 00:01:47.797778104 +0000 UTC m=+39.884789974" Jul 28 00:01:48.003952 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:48.003801 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls\") pod \"dns-default-dvgml\" (UID: \"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee\") " pod="openshift-dns/dns-default-dvgml" Jul 28 00:01:48.004041 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:48.003921 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:01:48.004081 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:48.004043 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls podName:f26cd91d-63b8-4b8c-94e6-6b3062ad83ee nodeName:}" failed. No retries permitted until 2026-07-28 00:01:52.004030462 +0000 UTC m=+44.091042310 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls") pod "dns-default-dvgml" (UID: "f26cd91d-63b8-4b8c-94e6-6b3062ad83ee") : secret "dns-default-metrics-tls" not found Jul 28 00:01:52.030816 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:52.030779 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls\") pod \"dns-default-dvgml\" (UID: \"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee\") " pod="openshift-dns/dns-default-dvgml" Jul 28 00:01:52.031213 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:52.030915 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:01:52.031213 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:52.030971 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls podName:f26cd91d-63b8-4b8c-94e6-6b3062ad83ee nodeName:}" failed. No retries permitted until 2026-07-28 00:02:00.030956374 +0000 UTC m=+52.117968222 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls") pod "dns-default-dvgml" (UID: "f26cd91d-63b8-4b8c-94e6-6b3062ad83ee") : secret "dns-default-metrics-tls" not found Jul 28 00:01:53.445354 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.445325 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cbdf5498d-rphjl"] Jul 28 00:01:53.477637 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.477616 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cbdf5498d-rphjl"] Jul 28 00:01:53.477767 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.477704 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.479951 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.479913 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 00:01:53.480083 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.479963 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 00:01:53.480083 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.480015 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g2k9m\"" Jul 28 00:01:53.480083 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.480015 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 00:01:53.489216 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.489194 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 00:01:53.641010 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.640981 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.641107 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.641015 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-certificates\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.641107 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.641057 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-bound-sa-token\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.641107 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.641089 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c52e3ebd-1d20-43af-967b-1b254306fa0e-image-registry-private-configuration\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.641107 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.641105 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c52e3ebd-1d20-43af-967b-1b254306fa0e-trusted-ca\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.641253 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.641144 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c52e3ebd-1d20-43af-967b-1b254306fa0e-ca-trust-extracted\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.641253 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.641208 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd56p\" (UniqueName: \"kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-kube-api-access-xd56p\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.641253 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.641244 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c52e3ebd-1d20-43af-967b-1b254306fa0e-installation-pull-secrets\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.741484 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.741433 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-bound-sa-token\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.741484 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.741473 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c52e3ebd-1d20-43af-967b-1b254306fa0e-image-registry-private-configuration\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.741620 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.741494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c52e3ebd-1d20-43af-967b-1b254306fa0e-trusted-ca\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.741660 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.741614 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c52e3ebd-1d20-43af-967b-1b254306fa0e-ca-trust-extracted\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.741660 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.741654 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd56p\" (UniqueName: \"kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-kube-api-access-xd56p\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.741731 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.741699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c52e3ebd-1d20-43af-967b-1b254306fa0e-installation-pull-secrets\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.741767 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.741730 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.741767 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.741759 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-certificates\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.741929 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:53.741903 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:01:53.741929 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:53.741926 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cbdf5498d-rphjl: secret "image-registry-tls" not found Jul 28 00:01:53.742050 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.742015 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c52e3ebd-1d20-43af-967b-1b254306fa0e-ca-trust-extracted\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.742050 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:53.742043 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls podName:c52e3ebd-1d20-43af-967b-1b254306fa0e nodeName:}" failed. No retries permitted until 2026-07-28 00:01:54.242020904 +0000 UTC m=+46.329032754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls") pod "image-registry-6cbdf5498d-rphjl" (UID: "c52e3ebd-1d20-43af-967b-1b254306fa0e") : secret "image-registry-tls" not found Jul 28 00:01:53.742375 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.742354 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-certificates\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.742508 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.742488 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c52e3ebd-1d20-43af-967b-1b254306fa0e-trusted-ca\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.745796 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.745773 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c52e3ebd-1d20-43af-967b-1b254306fa0e-installation-pull-secrets\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.745878 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.745781 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c52e3ebd-1d20-43af-967b-1b254306fa0e-image-registry-private-configuration\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.749239 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.749217 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-bound-sa-token\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:53.752405 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:53.752387 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd56p\" (UniqueName: \"kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-kube-api-access-xd56p\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:54.245641 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:54.245620 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:54.245779 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:54.245758 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:01:54.245825 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:54.245780 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cbdf5498d-rphjl: secret "image-registry-tls" not found Jul 28 00:01:54.245859 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:54.245844 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls podName:c52e3ebd-1d20-43af-967b-1b254306fa0e nodeName:}" failed. No retries permitted until 2026-07-28 00:01:55.245829604 +0000 UTC m=+47.332841451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls") pod "image-registry-6cbdf5498d-rphjl" (UID: "c52e3ebd-1d20-43af-967b-1b254306fa0e") : secret "image-registry-tls" not found Jul 28 00:01:55.251079 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:55.251053 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:55.251391 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:55.251147 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:01:55.251391 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:55.251158 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cbdf5498d-rphjl: secret "image-registry-tls" not found Jul 28 00:01:55.251391 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:55.251223 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls podName:c52e3ebd-1d20-43af-967b-1b254306fa0e nodeName:}" failed. No retries permitted until 2026-07-28 00:01:57.251211072 +0000 UTC m=+49.338222920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls") pod "image-registry-6cbdf5498d-rphjl" (UID: "c52e3ebd-1d20-43af-967b-1b254306fa0e") : secret "image-registry-tls" not found Jul 28 00:01:57.265799 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:01:57.265764 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:01:57.266206 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:57.265879 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:01:57.266206 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:57.265891 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cbdf5498d-rphjl: secret "image-registry-tls" not found Jul 28 00:01:57.266206 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:01:57.265942 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls podName:c52e3ebd-1d20-43af-967b-1b254306fa0e nodeName:}" failed. No retries permitted until 2026-07-28 00:02:01.265928443 +0000 UTC m=+53.352940290 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls") pod "image-registry-6cbdf5498d-rphjl" (UID: "c52e3ebd-1d20-43af-967b-1b254306fa0e") : secret "image-registry-tls" not found Jul 28 00:02:00.085464 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:00.085427 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls\") pod \"dns-default-dvgml\" (UID: \"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee\") " pod="openshift-dns/dns-default-dvgml" Jul 28 00:02:00.085917 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:00.085590 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:02:00.085917 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:00.085664 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls podName:f26cd91d-63b8-4b8c-94e6-6b3062ad83ee nodeName:}" failed. No retries permitted until 2026-07-28 00:02:16.085649287 +0000 UTC m=+68.172661134 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls") pod "dns-default-dvgml" (UID: "f26cd91d-63b8-4b8c-94e6-6b3062ad83ee") : secret "dns-default-metrics-tls" not found Jul 28 00:02:01.293353 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:01.293321 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:02:01.293869 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:01.293477 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:02:01.293869 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:01.293499 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cbdf5498d-rphjl: secret "image-registry-tls" not found Jul 28 00:02:01.293869 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:01.293555 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls podName:c52e3ebd-1d20-43af-967b-1b254306fa0e nodeName:}" failed. No retries permitted until 2026-07-28 00:02:09.29354073 +0000 UTC m=+61.380552577 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls") pod "image-registry-6cbdf5498d-rphjl" (UID: "c52e3ebd-1d20-43af-967b-1b254306fa0e") : secret "image-registry-tls" not found Jul 28 00:02:08.729815 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:08.729776 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvrbh" Jul 28 00:02:09.345763 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:09.345729 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:02:09.345964 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:09.345859 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:02:09.345964 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:09.345877 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cbdf5498d-rphjl: secret "image-registry-tls" not found Jul 28 00:02:09.345964 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:09.345958 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls podName:c52e3ebd-1d20-43af-967b-1b254306fa0e nodeName:}" failed. No retries permitted until 2026-07-28 00:02:25.345942474 +0000 UTC m=+77.432954321 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls") pod "image-registry-6cbdf5498d-rphjl" (UID: "c52e3ebd-1d20-43af-967b-1b254306fa0e") : secret "image-registry-tls" not found Jul 28 00:02:14.180070 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:14.180025 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs\") pod \"network-metrics-daemon-jqdhz\" (UID: \"ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71\") " pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:02:14.180731 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:14.180082 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret\") pod \"global-pull-secret-syncer-6fn66\" (UID: \"8d81b605-7b6c-4482-bf3c-e9be07ece7a1\") " pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:02:14.182612 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:14.182563 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 00:02:14.182767 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:14.182687 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 00:02:14.190233 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:14.190213 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 28 00:02:14.190303 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:14.190291 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs podName:ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71 nodeName:}" failed. No retries permitted until 2026-07-28 00:03:18.19027156 +0000 UTC m=+130.277283406 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs") pod "network-metrics-daemon-jqdhz" (UID: "ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71") : secret "metrics-daemon-secret" not found Jul 28 00:02:14.192920 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:14.192881 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d81b605-7b6c-4482-bf3c-e9be07ece7a1-original-pull-secret\") pod \"global-pull-secret-syncer-6fn66\" (UID: \"8d81b605-7b6c-4482-bf3c-e9be07ece7a1\") " pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:02:14.280381 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:14.280348 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzltj\" (UniqueName: \"kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj\") pod \"network-check-target-n4nkt\" (UID: \"898d09b0-dd59-4773-a4a2-74618b9015d9\") " pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:02:14.282889 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:14.282870 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 00:02:14.292605 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:14.292565 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 00:02:14.304536 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:14.304510 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzltj\" (UniqueName: \"kubernetes.io/projected/898d09b0-dd59-4773-a4a2-74618b9015d9-kube-api-access-kzltj\") pod \"network-check-target-n4nkt\" (UID: \"898d09b0-dd59-4773-a4a2-74618b9015d9\") " pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:02:14.310728 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:14.310706 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fn66" Jul 28 00:02:14.318716 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:14.318693 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8t2hm\"" Jul 28 00:02:14.327418 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:14.327395 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:02:14.451618 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:14.451529 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6fn66"] Jul 28 00:02:14.464132 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:14.464111 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n4nkt"] Jul 28 00:02:14.467124 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:02:14.467096 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod898d09b0_dd59_4773_a4a2_74618b9015d9.slice/crio-37df915ee06d5cb441a0f8fa817326191f2d4c79f6db4f647b29540deb89fd4f WatchSource:0}: Error finding container 37df915ee06d5cb441a0f8fa817326191f2d4c79f6db4f647b29540deb89fd4f: Status 404 returned error can't find the container with id 37df915ee06d5cb441a0f8fa817326191f2d4c79f6db4f647b29540deb89fd4f Jul 28 00:02:14.821674 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:14.821595 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n4nkt" event={"ID":"898d09b0-dd59-4773-a4a2-74618b9015d9","Type":"ContainerStarted","Data":"37df915ee06d5cb441a0f8fa817326191f2d4c79f6db4f647b29540deb89fd4f"} Jul 28 00:02:14.822819 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:14.822790 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6fn66" event={"ID":"8d81b605-7b6c-4482-bf3c-e9be07ece7a1","Type":"ContainerStarted","Data":"ceb8bc974d9989d6a9914697c13a409d78c1b760b9f93a4f8e6fe51878a30cb4"} Jul 28 00:02:16.095184 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:16.095154 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls\") pod \"dns-default-dvgml\" (UID: \"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee\") " pod="openshift-dns/dns-default-dvgml" Jul 28 00:02:16.095655 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:16.095321 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:02:16.095655 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:16.095390 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls podName:f26cd91d-63b8-4b8c-94e6-6b3062ad83ee nodeName:}" failed. No retries permitted until 2026-07-28 00:02:48.095369253 +0000 UTC m=+100.182381100 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls") pod "dns-default-dvgml" (UID: "f26cd91d-63b8-4b8c-94e6-6b3062ad83ee") : secret "dns-default-metrics-tls" not found Jul 28 00:02:19.838120 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:19.838080 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n4nkt" event={"ID":"898d09b0-dd59-4773-a4a2-74618b9015d9","Type":"ContainerStarted","Data":"98c56b3e2c1b46617a49501e16605835e2074716030955a029c9b80b5b9014c7"} Jul 28 00:02:19.838533 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:19.838225 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:02:19.839717 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:19.839697 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6fn66" event={"ID":"8d81b605-7b6c-4482-bf3c-e9be07ece7a1","Type":"ContainerStarted","Data":"666257e3dab01f2af42b112fbd405785d976322f0e6518fd80df71e71690ac3c"} Jul 28 00:02:19.852716 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:19.852674 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n4nkt" podStartSLOduration=67.086745018 podStartE2EDuration="1m11.852659638s" totalImagesPullingTime="4.76591462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:19.852195612 +0000 UTC m=+71.939207482" watchObservedRunningTime="2026-07-28 00:02:19.852659638 +0000 UTC m=+71.939671540" Jul 28 00:02:19.866788 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:19.866753 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6fn66" podStartSLOduration=67.086861575 podStartE2EDuration="1m11.866745072s" totalImagesPullingTime="4.779883497s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:19.865717624 +0000 UTC m=+71.952729492" watchObservedRunningTime="2026-07-28 00:02:19.866745072 +0000 UTC m=+71.953756940" Jul 28 00:02:25.350079 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:25.350035 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:02:25.350708 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:25.350177 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:02:25.350708 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:25.350194 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cbdf5498d-rphjl: secret "image-registry-tls" not found Jul 28 00:02:25.350708 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:25.350266 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls podName:c52e3ebd-1d20-43af-967b-1b254306fa0e nodeName:}" failed. No retries permitted until 2026-07-28 00:02:57.350245678 +0000 UTC m=+109.437257527 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls") pod "image-registry-6cbdf5498d-rphjl" (UID: "c52e3ebd-1d20-43af-967b-1b254306fa0e") : secret "image-registry-tls" not found Jul 28 00:02:33.286968 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.282467 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4"] Jul 28 00:02:33.286968 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.285306 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" Jul 28 00:02:33.287701 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.287679 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 28 00:02:33.288146 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.288125 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 28 00:02:33.288254 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.288152 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 28 00:02:33.288254 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.288157 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 28 00:02:33.297542 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.297519 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4"] Jul 28 00:02:33.301806 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.301782 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x4rq\" (UniqueName: \"kubernetes.io/projected/5399b003-7093-42ab-aa85-c56436fcbd53-kube-api-access-4x4rq\") pod \"klusterlet-addon-workmgr-5656cb958f-m8gw4\" (UID: \"5399b003-7093-42ab-aa85-c56436fcbd53\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" Jul 28 00:02:33.301904 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.301814 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5399b003-7093-42ab-aa85-c56436fcbd53-tmp\") pod \"klusterlet-addon-workmgr-5656cb958f-m8gw4\" (UID: \"5399b003-7093-42ab-aa85-c56436fcbd53\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" Jul 28 00:02:33.301904 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.301846 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5399b003-7093-42ab-aa85-c56436fcbd53-klusterlet-config\") pod \"klusterlet-addon-workmgr-5656cb958f-m8gw4\" (UID: \"5399b003-7093-42ab-aa85-c56436fcbd53\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" Jul 28 00:02:33.307343 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.307319 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n"] Jul 28 00:02:33.309755 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.309732 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" Jul 28 00:02:33.312042 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.312017 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 28 00:02:33.312140 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.312023 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 28 00:02:33.312300 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.312283 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 28 00:02:33.312338 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.312316 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 28 00:02:33.322037 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.322014 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n"] Jul 28 00:02:33.402623 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.402599 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/001742e4-80de-4d59-b219-3c32394e707a-ca\") pod \"cluster-proxy-proxy-agent-7c67448cfc-cgr2n\" (UID: \"001742e4-80de-4d59-b219-3c32394e707a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" Jul 28 00:02:33.402718 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.402643 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x4rq\" (UniqueName: \"kubernetes.io/projected/5399b003-7093-42ab-aa85-c56436fcbd53-kube-api-access-4x4rq\") pod \"klusterlet-addon-workmgr-5656cb958f-m8gw4\" (UID: \"5399b003-7093-42ab-aa85-c56436fcbd53\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" Jul 28 00:02:33.402718 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.402690 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5399b003-7093-42ab-aa85-c56436fcbd53-tmp\") pod \"klusterlet-addon-workmgr-5656cb958f-m8gw4\" (UID: \"5399b003-7093-42ab-aa85-c56436fcbd53\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" Jul 28 00:02:33.402793 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.402720 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5399b003-7093-42ab-aa85-c56436fcbd53-klusterlet-config\") pod \"klusterlet-addon-workmgr-5656cb958f-m8gw4\" (UID: \"5399b003-7093-42ab-aa85-c56436fcbd53\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" Jul 28 00:02:33.402793 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.402750 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/001742e4-80de-4d59-b219-3c32394e707a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c67448cfc-cgr2n\" (UID: \"001742e4-80de-4d59-b219-3c32394e707a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" Jul 28 00:02:33.402793 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.402779 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/001742e4-80de-4d59-b219-3c32394e707a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c67448cfc-cgr2n\" (UID: \"001742e4-80de-4d59-b219-3c32394e707a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" Jul 28 00:02:33.402898 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.402803 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/001742e4-80de-4d59-b219-3c32394e707a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c67448cfc-cgr2n\" (UID: \"001742e4-80de-4d59-b219-3c32394e707a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" Jul 28 00:02:33.402941 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.402919 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/001742e4-80de-4d59-b219-3c32394e707a-hub\") pod \"cluster-proxy-proxy-agent-7c67448cfc-cgr2n\" (UID: \"001742e4-80de-4d59-b219-3c32394e707a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" Jul 28 00:02:33.402976 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.402955 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqscv\" (UniqueName: \"kubernetes.io/projected/001742e4-80de-4d59-b219-3c32394e707a-kube-api-access-lqscv\") pod \"cluster-proxy-proxy-agent-7c67448cfc-cgr2n\" (UID: \"001742e4-80de-4d59-b219-3c32394e707a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" Jul 28 00:02:33.403142 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.403123 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5399b003-7093-42ab-aa85-c56436fcbd53-tmp\") pod \"klusterlet-addon-workmgr-5656cb958f-m8gw4\" (UID: \"5399b003-7093-42ab-aa85-c56436fcbd53\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" Jul 28 00:02:33.405532 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.405502 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5399b003-7093-42ab-aa85-c56436fcbd53-klusterlet-config\") pod \"klusterlet-addon-workmgr-5656cb958f-m8gw4\" (UID: \"5399b003-7093-42ab-aa85-c56436fcbd53\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" Jul 28 00:02:33.412540 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.412517 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x4rq\" (UniqueName: \"kubernetes.io/projected/5399b003-7093-42ab-aa85-c56436fcbd53-kube-api-access-4x4rq\") pod \"klusterlet-addon-workmgr-5656cb958f-m8gw4\" (UID: \"5399b003-7093-42ab-aa85-c56436fcbd53\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" Jul 28 00:02:33.503890 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.503852 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/001742e4-80de-4d59-b219-3c32394e707a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c67448cfc-cgr2n\" (UID: \"001742e4-80de-4d59-b219-3c32394e707a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" Jul 28 00:02:33.503890 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.503896 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/001742e4-80de-4d59-b219-3c32394e707a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c67448cfc-cgr2n\" (UID: \"001742e4-80de-4d59-b219-3c32394e707a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" Jul 28 00:02:33.504051 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.503915 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/001742e4-80de-4d59-b219-3c32394e707a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c67448cfc-cgr2n\" (UID: \"001742e4-80de-4d59-b219-3c32394e707a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" Jul 28 00:02:33.504051 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.503958 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/001742e4-80de-4d59-b219-3c32394e707a-hub\") pod \"cluster-proxy-proxy-agent-7c67448cfc-cgr2n\" (UID: \"001742e4-80de-4d59-b219-3c32394e707a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" Jul 28 00:02:33.504051 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.503974 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqscv\" (UniqueName: \"kubernetes.io/projected/001742e4-80de-4d59-b219-3c32394e707a-kube-api-access-lqscv\") pod \"cluster-proxy-proxy-agent-7c67448cfc-cgr2n\" (UID: \"001742e4-80de-4d59-b219-3c32394e707a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" Jul 28 00:02:33.504051 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.504004 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/001742e4-80de-4d59-b219-3c32394e707a-ca\") pod \"cluster-proxy-proxy-agent-7c67448cfc-cgr2n\" (UID: \"001742e4-80de-4d59-b219-3c32394e707a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" Jul 28 00:02:33.504624 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.504565 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/001742e4-80de-4d59-b219-3c32394e707a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c67448cfc-cgr2n\" (UID: \"001742e4-80de-4d59-b219-3c32394e707a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" Jul 28 00:02:33.506664 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.506633 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/001742e4-80de-4d59-b219-3c32394e707a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c67448cfc-cgr2n\" (UID: \"001742e4-80de-4d59-b219-3c32394e707a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" Jul 28 00:02:33.506753 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.506744 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/001742e4-80de-4d59-b219-3c32394e707a-ca\") pod \"cluster-proxy-proxy-agent-7c67448cfc-cgr2n\" (UID: \"001742e4-80de-4d59-b219-3c32394e707a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" Jul 28 00:02:33.507424 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.507395 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/001742e4-80de-4d59-b219-3c32394e707a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c67448cfc-cgr2n\" (UID: \"001742e4-80de-4d59-b219-3c32394e707a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" Jul 28 00:02:33.507510 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.507436 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/001742e4-80de-4d59-b219-3c32394e707a-hub\") pod \"cluster-proxy-proxy-agent-7c67448cfc-cgr2n\" (UID: \"001742e4-80de-4d59-b219-3c32394e707a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" Jul 28 00:02:33.511713 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.511680 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqscv\" (UniqueName: \"kubernetes.io/projected/001742e4-80de-4d59-b219-3c32394e707a-kube-api-access-lqscv\") pod \"cluster-proxy-proxy-agent-7c67448cfc-cgr2n\" (UID: \"001742e4-80de-4d59-b219-3c32394e707a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" Jul 28 00:02:33.594951 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.594923 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" Jul 28 00:02:33.627937 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.627911 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" Jul 28 00:02:33.726960 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.726921 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4"] Jul 28 00:02:33.732251 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:02:33.732225 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5399b003_7093_42ab_aa85_c56436fcbd53.slice/crio-eb55b3fa0c3a739fed8ed97700ec1328401f4ac2eda9c442cd73dc9e650ed5a7 WatchSource:0}: Error finding container eb55b3fa0c3a739fed8ed97700ec1328401f4ac2eda9c442cd73dc9e650ed5a7: Status 404 returned error can't find the container with id eb55b3fa0c3a739fed8ed97700ec1328401f4ac2eda9c442cd73dc9e650ed5a7 Jul 28 00:02:33.769264 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.769241 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n"] Jul 28 00:02:33.772311 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:02:33.772286 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod001742e4_80de_4d59_b219_3c32394e707a.slice/crio-8a29965240dcef9106919b3bc5b387c0bd4c380ce146e9a4461809cf1bd47597 WatchSource:0}: Error finding container 8a29965240dcef9106919b3bc5b387c0bd4c380ce146e9a4461809cf1bd47597: Status 404 returned error can't find the container with id 8a29965240dcef9106919b3bc5b387c0bd4c380ce146e9a4461809cf1bd47597 Jul 28 00:02:33.873014 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.872955 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" event={"ID":"5399b003-7093-42ab-aa85-c56436fcbd53","Type":"ContainerStarted","Data":"eb55b3fa0c3a739fed8ed97700ec1328401f4ac2eda9c442cd73dc9e650ed5a7"} Jul 28 00:02:33.873985 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:33.873954 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" event={"ID":"001742e4-80de-4d59-b219-3c32394e707a","Type":"ContainerStarted","Data":"8a29965240dcef9106919b3bc5b387c0bd4c380ce146e9a4461809cf1bd47597"} Jul 28 00:02:34.649459 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:34.649422 2562 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc" Jul 28 00:02:34.649800 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:34.649522 2562 kuberuntime_manager.go:1459] "Unhandled Error" err="container acm-agent start failed in pod klusterlet-addon-workmgr-5656cb958f-m8gw4_open-cluster-management-agent-addon(5399b003-7093-42ab-aa85-c56436fcbd53): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 28 00:02:34.649800 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:34.649565 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:02:34.878432 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:34.878392 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:02:37.887830 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:37.887803 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" event={"ID":"001742e4-80de-4d59-b219-3c32394e707a","Type":"ContainerStarted","Data":"e7a4581733577f9393e667a3881429a6257b77a981060030d42a2c96d58e228a"} Jul 28 00:02:37.888142 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:37.887841 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" event={"ID":"001742e4-80de-4d59-b219-3c32394e707a","Type":"ContainerStarted","Data":"27ce849ae91ce4ec4ad62f4d0e918323b322f7ca625c70ccbe737e016c501c60"} Jul 28 00:02:37.888142 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:37.887862 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" event={"ID":"001742e4-80de-4d59-b219-3c32394e707a","Type":"ContainerStarted","Data":"1966d743dc84bb5d0d57296f2b5fc66dd1b64d0c656b65c8e9b79e1b51f9484d"} Jul 28 00:02:37.905039 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:37.904994 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" podStartSLOduration=1.161960266 podStartE2EDuration="4.904979418s" totalImagesPullingTime="3.743019152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:02:37.903877325 +0000 UTC m=+89.990889194" watchObservedRunningTime="2026-07-28 00:02:37.904979418 +0000 UTC m=+89.991991286" Jul 28 00:02:48.100535 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:48.100501 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls\") pod \"dns-default-dvgml\" (UID: \"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee\") " pod="openshift-dns/dns-default-dvgml" Jul 28 00:02:48.100925 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:48.100647 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:02:48.100925 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:48.100712 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls podName:f26cd91d-63b8-4b8c-94e6-6b3062ad83ee nodeName:}" failed. No retries permitted until 2026-07-28 00:03:52.100697599 +0000 UTC m=+164.187709447 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls") pod "dns-default-dvgml" (UID: "f26cd91d-63b8-4b8c-94e6-6b3062ad83ee") : secret "dns-default-metrics-tls" not found Jul 28 00:02:48.382428 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:48.382392 2562 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc" Jul 28 00:02:48.382615 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:48.382527 2562 kuberuntime_manager.go:1459] "Unhandled Error" err="container acm-agent start failed in pod klusterlet-addon-workmgr-5656cb958f-m8gw4_open-cluster-management-agent-addon(5399b003-7093-42ab-aa85-c56436fcbd53): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 28 00:02:48.382692 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:48.382618 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:02:50.845291 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:50.845253 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n4nkt" Jul 28 00:02:57.362513 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:02:57.362475 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:02:57.362928 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:57.362623 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:02:57.362928 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:57.362638 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cbdf5498d-rphjl: secret "image-registry-tls" not found Jul 28 00:02:57.362928 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:02:57.362687 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls podName:c52e3ebd-1d20-43af-967b-1b254306fa0e nodeName:}" failed. No retries permitted until 2026-07-28 00:04:01.362672891 +0000 UTC m=+173.449684738 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls") pod "image-registry-6cbdf5498d-rphjl" (UID: "c52e3ebd-1d20-43af-967b-1b254306fa0e") : secret "image-registry-tls" not found Jul 28 00:03:01.494283 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:03:01.494228 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:03:13.432903 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:03:13.432856 2562 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc" Jul 28 00:03:13.433325 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:03:13.432981 2562 kuberuntime_manager.go:1459] "Unhandled Error" err="container acm-agent start failed in pod klusterlet-addon-workmgr-5656cb958f-m8gw4_open-cluster-management-agent-addon(5399b003-7093-42ab-aa85-c56436fcbd53): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 28 00:03:13.433325 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:03:13.433022 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:03:18.207382 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:03:18.207340 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs\") pod \"network-metrics-daemon-jqdhz\" (UID: \"ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71\") " pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:03:18.207785 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:03:18.207488 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 28 00:03:18.207785 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:03:18.207560 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs podName:ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:20.207544671 +0000 UTC m=+252.294556518 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs") pod "network-metrics-daemon-jqdhz" (UID: "ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71") : secret "metrics-daemon-secret" not found Jul 28 00:03:28.495767 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:03:28.495530 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:03:39.493790 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:03:39.493756 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:03:47.295851 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:03:47.295796 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dvgml" podUID="f26cd91d-63b8-4b8c-94e6-6b3062ad83ee" Jul 28 00:03:48.084806 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:03:48.084780 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dvgml" Jul 28 00:03:48.504514 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:03:48.504443 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jqdhz" podUID="ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71" Jul 28 00:03:52.124628 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:03:52.124596 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls\") pod \"dns-default-dvgml\" (UID: \"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee\") " pod="openshift-dns/dns-default-dvgml" Jul 28 00:03:52.124979 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:03:52.124716 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:03:52.124979 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:03:52.124791 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls podName:f26cd91d-63b8-4b8c-94e6-6b3062ad83ee nodeName:}" failed. No retries permitted until 2026-07-28 00:05:54.124776648 +0000 UTC m=+286.211788496 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls") pod "dns-default-dvgml" (UID: "f26cd91d-63b8-4b8c-94e6-6b3062ad83ee") : secret "dns-default-metrics-tls" not found Jul 28 00:03:55.335249 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:03:55.335205 2562 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc" Jul 28 00:03:55.335728 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:03:55.335326 2562 kuberuntime_manager.go:1459] "Unhandled Error" err="container acm-agent start failed in pod klusterlet-addon-workmgr-5656cb958f-m8gw4_open-cluster-management-agent-addon(5399b003-7093-42ab-aa85-c56436fcbd53): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 28 00:03:55.335728 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:03:55.335364 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:03:56.490619 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:03:56.490551 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" podUID="c52e3ebd-1d20-43af-967b-1b254306fa0e" Jul 28 00:04:01.385339 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:04:01.385237 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls\") pod \"image-registry-6cbdf5498d-rphjl\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:04:01.385873 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:04:01.385356 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:04:01.385873 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:04:01.385368 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cbdf5498d-rphjl: secret "image-registry-tls" not found Jul 28 00:04:01.385873 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:04:01.385435 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls podName:c52e3ebd-1d20-43af-967b-1b254306fa0e nodeName:}" failed. No retries permitted until 2026-07-28 00:06:03.38541909 +0000 UTC m=+295.472430937 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls") pod "image-registry-6cbdf5498d-rphjl" (UID: "c52e3ebd-1d20-43af-967b-1b254306fa0e") : secret "image-registry-tls" not found Jul 28 00:04:01.493787 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:04:01.493759 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:04:06.494405 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:04:06.494219 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:04:10.493683 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:04:10.493643 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:04:17.495092 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:04:17.495014 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:04:29.494999 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:04:29.494962 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:04:43.494674 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:04:43.494637 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:04:56.494778 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:04:56.494663 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:05:07.494693 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:07.494540 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:05:20.305736 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:20.305699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs\") pod \"network-metrics-daemon-jqdhz\" (UID: \"ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71\") " pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:05:20.306221 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:20.305821 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 28 00:05:20.306221 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:20.305875 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs podName:ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71 nodeName:}" failed. No retries permitted until 2026-07-28 00:07:22.305860799 +0000 UTC m=+374.392872646 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs") pod "network-metrics-daemon-jqdhz" (UID: "ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71") : secret "metrics-daemon-secret" not found Jul 28 00:05:20.502525 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:20.502479 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cktm2"] Jul 28 00:05:20.504782 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:20.504763 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:20.507861 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:20.507824 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 00:05:20.508192 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:20.508156 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 00:05:20.509602 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:20.508728 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5zxjk\"" Jul 28 00:05:20.509602 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:20.508774 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 00:05:20.509602 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:20.508774 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 00:05:20.520755 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:20.520730 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cktm2"] Jul 28 00:05:20.608259 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:20.608233 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a3040796-37d1-4da9-921c-6353fa8f55b2-crio-socket\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:20.608351 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:20.608269 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3040796-37d1-4da9-921c-6353fa8f55b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:20.608351 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:20.608295 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3040796-37d1-4da9-921c-6353fa8f55b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:20.608434 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:20.608345 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p76vx\" (UniqueName: \"kubernetes.io/projected/a3040796-37d1-4da9-921c-6353fa8f55b2-kube-api-access-p76vx\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:20.608434 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:20.608398 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3040796-37d1-4da9-921c-6353fa8f55b2-data-volume\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:20.709007 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:20.708986 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a3040796-37d1-4da9-921c-6353fa8f55b2-crio-socket\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:20.709113 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:20.709018 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3040796-37d1-4da9-921c-6353fa8f55b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:20.709113 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:20.709042 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3040796-37d1-4da9-921c-6353fa8f55b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:20.709113 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:20.709057 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p76vx\" (UniqueName: \"kubernetes.io/projected/a3040796-37d1-4da9-921c-6353fa8f55b2-kube-api-access-p76vx\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:20.709113 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:20.709099 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3040796-37d1-4da9-921c-6353fa8f55b2-data-volume\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:20.709247 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:20.709123 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a3040796-37d1-4da9-921c-6353fa8f55b2-crio-socket\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:20.709247 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:20.709138 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 00:05:20.709247 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:20.709161 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:05:20.709247 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:20.709212 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a3040796-37d1-4da9-921c-6353fa8f55b2-kube-rbac-proxy-cm podName:a3040796-37d1-4da9-921c-6353fa8f55b2 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:21.209197225 +0000 UTC m=+253.296209071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a3040796-37d1-4da9-921c-6353fa8f55b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cktm2" (UID: "a3040796-37d1-4da9-921c-6353fa8f55b2") : configmap "kube-rbac-proxy" not found Jul 28 00:05:20.709247 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:20.709228 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3040796-37d1-4da9-921c-6353fa8f55b2-insights-runtime-extractor-tls podName:a3040796-37d1-4da9-921c-6353fa8f55b2 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:21.209221868 +0000 UTC m=+253.296233714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a3040796-37d1-4da9-921c-6353fa8f55b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cktm2" (UID: "a3040796-37d1-4da9-921c-6353fa8f55b2") : secret "insights-runtime-extractor-tls" not found Jul 28 00:05:20.709415 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:20.709393 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3040796-37d1-4da9-921c-6353fa8f55b2-data-volume\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:20.720614 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:20.720595 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p76vx\" (UniqueName: \"kubernetes.io/projected/a3040796-37d1-4da9-921c-6353fa8f55b2-kube-api-access-p76vx\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:21.211711 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:21.211677 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3040796-37d1-4da9-921c-6353fa8f55b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:21.211870 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:21.211793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3040796-37d1-4da9-921c-6353fa8f55b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:21.211870 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:21.211810 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 00:05:21.211987 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:21.211899 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a3040796-37d1-4da9-921c-6353fa8f55b2-kube-rbac-proxy-cm podName:a3040796-37d1-4da9-921c-6353fa8f55b2 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:22.211882004 +0000 UTC m=+254.298893851 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a3040796-37d1-4da9-921c-6353fa8f55b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cktm2" (UID: "a3040796-37d1-4da9-921c-6353fa8f55b2") : configmap "kube-rbac-proxy" not found Jul 28 00:05:21.211987 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:21.211932 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:05:21.212078 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:21.212002 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3040796-37d1-4da9-921c-6353fa8f55b2-insights-runtime-extractor-tls podName:a3040796-37d1-4da9-921c-6353fa8f55b2 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:22.211983421 +0000 UTC m=+254.298995331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a3040796-37d1-4da9-921c-6353fa8f55b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cktm2" (UID: "a3040796-37d1-4da9-921c-6353fa8f55b2") : secret "insights-runtime-extractor-tls" not found Jul 28 00:05:22.218977 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:22.218953 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3040796-37d1-4da9-921c-6353fa8f55b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:22.219361 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:22.218989 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3040796-37d1-4da9-921c-6353fa8f55b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:22.219361 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:22.219058 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 00:05:22.219361 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:22.219101 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:05:22.219361 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:22.219119 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a3040796-37d1-4da9-921c-6353fa8f55b2-kube-rbac-proxy-cm podName:a3040796-37d1-4da9-921c-6353fa8f55b2 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:24.219106549 +0000 UTC m=+256.306118396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a3040796-37d1-4da9-921c-6353fa8f55b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cktm2" (UID: "a3040796-37d1-4da9-921c-6353fa8f55b2") : configmap "kube-rbac-proxy" not found Jul 28 00:05:22.219361 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:22.219155 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3040796-37d1-4da9-921c-6353fa8f55b2-insights-runtime-extractor-tls podName:a3040796-37d1-4da9-921c-6353fa8f55b2 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:24.21914176 +0000 UTC m=+256.306153607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a3040796-37d1-4da9-921c-6353fa8f55b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cktm2" (UID: "a3040796-37d1-4da9-921c-6353fa8f55b2") : secret "insights-runtime-extractor-tls" not found Jul 28 00:05:23.298243 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:23.298188 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wj95q_35f7c804-20c6-4b56-91bc-e4e9546926f1/dns-node-resolver/0.log" Jul 28 00:05:23.487796 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:23.487757 2562 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc" Jul 28 00:05:23.487904 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:23.487859 2562 kuberuntime_manager.go:1459] "Unhandled Error" err="container acm-agent start failed in pod klusterlet-addon-workmgr-5656cb958f-m8gw4_open-cluster-management-agent-addon(5399b003-7093-42ab-aa85-c56436fcbd53): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 28 00:05:23.487964 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:23.487897 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:05:24.235424 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:24.235379 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3040796-37d1-4da9-921c-6353fa8f55b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:24.235601 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:24.235440 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3040796-37d1-4da9-921c-6353fa8f55b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:24.235601 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:24.235548 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:05:24.235601 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:24.235561 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 00:05:24.235731 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:24.235669 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3040796-37d1-4da9-921c-6353fa8f55b2-insights-runtime-extractor-tls podName:a3040796-37d1-4da9-921c-6353fa8f55b2 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:28.235646408 +0000 UTC m=+260.322658336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a3040796-37d1-4da9-921c-6353fa8f55b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cktm2" (UID: "a3040796-37d1-4da9-921c-6353fa8f55b2") : secret "insights-runtime-extractor-tls" not found Jul 28 00:05:24.235731 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:24.235686 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a3040796-37d1-4da9-921c-6353fa8f55b2-kube-rbac-proxy-cm podName:a3040796-37d1-4da9-921c-6353fa8f55b2 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:28.235679671 +0000 UTC m=+260.322691517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a3040796-37d1-4da9-921c-6353fa8f55b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cktm2" (UID: "a3040796-37d1-4da9-921c-6353fa8f55b2") : configmap "kube-rbac-proxy" not found Jul 28 00:05:24.699769 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:24.699747 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-psqlm_be369c59-0b1a-4743-a91e-6365573fe326/node-ca/0.log" Jul 28 00:05:25.098715 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:25.098687 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fvx4b_0bc6ef2e-56e8-4822-a0aa-72c4b47991e5/serve-healthcheck-canary/0.log" Jul 28 00:05:28.261718 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:28.261678 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3040796-37d1-4da9-921c-6353fa8f55b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:28.261718 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:28.261724 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3040796-37d1-4da9-921c-6353fa8f55b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:28.262257 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:28.261822 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 00:05:28.262257 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:28.261828 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:05:28.262257 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:28.261881 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a3040796-37d1-4da9-921c-6353fa8f55b2-kube-rbac-proxy-cm podName:a3040796-37d1-4da9-921c-6353fa8f55b2 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:36.261865706 +0000 UTC m=+268.348877552 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a3040796-37d1-4da9-921c-6353fa8f55b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cktm2" (UID: "a3040796-37d1-4da9-921c-6353fa8f55b2") : configmap "kube-rbac-proxy" not found Jul 28 00:05:28.262257 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:28.261898 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3040796-37d1-4da9-921c-6353fa8f55b2-insights-runtime-extractor-tls podName:a3040796-37d1-4da9-921c-6353fa8f55b2 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:36.261889068 +0000 UTC m=+268.348900915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a3040796-37d1-4da9-921c-6353fa8f55b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cktm2" (UID: "a3040796-37d1-4da9-921c-6353fa8f55b2") : secret "insights-runtime-extractor-tls" not found Jul 28 00:05:34.494849 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:34.494796 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:05:36.321772 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:36.321721 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3040796-37d1-4da9-921c-6353fa8f55b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:36.322261 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:36.321796 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3040796-37d1-4da9-921c-6353fa8f55b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:36.322261 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:36.322115 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:05:36.322261 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:36.322237 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3040796-37d1-4da9-921c-6353fa8f55b2-insights-runtime-extractor-tls podName:a3040796-37d1-4da9-921c-6353fa8f55b2 nodeName:}" failed. No retries permitted until 2026-07-28 00:05:52.32221258 +0000 UTC m=+284.409224482 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a3040796-37d1-4da9-921c-6353fa8f55b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cktm2" (UID: "a3040796-37d1-4da9-921c-6353fa8f55b2") : secret "insights-runtime-extractor-tls" not found Jul 28 00:05:36.322607 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:36.322558 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3040796-37d1-4da9-921c-6353fa8f55b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:43.835528 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:43.835482 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cbdf5498d-rphjl"] Jul 28 00:05:43.835966 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:43.835710 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" podUID="c52e3ebd-1d20-43af-967b-1b254306fa0e" Jul 28 00:05:44.424623 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.424594 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:05:44.431000 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.430974 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:05:44.482057 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.482037 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c52e3ebd-1d20-43af-967b-1b254306fa0e-image-registry-private-configuration\") pod \"c52e3ebd-1d20-43af-967b-1b254306fa0e\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " Jul 28 00:05:44.482188 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.482067 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-certificates\") pod \"c52e3ebd-1d20-43af-967b-1b254306fa0e\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " Jul 28 00:05:44.482188 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.482089 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c52e3ebd-1d20-43af-967b-1b254306fa0e-installation-pull-secrets\") pod \"c52e3ebd-1d20-43af-967b-1b254306fa0e\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " Jul 28 00:05:44.482188 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.482110 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-bound-sa-token\") pod \"c52e3ebd-1d20-43af-967b-1b254306fa0e\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " Jul 28 00:05:44.482188 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.482138 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c52e3ebd-1d20-43af-967b-1b254306fa0e-ca-trust-extracted\") pod \"c52e3ebd-1d20-43af-967b-1b254306fa0e\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " Jul 28 00:05:44.482188 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.482171 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c52e3ebd-1d20-43af-967b-1b254306fa0e-trusted-ca\") pod \"c52e3ebd-1d20-43af-967b-1b254306fa0e\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " Jul 28 00:05:44.482434 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.482200 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xd56p\" (UniqueName: \"kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-kube-api-access-xd56p\") pod \"c52e3ebd-1d20-43af-967b-1b254306fa0e\" (UID: \"c52e3ebd-1d20-43af-967b-1b254306fa0e\") " Jul 28 00:05:44.482606 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.482534 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c52e3ebd-1d20-43af-967b-1b254306fa0e" (UID: "c52e3ebd-1d20-43af-967b-1b254306fa0e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:05:44.482740 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.482685 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c52e3ebd-1d20-43af-967b-1b254306fa0e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c52e3ebd-1d20-43af-967b-1b254306fa0e" (UID: "c52e3ebd-1d20-43af-967b-1b254306fa0e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:05:44.482859 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.482727 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c52e3ebd-1d20-43af-967b-1b254306fa0e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c52e3ebd-1d20-43af-967b-1b254306fa0e" (UID: "c52e3ebd-1d20-43af-967b-1b254306fa0e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:05:44.484714 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.484687 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c52e3ebd-1d20-43af-967b-1b254306fa0e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c52e3ebd-1d20-43af-967b-1b254306fa0e" (UID: "c52e3ebd-1d20-43af-967b-1b254306fa0e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:05:44.484805 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.484723 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c52e3ebd-1d20-43af-967b-1b254306fa0e" (UID: "c52e3ebd-1d20-43af-967b-1b254306fa0e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:05:44.484805 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.484749 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c52e3ebd-1d20-43af-967b-1b254306fa0e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c52e3ebd-1d20-43af-967b-1b254306fa0e" (UID: "c52e3ebd-1d20-43af-967b-1b254306fa0e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:05:44.484805 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.484787 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-kube-api-access-xd56p" (OuterVolumeSpecName: "kube-api-access-xd56p") pod "c52e3ebd-1d20-43af-967b-1b254306fa0e" (UID: "c52e3ebd-1d20-43af-967b-1b254306fa0e"). InnerVolumeSpecName "kube-api-access-xd56p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:05:44.582868 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.582844 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c52e3ebd-1d20-43af-967b-1b254306fa0e-installation-pull-secrets\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:05:44.582868 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.582864 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-bound-sa-token\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:05:44.582979 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.582874 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c52e3ebd-1d20-43af-967b-1b254306fa0e-ca-trust-extracted\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:05:44.582979 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.582882 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c52e3ebd-1d20-43af-967b-1b254306fa0e-trusted-ca\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:05:44.582979 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.582890 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xd56p\" (UniqueName: \"kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-kube-api-access-xd56p\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:05:44.582979 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.582898 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c52e3ebd-1d20-43af-967b-1b254306fa0e-image-registry-private-configuration\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:05:44.582979 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:44.582907 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-certificates\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:05:45.428056 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:45.428024 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cbdf5498d-rphjl" Jul 28 00:05:45.460735 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:45.460702 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cbdf5498d-rphjl"] Jul 28 00:05:45.464108 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:45.464083 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6cbdf5498d-rphjl"] Jul 28 00:05:45.588986 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:45.588964 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c52e3ebd-1d20-43af-967b-1b254306fa0e-registry-tls\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:05:46.496990 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:46.496960 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c52e3ebd-1d20-43af-967b-1b254306fa0e" path="/var/lib/kubelet/pods/c52e3ebd-1d20-43af-967b-1b254306fa0e/volumes" Jul 28 00:05:49.494109 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:49.494072 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:05:51.085723 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:05:51.085672 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dvgml" podUID="f26cd91d-63b8-4b8c-94e6-6b3062ad83ee" Jul 28 00:05:51.449926 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:51.449848 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dvgml" Jul 28 00:05:52.335518 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:52.335481 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3040796-37d1-4da9-921c-6353fa8f55b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:52.337968 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:52.337948 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3040796-37d1-4da9-921c-6353fa8f55b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cktm2\" (UID: \"a3040796-37d1-4da9-921c-6353fa8f55b2\") " pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:52.616914 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:52.616847 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cktm2" Jul 28 00:05:52.745136 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:52.745112 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cktm2"] Jul 28 00:05:52.748589 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:05:52.748547 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3040796_37d1_4da9_921c_6353fa8f55b2.slice/crio-b86a5487c93a76df408e60f8b2b706d3432d242bdc71218badcfe9c71d1e36db WatchSource:0}: Error finding container b86a5487c93a76df408e60f8b2b706d3432d242bdc71218badcfe9c71d1e36db: Status 404 returned error can't find the container with id b86a5487c93a76df408e60f8b2b706d3432d242bdc71218badcfe9c71d1e36db Jul 28 00:05:53.458952 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:53.458871 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cktm2" event={"ID":"a3040796-37d1-4da9-921c-6353fa8f55b2","Type":"ContainerStarted","Data":"b86a5487c93a76df408e60f8b2b706d3432d242bdc71218badcfe9c71d1e36db"} Jul 28 00:05:54.151077 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:54.151042 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls\") pod \"dns-default-dvgml\" (UID: \"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee\") " pod="openshift-dns/dns-default-dvgml" Jul 28 00:05:54.153672 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:54.153649 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f26cd91d-63b8-4b8c-94e6-6b3062ad83ee-metrics-tls\") pod \"dns-default-dvgml\" (UID: \"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee\") " pod="openshift-dns/dns-default-dvgml" Jul 28 00:05:54.453435 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:54.453368 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wxjjr\"" Jul 28 00:05:54.461486 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:54.461453 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dvgml" Jul 28 00:05:54.599507 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:54.599477 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dvgml"] Jul 28 00:05:54.603546 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:05:54.603508 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26cd91d_63b8_4b8c_94e6_6b3062ad83ee.slice/crio-1ad18b5c47df656761517f066520fbdc68449e001bc230c7f1daba23a6330a4e WatchSource:0}: Error finding container 1ad18b5c47df656761517f066520fbdc68449e001bc230c7f1daba23a6330a4e: Status 404 returned error can't find the container with id 1ad18b5c47df656761517f066520fbdc68449e001bc230c7f1daba23a6330a4e Jul 28 00:05:55.467016 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:55.466982 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dvgml" event={"ID":"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee","Type":"ContainerStarted","Data":"1ad18b5c47df656761517f066520fbdc68449e001bc230c7f1daba23a6330a4e"} Jul 28 00:05:58.479248 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:58.479153 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cktm2" event={"ID":"a3040796-37d1-4da9-921c-6353fa8f55b2","Type":"ContainerStarted","Data":"7f3d293506175df04224160a68eb3b4d439b1c6df50827bebd22f54957750768"} Jul 28 00:05:58.481469 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:58.481437 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dvgml" event={"ID":"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee","Type":"ContainerStarted","Data":"942b567bfe53436fc3f2dcdb2b0771473edacb22e1bf45c854e12f27146a3f79"} Jul 28 00:05:58.481646 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:58.481492 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dvgml" event={"ID":"f26cd91d-63b8-4b8c-94e6-6b3062ad83ee","Type":"ContainerStarted","Data":"f131bdb6b99b4531f10a34053788faa98d99da17e0bbf43504d3115e44344e6b"} Jul 28 00:05:58.481742 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:58.481658 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dvgml" Jul 28 00:05:58.500858 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:05:58.500237 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dvgml" podStartSLOduration=250.999697605 podStartE2EDuration="4m14.500218799s" totalImagesPullingTime="3.500521194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:05:58.49953163 +0000 UTC m=+290.586543500" watchObservedRunningTime="2026-07-28 00:05:58.500218799 +0000 UTC m=+290.587230669" Jul 28 00:06:01.495751 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:01.492300 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cktm2" event={"ID":"a3040796-37d1-4da9-921c-6353fa8f55b2","Type":"ContainerStarted","Data":"03ee6ff7b4a5b697c89dd5877888142368f99dd17d71588eef2c7e9c0a59306e"} Jul 28 00:06:02.157768 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.157728 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv"] Jul 28 00:06:02.160839 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.160812 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" Jul 28 00:06:02.163435 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.163379 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 28 00:06:02.163833 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.163791 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 00:06:02.164239 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.164015 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 28 00:06:02.164239 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.164015 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4kgcj\"" Jul 28 00:06:02.164487 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.164466 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 00:06:02.164607 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.164523 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 00:06:02.164607 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.164523 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 28 00:06:02.172640 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.172621 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bmrmv"] Jul 28 00:06:02.175543 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.175524 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.178632 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.177882 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tt4cg\"" Jul 28 00:06:02.178632 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.178306 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 00:06:02.178838 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.178795 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 00:06:02.179126 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.179104 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 00:06:02.179774 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.179712 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv"] Jul 28 00:06:02.308365 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.308336 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d853349-6a1e-4cd2-b876-b2526ed4818a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-92zmv\" (UID: \"6d853349-6a1e-4cd2-b876-b2526ed4818a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" Jul 28 00:06:02.308509 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.308377 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d853349-6a1e-4cd2-b876-b2526ed4818a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-92zmv\" (UID: \"6d853349-6a1e-4cd2-b876-b2526ed4818a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" Jul 28 00:06:02.308509 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.308411 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdqfl\" (UniqueName: \"kubernetes.io/projected/6d853349-6a1e-4cd2-b876-b2526ed4818a-kube-api-access-fdqfl\") pod \"kube-state-metrics-56d9f944b4-92zmv\" (UID: \"6d853349-6a1e-4cd2-b876-b2526ed4818a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" Jul 28 00:06:02.308509 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.308471 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/462d9293-d0e2-413e-9f6e-1de73f69b5a7-node-exporter-wtmp\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.308673 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.308539 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d853349-6a1e-4cd2-b876-b2526ed4818a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-92zmv\" (UID: \"6d853349-6a1e-4cd2-b876-b2526ed4818a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" Jul 28 00:06:02.308673 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.308603 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/462d9293-d0e2-413e-9f6e-1de73f69b5a7-root\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.308673 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.308622 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/462d9293-d0e2-413e-9f6e-1de73f69b5a7-node-exporter-tls\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.308673 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.308643 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/462d9293-d0e2-413e-9f6e-1de73f69b5a7-metrics-client-ca\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.308673 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.308663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/462d9293-d0e2-413e-9f6e-1de73f69b5a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.308863 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.308695 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sthcx\" (UniqueName: \"kubernetes.io/projected/462d9293-d0e2-413e-9f6e-1de73f69b5a7-kube-api-access-sthcx\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.308863 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.308753 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/462d9293-d0e2-413e-9f6e-1de73f69b5a7-sys\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.308863 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.308787 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/462d9293-d0e2-413e-9f6e-1de73f69b5a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.308863 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.308842 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6d853349-6a1e-4cd2-b876-b2526ed4818a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-92zmv\" (UID: \"6d853349-6a1e-4cd2-b876-b2526ed4818a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" Jul 28 00:06:02.309031 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.308878 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6d853349-6a1e-4cd2-b876-b2526ed4818a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-92zmv\" (UID: \"6d853349-6a1e-4cd2-b876-b2526ed4818a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" Jul 28 00:06:02.309031 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.308910 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/462d9293-d0e2-413e-9f6e-1de73f69b5a7-node-exporter-textfile\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.409617 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.409530 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/462d9293-d0e2-413e-9f6e-1de73f69b5a7-root\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.409617 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.409566 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/462d9293-d0e2-413e-9f6e-1de73f69b5a7-node-exporter-tls\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.409617 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.409609 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/462d9293-d0e2-413e-9f6e-1de73f69b5a7-metrics-client-ca\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.409841 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.409631 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/462d9293-d0e2-413e-9f6e-1de73f69b5a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.409841 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.409648 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/462d9293-d0e2-413e-9f6e-1de73f69b5a7-root\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.409841 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:06:02.409724 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 00:06:02.409841 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:06:02.409801 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/462d9293-d0e2-413e-9f6e-1de73f69b5a7-node-exporter-tls podName:462d9293-d0e2-413e-9f6e-1de73f69b5a7 nodeName:}" failed. No retries permitted until 2026-07-28 00:06:02.909779774 +0000 UTC m=+294.996791625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/462d9293-d0e2-413e-9f6e-1de73f69b5a7-node-exporter-tls") pod "node-exporter-bmrmv" (UID: "462d9293-d0e2-413e-9f6e-1de73f69b5a7") : secret "node-exporter-tls" not found Jul 28 00:06:02.409841 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.409793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sthcx\" (UniqueName: \"kubernetes.io/projected/462d9293-d0e2-413e-9f6e-1de73f69b5a7-kube-api-access-sthcx\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.410152 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.409972 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/462d9293-d0e2-413e-9f6e-1de73f69b5a7-sys\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.410152 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.410007 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/462d9293-d0e2-413e-9f6e-1de73f69b5a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.410152 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.410038 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6d853349-6a1e-4cd2-b876-b2526ed4818a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-92zmv\" (UID: \"6d853349-6a1e-4cd2-b876-b2526ed4818a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" Jul 28 00:06:02.410152 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.410067 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6d853349-6a1e-4cd2-b876-b2526ed4818a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-92zmv\" (UID: \"6d853349-6a1e-4cd2-b876-b2526ed4818a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" Jul 28 00:06:02.410347 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.410214 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/462d9293-d0e2-413e-9f6e-1de73f69b5a7-metrics-client-ca\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.410347 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.410214 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/462d9293-d0e2-413e-9f6e-1de73f69b5a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.410347 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.410287 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/462d9293-d0e2-413e-9f6e-1de73f69b5a7-sys\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.410347 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.410316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/462d9293-d0e2-413e-9f6e-1de73f69b5a7-node-exporter-textfile\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.410554 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.410351 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d853349-6a1e-4cd2-b876-b2526ed4818a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-92zmv\" (UID: \"6d853349-6a1e-4cd2-b876-b2526ed4818a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" Jul 28 00:06:02.410554 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.410377 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d853349-6a1e-4cd2-b876-b2526ed4818a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-92zmv\" (UID: \"6d853349-6a1e-4cd2-b876-b2526ed4818a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" Jul 28 00:06:02.410554 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.410408 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdqfl\" (UniqueName: \"kubernetes.io/projected/6d853349-6a1e-4cd2-b876-b2526ed4818a-kube-api-access-fdqfl\") pod \"kube-state-metrics-56d9f944b4-92zmv\" (UID: \"6d853349-6a1e-4cd2-b876-b2526ed4818a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" Jul 28 00:06:02.410554 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.410428 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6d853349-6a1e-4cd2-b876-b2526ed4818a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-92zmv\" (UID: \"6d853349-6a1e-4cd2-b876-b2526ed4818a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" Jul 28 00:06:02.410554 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.410443 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/462d9293-d0e2-413e-9f6e-1de73f69b5a7-node-exporter-wtmp\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.410554 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.410488 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d853349-6a1e-4cd2-b876-b2526ed4818a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-92zmv\" (UID: \"6d853349-6a1e-4cd2-b876-b2526ed4818a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" Jul 28 00:06:02.410876 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.410722 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/462d9293-d0e2-413e-9f6e-1de73f69b5a7-node-exporter-textfile\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.411169 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.410933 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6d853349-6a1e-4cd2-b876-b2526ed4818a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-92zmv\" (UID: \"6d853349-6a1e-4cd2-b876-b2526ed4818a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" Jul 28 00:06:02.411169 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.411071 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/462d9293-d0e2-413e-9f6e-1de73f69b5a7-node-exporter-wtmp\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.411169 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.411104 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d853349-6a1e-4cd2-b876-b2526ed4818a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-92zmv\" (UID: \"6d853349-6a1e-4cd2-b876-b2526ed4818a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" Jul 28 00:06:02.412893 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.412871 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/462d9293-d0e2-413e-9f6e-1de73f69b5a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.413293 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.413265 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d853349-6a1e-4cd2-b876-b2526ed4818a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-92zmv\" (UID: \"6d853349-6a1e-4cd2-b876-b2526ed4818a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" Jul 28 00:06:02.413634 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.413613 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d853349-6a1e-4cd2-b876-b2526ed4818a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-92zmv\" (UID: \"6d853349-6a1e-4cd2-b876-b2526ed4818a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" Jul 28 00:06:02.418748 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.418727 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sthcx\" (UniqueName: \"kubernetes.io/projected/462d9293-d0e2-413e-9f6e-1de73f69b5a7-kube-api-access-sthcx\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.419271 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.419232 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdqfl\" (UniqueName: \"kubernetes.io/projected/6d853349-6a1e-4cd2-b876-b2526ed4818a-kube-api-access-fdqfl\") pod \"kube-state-metrics-56d9f944b4-92zmv\" (UID: \"6d853349-6a1e-4cd2-b876-b2526ed4818a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" Jul 28 00:06:02.471548 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.471520 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" Jul 28 00:06:02.612328 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.612296 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv"] Jul 28 00:06:02.616148 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:06:02.616114 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d853349_6a1e_4cd2_b876_b2526ed4818a.slice/crio-bf987019590db9468c96c255837735844c8443e5f6dc43516b79bfbbe5c19c04 WatchSource:0}: Error finding container bf987019590db9468c96c255837735844c8443e5f6dc43516b79bfbbe5c19c04: Status 404 returned error can't find the container with id bf987019590db9468c96c255837735844c8443e5f6dc43516b79bfbbe5c19c04 Jul 28 00:06:02.914277 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:02.914245 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/462d9293-d0e2-413e-9f6e-1de73f69b5a7-node-exporter-tls\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:02.914474 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:06:02.914377 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 00:06:02.914474 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:06:02.914446 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/462d9293-d0e2-413e-9f6e-1de73f69b5a7-node-exporter-tls podName:462d9293-d0e2-413e-9f6e-1de73f69b5a7 nodeName:}" failed. No retries permitted until 2026-07-28 00:06:03.914427082 +0000 UTC m=+296.001438928 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/462d9293-d0e2-413e-9f6e-1de73f69b5a7-node-exporter-tls") pod "node-exporter-bmrmv" (UID: "462d9293-d0e2-413e-9f6e-1de73f69b5a7") : secret "node-exporter-tls" not found Jul 28 00:06:03.494751 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:06:03.494702 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:06:03.500605 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:03.500557 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" event={"ID":"6d853349-6a1e-4cd2-b876-b2526ed4818a","Type":"ContainerStarted","Data":"bf987019590db9468c96c255837735844c8443e5f6dc43516b79bfbbe5c19c04"} Jul 28 00:06:03.922409 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:03.922376 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/462d9293-d0e2-413e-9f6e-1de73f69b5a7-node-exporter-tls\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:03.924984 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:03.924958 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/462d9293-d0e2-413e-9f6e-1de73f69b5a7-node-exporter-tls\") pod \"node-exporter-bmrmv\" (UID: \"462d9293-d0e2-413e-9f6e-1de73f69b5a7\") " pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:03.986655 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:03.986633 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bmrmv" Jul 28 00:06:04.494341 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:06:04.494293 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jqdhz" podUID="ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71" Jul 28 00:06:04.522864 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:06:04.522836 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod462d9293_d0e2_413e_9f6e_1de73f69b5a7.slice/crio-5e80eb5d5cf3eac2c6b0731fb2c2334e3bb060d5b3314aab1ab11e62e1e44d65 WatchSource:0}: Error finding container 5e80eb5d5cf3eac2c6b0731fb2c2334e3bb060d5b3314aab1ab11e62e1e44d65: Status 404 returned error can't find the container with id 5e80eb5d5cf3eac2c6b0731fb2c2334e3bb060d5b3314aab1ab11e62e1e44d65 Jul 28 00:06:05.508257 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:05.508224 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cktm2" event={"ID":"a3040796-37d1-4da9-921c-6353fa8f55b2","Type":"ContainerStarted","Data":"d87e792247eda1833cc54a3f55868e479356a3d15a55d1a37bd710915af8c6f4"} Jul 28 00:06:05.509468 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:05.509444 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bmrmv" event={"ID":"462d9293-d0e2-413e-9f6e-1de73f69b5a7","Type":"ContainerStarted","Data":"5e80eb5d5cf3eac2c6b0731fb2c2334e3bb060d5b3314aab1ab11e62e1e44d65"} Jul 28 00:06:05.528063 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:05.528018 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cktm2" podStartSLOduration=33.819176727 podStartE2EDuration="45.528002021s" totalImagesPullingTime="11.708825294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:05:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:06:05.526769138 +0000 UTC m=+297.613781019" watchObservedRunningTime="2026-07-28 00:06:05.528002021 +0000 UTC m=+297.615013890" Jul 28 00:06:06.513936 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:06.513898 2562 generic.go:356] "Generic (PLEG): container finished" podID="462d9293-d0e2-413e-9f6e-1de73f69b5a7" containerID="fad945c0cf2b37ee54f8dfd3970847597149c12b029d016a650aa8482e3edd9c" exitCode=0 Jul 28 00:06:06.514421 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:06.513982 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bmrmv" event={"ID":"462d9293-d0e2-413e-9f6e-1de73f69b5a7","Type":"ContainerDied","Data":"fad945c0cf2b37ee54f8dfd3970847597149c12b029d016a650aa8482e3edd9c"} Jul 28 00:06:06.516175 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:06.516150 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" event={"ID":"6d853349-6a1e-4cd2-b876-b2526ed4818a","Type":"ContainerStarted","Data":"78415c8ca6fb1bdb2ba00970dfbeeb3970d8e0d4b5b88d66024d72556260fcd6"} Jul 28 00:06:06.516272 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:06.516201 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" event={"ID":"6d853349-6a1e-4cd2-b876-b2526ed4818a","Type":"ContainerStarted","Data":"a192a46b56909dc139eb42367219caf16f14cfdd92b73141914d9d03c84d87a1"} Jul 28 00:06:06.516272 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:06.516231 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" event={"ID":"6d853349-6a1e-4cd2-b876-b2526ed4818a","Type":"ContainerStarted","Data":"988df75deb6ef5d902510f824428b9c86c27365ec50c71d0c95d5d6d2f3bcaf2"} Jul 28 00:06:06.547974 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:06.547928 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-92zmv" podStartSLOduration=1.4319280540000001 podStartE2EDuration="4.547915034s" totalImagesPullingTime="3.11598698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:06:06.547423137 +0000 UTC m=+298.634435007" watchObservedRunningTime="2026-07-28 00:06:06.547915034 +0000 UTC m=+298.634926940" Jul 28 00:06:07.521288 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:07.521254 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bmrmv" event={"ID":"462d9293-d0e2-413e-9f6e-1de73f69b5a7","Type":"ContainerStarted","Data":"4edfa23d99fab02e3345c1a17d795e821affef50ea1ea27ea1b0947b2d2c35ef"} Jul 28 00:06:07.521658 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:07.521307 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bmrmv" event={"ID":"462d9293-d0e2-413e-9f6e-1de73f69b5a7","Type":"ContainerStarted","Data":"275caaef0afef8b4d47e6bda06379da1d0412e3bad9f8f47e5cb00f2d03df9e1"} Jul 28 00:06:07.539885 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:07.539844 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bmrmv" podStartSLOduration=4.234742079 podStartE2EDuration="5.539825814s" totalImagesPullingTime="1.212358144s" totalInitContainerRuntime="92.725591ms" isStatefulPod=true podCreationTimestamp="2026-07-28 00:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:06:07.538614627 +0000 UTC m=+299.625626496" watchObservedRunningTime="2026-07-28 00:06:07.539825814 +0000 UTC m=+299.626837682" Jul 28 00:06:08.318924 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.318896 2562 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 00:06:08.404743 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.404713 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 00:06:08.408376 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.408359 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.411045 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.411028 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 00:06:08.411164 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.411150 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 00:06:08.411292 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.411278 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 00:06:08.411447 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.411436 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 00:06:08.411788 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.411758 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 00:06:08.411788 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.411778 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 00:06:08.411959 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.411825 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 00:06:08.411959 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.411852 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 00:06:08.411959 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.411782 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 00:06:08.411959 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.411872 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 00:06:08.411959 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.411905 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-39g1lsr6rcjgi\"" Jul 28 00:06:08.411959 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.411780 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 00:06:08.417001 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.416979 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 00:06:08.417083 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.417050 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sbltp\"" Jul 28 00:06:08.417407 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.417387 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 00:06:08.417788 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.417766 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 00:06:08.421018 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.421002 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 00:06:08.429437 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.429419 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 00:06:08.487018 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.486915 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dvgml" Jul 28 00:06:08.556960 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.556929 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-web-config\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.556960 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.556961 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.557419 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.556985 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fec428cd-87d2-41d8-a3ea-c71151f543cf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.557419 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.557003 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.557419 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.557084 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.557419 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.557127 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.557419 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.557166 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.557419 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.557197 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.557419 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.557228 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.557419 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.557260 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fec428cd-87d2-41d8-a3ea-c71151f543cf-config-out\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.557419 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.557285 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb265\" (UniqueName: \"kubernetes.io/projected/fec428cd-87d2-41d8-a3ea-c71151f543cf-kube-api-access-jb265\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.557419 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.557313 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.557419 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.557338 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.557419 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.557362 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.557419 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.557391 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.557866 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.557427 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-config\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.557866 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.557469 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.557866 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.557489 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.557866 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.557506 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.557866 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.557565 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.658346 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.658324 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.658346 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.658348 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-web-config\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.658531 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.658368 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.658531 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.658436 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fec428cd-87d2-41d8-a3ea-c71151f543cf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.658531 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.658473 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.658531 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.658509 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.658772 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.658542 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.658772 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.658601 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.658772 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.658631 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.658772 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.658657 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.658772 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.658686 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fec428cd-87d2-41d8-a3ea-c71151f543cf-config-out\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.658772 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.658713 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb265\" (UniqueName: \"kubernetes.io/projected/fec428cd-87d2-41d8-a3ea-c71151f543cf-kube-api-access-jb265\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.658772 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.658744 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.659107 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.658772 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.659107 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.658830 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.659107 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.658864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.659107 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.658891 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-config\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.659107 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.658990 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.659107 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.659021 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.659107 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.659051 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.659471 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.659448 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.659536 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.659485 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.659536 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.659506 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.659667 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.659547 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.660160 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.660135 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.660811 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.660731 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.661212 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.661190 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-web-config\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.662472 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.662446 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.662629 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.662431 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.663238 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.662440 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.663325 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.662932 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.663325 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.663251 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.663796 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.663755 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fec428cd-87d2-41d8-a3ea-c71151f543cf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.663941 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.663915 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.664317 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.664295 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.665329 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.665305 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.665404 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.665313 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-config\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.665404 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.665348 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fec428cd-87d2-41d8-a3ea-c71151f543cf-config-out\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.665470 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.665431 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.673367 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.673346 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb265\" (UniqueName: \"kubernetes.io/projected/fec428cd-87d2-41d8-a3ea-c71151f543cf-kube-api-access-jb265\") pod \"prometheus-k8s-0\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.719258 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.719242 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:08.853451 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:08.853354 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 00:06:08.864182 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:06:08.862058 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfec428cd_87d2_41d8_a3ea_c71151f543cf.slice/crio-a611054d3e21b178714979f12fd472ba4c66a38dfa89dc0fee2b03e2e4ae4950 WatchSource:0}: Error finding container a611054d3e21b178714979f12fd472ba4c66a38dfa89dc0fee2b03e2e4ae4950: Status 404 returned error can't find the container with id a611054d3e21b178714979f12fd472ba4c66a38dfa89dc0fee2b03e2e4ae4950 Jul 28 00:06:09.529445 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:09.529408 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fec428cd-87d2-41d8-a3ea-c71151f543cf","Type":"ContainerStarted","Data":"a611054d3e21b178714979f12fd472ba4c66a38dfa89dc0fee2b03e2e4ae4950"} Jul 28 00:06:10.537914 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:10.537886 2562 generic.go:356] "Generic (PLEG): container finished" podID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerID="c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178" exitCode=0 Jul 28 00:06:10.538252 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:10.537963 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fec428cd-87d2-41d8-a3ea-c71151f543cf","Type":"ContainerDied","Data":"c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178"} Jul 28 00:06:10.539421 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:10.539406 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 00:06:13.551604 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:13.551551 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fec428cd-87d2-41d8-a3ea-c71151f543cf","Type":"ContainerStarted","Data":"c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124"} Jul 28 00:06:14.557761 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:14.557718 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fec428cd-87d2-41d8-a3ea-c71151f543cf","Type":"ContainerStarted","Data":"757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6"} Jul 28 00:06:15.564427 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:15.564365 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fec428cd-87d2-41d8-a3ea-c71151f543cf","Type":"ContainerStarted","Data":"9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b"} Jul 28 00:06:15.564838 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:15.564441 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fec428cd-87d2-41d8-a3ea-c71151f543cf","Type":"ContainerStarted","Data":"f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311"} Jul 28 00:06:15.564838 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:15.564482 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fec428cd-87d2-41d8-a3ea-c71151f543cf","Type":"ContainerStarted","Data":"8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87"} Jul 28 00:06:15.564838 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:15.564530 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fec428cd-87d2-41d8-a3ea-c71151f543cf","Type":"ContainerStarted","Data":"63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5"} Jul 28 00:06:15.596975 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:15.596885 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.003593768 podStartE2EDuration="7.59686444s" totalImagesPullingTime="5.575851297s" totalInitContainerRuntime="17.419375ms" isStatefulPod=false podCreationTimestamp="2026-07-28 00:06:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:06:15.59533943 +0000 UTC m=+307.682351300" watchObservedRunningTime="2026-07-28 00:06:15.59686444 +0000 UTC m=+307.683876311" Jul 28 00:06:16.493807 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:16.493776 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:06:18.496419 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:06:18.496312 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:06:18.719916 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:18.719891 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:06:23.629064 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:23.629021 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" podUID="001742e4-80de-4d59-b219-3c32394e707a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 28 00:06:31.495292 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:06:31.495247 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:06:33.629253 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:33.629209 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" podUID="001742e4-80de-4d59-b219-3c32394e707a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 28 00:06:42.494907 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:06:42.494870 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:06:43.629179 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:43.629135 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" podUID="001742e4-80de-4d59-b219-3c32394e707a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 28 00:06:43.629660 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:43.629223 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" Jul 28 00:06:43.629865 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:43.629830 2562 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"e7a4581733577f9393e667a3881429a6257b77a981060030d42a2c96d58e228a"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 28 00:06:43.629937 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:43.629895 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" podUID="001742e4-80de-4d59-b219-3c32394e707a" containerName="service-proxy" containerID="cri-o://e7a4581733577f9393e667a3881429a6257b77a981060030d42a2c96d58e228a" gracePeriod=30 Jul 28 00:06:44.668821 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:44.668786 2562 generic.go:356] "Generic (PLEG): container finished" podID="001742e4-80de-4d59-b219-3c32394e707a" containerID="e7a4581733577f9393e667a3881429a6257b77a981060030d42a2c96d58e228a" exitCode=2 Jul 28 00:06:44.669233 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:44.668828 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" event={"ID":"001742e4-80de-4d59-b219-3c32394e707a","Type":"ContainerDied","Data":"e7a4581733577f9393e667a3881429a6257b77a981060030d42a2c96d58e228a"} Jul 28 00:06:44.669233 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:06:44.668862 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c67448cfc-cgr2n" event={"ID":"001742e4-80de-4d59-b219-3c32394e707a","Type":"ContainerStarted","Data":"2b52fa0c9fdb41da5406aca7dd3febf14c58699668829d41a4ad98ede107def8"} Jul 28 00:06:56.494770 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:06:56.494681 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:07:07.495068 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:07:07.494995 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:07:08.719497 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:08.719467 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:08.740542 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:08.740516 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:08.766813 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:08.766790 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:21.494844 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:07:21.494807 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:07:22.377387 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:22.377350 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs\") pod \"network-metrics-daemon-jqdhz\" (UID: \"ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71\") " pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:07:22.380090 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:22.380055 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71-metrics-certs\") pod \"network-metrics-daemon-jqdhz\" (UID: \"ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71\") " pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:07:22.496635 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:22.496609 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-shf5w\"" Jul 28 00:07:22.505381 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:22.505359 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqdhz" Jul 28 00:07:22.640886 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:22.640819 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jqdhz"] Jul 28 00:07:22.644510 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:07:22.644482 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce0e5ef5_3be4_4ebe_bf9d_29124fc6fe71.slice/crio-83248ad4e3b96393e90989d779bf8ecf314f4ef2846c83fc118586bac68016c1 WatchSource:0}: Error finding container 83248ad4e3b96393e90989d779bf8ecf314f4ef2846c83fc118586bac68016c1: Status 404 returned error can't find the container with id 83248ad4e3b96393e90989d779bf8ecf314f4ef2846c83fc118586bac68016c1 Jul 28 00:07:22.801032 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:22.800995 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jqdhz" event={"ID":"ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71","Type":"ContainerStarted","Data":"83248ad4e3b96393e90989d779bf8ecf314f4ef2846c83fc118586bac68016c1"} Jul 28 00:07:23.806462 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:23.806426 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jqdhz" event={"ID":"ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71","Type":"ContainerStarted","Data":"6ce617e84d9653994df8146765f9c4ab7058c58d987104623fbf01948fe7411a"} Jul 28 00:07:23.806824 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:23.806508 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jqdhz" event={"ID":"ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71","Type":"ContainerStarted","Data":"177e7dcb358f5fd7792822a8ca62b75c95132c83c320e83904af36c10167e7fc"} Jul 28 00:07:23.823269 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:23.823217 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jqdhz" podStartSLOduration=374.88718558 podStartE2EDuration="6m15.823200703s" totalImagesPullingTime="936.015123ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:07:23.822687643 +0000 UTC m=+375.909699511" watchObservedRunningTime="2026-07-28 00:07:23.823200703 +0000 UTC m=+375.910212579" Jul 28 00:07:26.891010 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:26.890978 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 00:07:26.891430 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:26.891262 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="prometheus" containerID="cri-o://c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124" gracePeriod=600 Jul 28 00:07:26.891430 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:26.891304 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="thanos-sidecar" containerID="cri-o://63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5" gracePeriod=600 Jul 28 00:07:26.891430 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:26.891304 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="kube-rbac-proxy" containerID="cri-o://f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311" gracePeriod=600 Jul 28 00:07:26.891430 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:26.891353 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b" gracePeriod=600 Jul 28 00:07:26.891430 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:26.891363 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="kube-rbac-proxy-web" containerID="cri-o://8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87" gracePeriod=600 Jul 28 00:07:26.891430 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:26.891402 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="config-reloader" containerID="cri-o://757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6" gracePeriod=600 Jul 28 00:07:27.129310 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.129289 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:27.217380 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.217319 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fec428cd-87d2-41d8-a3ea-c71151f543cf-config-out\") pod \"fec428cd-87d2-41d8-a3ea-c71151f543cf\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " Jul 28 00:07:27.217380 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.217351 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-web-config\") pod \"fec428cd-87d2-41d8-a3ea-c71151f543cf\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " Jul 28 00:07:27.217380 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.217370 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-thanos-prometheus-http-client-file\") pod \"fec428cd-87d2-41d8-a3ea-c71151f543cf\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " Jul 28 00:07:27.217661 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.217390 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-configmap-metrics-client-ca\") pod \"fec428cd-87d2-41d8-a3ea-c71151f543cf\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " Jul 28 00:07:27.217661 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.217407 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-configmap-serving-certs-ca-bundle\") pod \"fec428cd-87d2-41d8-a3ea-c71151f543cf\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " Jul 28 00:07:27.217661 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.217429 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-db\") pod \"fec428cd-87d2-41d8-a3ea-c71151f543cf\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " Jul 28 00:07:27.217661 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.217464 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fec428cd-87d2-41d8-a3ea-c71151f543cf-tls-assets\") pod \"fec428cd-87d2-41d8-a3ea-c71151f543cf\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " Jul 28 00:07:27.217661 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.217493 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-rulefiles-1\") pod \"fec428cd-87d2-41d8-a3ea-c71151f543cf\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " Jul 28 00:07:27.217661 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.217518 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jb265\" (UniqueName: \"kubernetes.io/projected/fec428cd-87d2-41d8-a3ea-c71151f543cf-kube-api-access-jb265\") pod \"fec428cd-87d2-41d8-a3ea-c71151f543cf\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " Jul 28 00:07:27.217661 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.217553 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-kube-rbac-proxy\") pod \"fec428cd-87d2-41d8-a3ea-c71151f543cf\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " Jul 28 00:07:27.217661 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.217603 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-metrics-client-certs\") pod \"fec428cd-87d2-41d8-a3ea-c71151f543cf\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " Jul 28 00:07:27.217661 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.217634 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-configmap-kubelet-serving-ca-bundle\") pod \"fec428cd-87d2-41d8-a3ea-c71151f543cf\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " Jul 28 00:07:27.217661 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.217658 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-trusted-ca-bundle\") pod \"fec428cd-87d2-41d8-a3ea-c71151f543cf\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " Jul 28 00:07:27.218309 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.217679 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-config\") pod \"fec428cd-87d2-41d8-a3ea-c71151f543cf\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " Jul 28 00:07:27.218309 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.217708 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-rulefiles-2\") pod \"fec428cd-87d2-41d8-a3ea-c71151f543cf\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " Jul 28 00:07:27.218309 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.217740 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-prometheus-k8s-tls\") pod \"fec428cd-87d2-41d8-a3ea-c71151f543cf\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " Jul 28 00:07:27.218309 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.217768 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"fec428cd-87d2-41d8-a3ea-c71151f543cf\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " Jul 28 00:07:27.218309 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.217811 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-rulefiles-0\") pod \"fec428cd-87d2-41d8-a3ea-c71151f543cf\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " Jul 28 00:07:27.218309 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.217834 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-grpc-tls\") pod \"fec428cd-87d2-41d8-a3ea-c71151f543cf\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " Jul 28 00:07:27.218309 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.217863 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"fec428cd-87d2-41d8-a3ea-c71151f543cf\" (UID: \"fec428cd-87d2-41d8-a3ea-c71151f543cf\") " Jul 28 00:07:27.219619 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.217822 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "fec428cd-87d2-41d8-a3ea-c71151f543cf" (UID: "fec428cd-87d2-41d8-a3ea-c71151f543cf"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:07:27.219619 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.217851 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "fec428cd-87d2-41d8-a3ea-c71151f543cf" (UID: "fec428cd-87d2-41d8-a3ea-c71151f543cf"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:07:27.219619 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.219120 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "fec428cd-87d2-41d8-a3ea-c71151f543cf" (UID: "fec428cd-87d2-41d8-a3ea-c71151f543cf"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:07:27.219619 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.219371 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "fec428cd-87d2-41d8-a3ea-c71151f543cf" (UID: "fec428cd-87d2-41d8-a3ea-c71151f543cf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:07:27.219619 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.219428 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "fec428cd-87d2-41d8-a3ea-c71151f543cf" (UID: "fec428cd-87d2-41d8-a3ea-c71151f543cf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:07:27.221306 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.220950 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "fec428cd-87d2-41d8-a3ea-c71151f543cf" (UID: "fec428cd-87d2-41d8-a3ea-c71151f543cf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:07:27.221306 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.221226 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "fec428cd-87d2-41d8-a3ea-c71151f543cf" (UID: "fec428cd-87d2-41d8-a3ea-c71151f543cf"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:07:27.221517 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.221322 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "fec428cd-87d2-41d8-a3ea-c71151f543cf" (UID: "fec428cd-87d2-41d8-a3ea-c71151f543cf"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:07:27.221600 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.221526 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "fec428cd-87d2-41d8-a3ea-c71151f543cf" (UID: "fec428cd-87d2-41d8-a3ea-c71151f543cf"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:07:27.221763 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.221728 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fec428cd-87d2-41d8-a3ea-c71151f543cf-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "fec428cd-87d2-41d8-a3ea-c71151f543cf" (UID: "fec428cd-87d2-41d8-a3ea-c71151f543cf"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:07:27.222022 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.221928 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fec428cd-87d2-41d8-a3ea-c71151f543cf-config-out" (OuterVolumeSpecName: "config-out") pod "fec428cd-87d2-41d8-a3ea-c71151f543cf" (UID: "fec428cd-87d2-41d8-a3ea-c71151f543cf"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:07:27.222099 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.222073 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "fec428cd-87d2-41d8-a3ea-c71151f543cf" (UID: "fec428cd-87d2-41d8-a3ea-c71151f543cf"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:07:27.222155 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.222119 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-config" (OuterVolumeSpecName: "config") pod "fec428cd-87d2-41d8-a3ea-c71151f543cf" (UID: "fec428cd-87d2-41d8-a3ea-c71151f543cf"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:07:27.222239 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.222215 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "fec428cd-87d2-41d8-a3ea-c71151f543cf" (UID: "fec428cd-87d2-41d8-a3ea-c71151f543cf"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:07:27.222650 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.222627 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "fec428cd-87d2-41d8-a3ea-c71151f543cf" (UID: "fec428cd-87d2-41d8-a3ea-c71151f543cf"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:07:27.223245 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.223223 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fec428cd-87d2-41d8-a3ea-c71151f543cf-kube-api-access-jb265" (OuterVolumeSpecName: "kube-api-access-jb265") pod "fec428cd-87d2-41d8-a3ea-c71151f543cf" (UID: "fec428cd-87d2-41d8-a3ea-c71151f543cf"). InnerVolumeSpecName "kube-api-access-jb265". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:07:27.223776 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.223698 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "fec428cd-87d2-41d8-a3ea-c71151f543cf" (UID: "fec428cd-87d2-41d8-a3ea-c71151f543cf"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:07:27.223776 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.223785 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "fec428cd-87d2-41d8-a3ea-c71151f543cf" (UID: "fec428cd-87d2-41d8-a3ea-c71151f543cf"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:07:27.223776 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.223801 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "fec428cd-87d2-41d8-a3ea-c71151f543cf" (UID: "fec428cd-87d2-41d8-a3ea-c71151f543cf"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:07:27.230671 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.230647 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-web-config" (OuterVolumeSpecName: "web-config") pod "fec428cd-87d2-41d8-a3ea-c71151f543cf" (UID: "fec428cd-87d2-41d8-a3ea-c71151f543cf"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:07:27.319314 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.319289 2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-kube-rbac-proxy\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:07:27.319314 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.319311 2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-metrics-client-certs\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:07:27.319469 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.319325 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:07:27.319469 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.319338 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:07:27.319469 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.319352 2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-config\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:07:27.319469 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.319364 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:07:27.319469 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.319377 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:07:27.319469 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.319391 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:07:27.319469 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.319406 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:07:27.319469 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.319418 2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-grpc-tls\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:07:27.319469 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.319431 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:07:27.319469 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.319444 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fec428cd-87d2-41d8-a3ea-c71151f543cf-config-out\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:07:27.319469 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.319458 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-web-config\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:07:27.319469 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.319470 2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fec428cd-87d2-41d8-a3ea-c71151f543cf-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:07:27.319874 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.319483 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-configmap-metrics-client-ca\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:07:27.319874 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.319496 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:07:27.319874 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.319520 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-db\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:07:27.319874 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.319532 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fec428cd-87d2-41d8-a3ea-c71151f543cf-tls-assets\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:07:27.319874 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.319546 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fec428cd-87d2-41d8-a3ea-c71151f543cf-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:07:27.319874 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.319560 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jb265\" (UniqueName: \"kubernetes.io/projected/fec428cd-87d2-41d8-a3ea-c71151f543cf-kube-api-access-jb265\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\"" Jul 28 00:07:27.827952 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.827922 2562 generic.go:356] "Generic (PLEG): container finished" podID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerID="9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b" exitCode=0 Jul 28 00:07:27.827952 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.827945 2562 generic.go:356] "Generic (PLEG): container finished" podID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerID="f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311" exitCode=0 Jul 28 00:07:27.827952 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.827955 2562 generic.go:356] "Generic (PLEG): container finished" podID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerID="8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87" exitCode=0 Jul 28 00:07:27.828145 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.827961 2562 generic.go:356] "Generic (PLEG): container finished" podID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerID="63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5" exitCode=0 Jul 28 00:07:27.828145 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.827969 2562 generic.go:356] "Generic (PLEG): container finished" podID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerID="757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6" exitCode=0 Jul 28 00:07:27.828145 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.827975 2562 generic.go:356] "Generic (PLEG): container finished" podID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerID="c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124" exitCode=0 Jul 28 00:07:27.828145 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.828002 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:27.828145 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.828006 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fec428cd-87d2-41d8-a3ea-c71151f543cf","Type":"ContainerDied","Data":"9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b"} Jul 28 00:07:27.828145 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.828085 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fec428cd-87d2-41d8-a3ea-c71151f543cf","Type":"ContainerDied","Data":"f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311"} Jul 28 00:07:27.828145 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.828116 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fec428cd-87d2-41d8-a3ea-c71151f543cf","Type":"ContainerDied","Data":"8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87"} Jul 28 00:07:27.828145 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.828147 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fec428cd-87d2-41d8-a3ea-c71151f543cf","Type":"ContainerDied","Data":"63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5"} Jul 28 00:07:27.828441 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.828162 2562 scope.go:117] "RemoveContainer" containerID="9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b" Jul 28 00:07:27.828441 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.828189 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fec428cd-87d2-41d8-a3ea-c71151f543cf","Type":"ContainerDied","Data":"757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6"} Jul 28 00:07:27.828441 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.828229 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fec428cd-87d2-41d8-a3ea-c71151f543cf","Type":"ContainerDied","Data":"c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124"} Jul 28 00:07:27.828441 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.828270 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fec428cd-87d2-41d8-a3ea-c71151f543cf","Type":"ContainerDied","Data":"a611054d3e21b178714979f12fd472ba4c66a38dfa89dc0fee2b03e2e4ae4950"} Jul 28 00:07:27.840731 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.840714 2562 scope.go:117] "RemoveContainer" containerID="f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311" Jul 28 00:07:27.847905 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.847887 2562 scope.go:117] "RemoveContainer" containerID="8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87" Jul 28 00:07:27.854819 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.854803 2562 scope.go:117] "RemoveContainer" containerID="63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5" Jul 28 00:07:27.861297 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.861278 2562 scope.go:117] "RemoveContainer" containerID="757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6" Jul 28 00:07:27.867503 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.867481 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 00:07:27.869135 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.869121 2562 scope.go:117] "RemoveContainer" containerID="c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124" Jul 28 00:07:27.876245 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.876226 2562 scope.go:117] "RemoveContainer" containerID="c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178" Jul 28 00:07:27.879670 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.879649 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 00:07:27.882885 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.882867 2562 scope.go:117] "RemoveContainer" containerID="9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b" Jul 28 00:07:27.883172 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:07:27.883154 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b\": container with ID starting with 9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b not found: ID does not exist" containerID="9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b" Jul 28 00:07:27.883213 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.883180 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b"} err="failed to get container status \"9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b\": rpc error: code = NotFound desc = could not find container \"9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b\": container with ID starting with 9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b not found: ID does not exist" Jul 28 00:07:27.883213 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.883197 2562 scope.go:117] "RemoveContainer" containerID="f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311" Jul 28 00:07:27.883432 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:07:27.883414 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311\": container with ID starting with f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311 not found: ID does not exist" containerID="f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311" Jul 28 00:07:27.883469 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.883436 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311"} err="failed to get container status \"f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311\": rpc error: code = NotFound desc = could not find container \"f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311\": container with ID starting with f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311 not found: ID does not exist" Jul 28 00:07:27.883469 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.883449 2562 scope.go:117] "RemoveContainer" containerID="8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87" Jul 28 00:07:27.883694 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:07:27.883679 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87\": container with ID starting with 8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87 not found: ID does not exist" containerID="8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87" Jul 28 00:07:27.883750 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.883697 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87"} err="failed to get container status \"8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87\": rpc error: code = NotFound desc = could not find container \"8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87\": container with ID starting with 8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87 not found: ID does not exist" Jul 28 00:07:27.883750 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.883709 2562 scope.go:117] "RemoveContainer" containerID="63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5" Jul 28 00:07:27.883964 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:07:27.883946 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5\": container with ID starting with 63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5 not found: ID does not exist" containerID="63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5" Jul 28 00:07:27.884023 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.883969 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5"} err="failed to get container status \"63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5\": rpc error: code = NotFound desc = could not find container \"63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5\": container with ID starting with 63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5 not found: ID does not exist" Jul 28 00:07:27.884023 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.883987 2562 scope.go:117] "RemoveContainer" containerID="757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6" Jul 28 00:07:27.884236 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:07:27.884214 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6\": container with ID starting with 757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6 not found: ID does not exist" containerID="757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6" Jul 28 00:07:27.884294 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.884240 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6"} err="failed to get container status \"757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6\": rpc error: code = NotFound desc = could not find container \"757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6\": container with ID starting with 757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6 not found: ID does not exist" Jul 28 00:07:27.884294 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.884255 2562 scope.go:117] "RemoveContainer" containerID="c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124" Jul 28 00:07:27.884476 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:07:27.884460 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124\": container with ID starting with c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124 not found: ID does not exist" containerID="c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124" Jul 28 00:07:27.884512 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.884481 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124"} err="failed to get container status \"c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124\": rpc error: code = NotFound desc = could not find container \"c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124\": container with ID starting with c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124 not found: ID does not exist" Jul 28 00:07:27.884512 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.884496 2562 scope.go:117] "RemoveContainer" containerID="c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178" Jul 28 00:07:27.884743 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:07:27.884727 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178\": container with ID starting with c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178 not found: ID does not exist" containerID="c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178" Jul 28 00:07:27.884794 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.884747 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178"} err="failed to get container status \"c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178\": rpc error: code = NotFound desc = could not find container \"c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178\": container with ID starting with c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178 not found: ID does not exist" Jul 28 00:07:27.884794 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.884760 2562 scope.go:117] "RemoveContainer" containerID="9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b" Jul 28 00:07:27.884991 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.884972 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b"} err="failed to get container status \"9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b\": rpc error: code = NotFound desc = could not find container \"9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b\": container with ID starting with 9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b not found: ID does not exist" Jul 28 00:07:27.885040 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.884991 2562 scope.go:117] "RemoveContainer" containerID="f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311" Jul 28 00:07:27.885234 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.885219 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311"} err="failed to get container status \"f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311\": rpc error: code = NotFound desc = could not find container \"f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311\": container with ID starting with f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311 not found: ID does not exist" Jul 28 00:07:27.885234 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.885233 2562 scope.go:117] "RemoveContainer" containerID="8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87" Jul 28 00:07:27.885442 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.885428 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87"} err="failed to get container status \"8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87\": rpc error: code = NotFound desc = could not find container \"8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87\": container with ID starting with 8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87 not found: ID does not exist" Jul 28 00:07:27.885442 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.885441 2562 scope.go:117] "RemoveContainer" containerID="63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5" Jul 28 00:07:27.885650 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.885635 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5"} err="failed to get container status \"63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5\": rpc error: code = NotFound desc = could not find container \"63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5\": container with ID starting with 63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5 not found: ID does not exist" Jul 28 00:07:27.885650 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.885649 2562 scope.go:117] "RemoveContainer" containerID="757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6" Jul 28 00:07:27.885856 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.885838 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6"} err="failed to get container status \"757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6\": rpc error: code = NotFound desc = could not find container \"757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6\": container with ID starting with 757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6 not found: ID does not exist" Jul 28 00:07:27.885904 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.885856 2562 scope.go:117] "RemoveContainer" containerID="c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124" Jul 28 00:07:27.886062 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.886047 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124"} err="failed to get container status \"c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124\": rpc error: code = NotFound desc = could not find container \"c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124\": container with ID starting with c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124 not found: ID does not exist" Jul 28 00:07:27.886121 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.886062 2562 scope.go:117] "RemoveContainer" containerID="c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178" Jul 28 00:07:27.886247 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.886233 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178"} err="failed to get container status \"c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178\": rpc error: code = NotFound desc = could not find container \"c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178\": container with ID starting with c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178 not found: ID does not exist" Jul 28 00:07:27.886291 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.886246 2562 scope.go:117] "RemoveContainer" containerID="9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b" Jul 28 00:07:27.886469 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.886449 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b"} err="failed to get container status \"9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b\": rpc error: code = NotFound desc = could not find container \"9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b\": container with ID starting with 9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b not found: ID does not exist" Jul 28 00:07:27.886514 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.886470 2562 scope.go:117] "RemoveContainer" containerID="f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311" Jul 28 00:07:27.886742 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.886724 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311"} err="failed to get container status \"f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311\": rpc error: code = NotFound desc = could not find container \"f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311\": container with ID starting with f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311 not found: ID does not exist" Jul 28 00:07:27.886795 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.886743 2562 scope.go:117] "RemoveContainer" containerID="8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87" Jul 28 00:07:27.886958 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.886941 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87"} err="failed to get container status \"8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87\": rpc error: code = NotFound desc = could not find container \"8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87\": container with ID starting with 8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87 not found: ID does not exist" Jul 28 00:07:27.886999 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.886958 2562 scope.go:117] "RemoveContainer" containerID="63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5" Jul 28 00:07:27.887157 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.887141 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5"} err="failed to get container status \"63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5\": rpc error: code = NotFound desc = could not find container \"63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5\": container with ID starting with 63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5 not found: ID does not exist" Jul 28 00:07:27.887196 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.887158 2562 scope.go:117] "RemoveContainer" containerID="757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6" Jul 28 00:07:27.887351 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.887329 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6"} err="failed to get container status \"757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6\": rpc error: code = NotFound desc = could not find container \"757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6\": container with ID starting with 757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6 not found: ID does not exist" Jul 28 00:07:27.887392 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.887351 2562 scope.go:117] "RemoveContainer" containerID="c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124" Jul 28 00:07:27.887542 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.887525 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124"} err="failed to get container status \"c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124\": rpc error: code = NotFound desc = could not find container \"c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124\": container with ID starting with c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124 not found: ID does not exist" Jul 28 00:07:27.887601 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.887542 2562 scope.go:117] "RemoveContainer" containerID="c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178" Jul 28 00:07:27.887777 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.887761 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178"} err="failed to get container status \"c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178\": rpc error: code = NotFound desc = could not find container \"c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178\": container with ID starting with c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178 not found: ID does not exist" Jul 28 00:07:27.887822 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.887777 2562 scope.go:117] "RemoveContainer" containerID="9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b" Jul 28 00:07:27.888032 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.888012 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b"} err="failed to get container status \"9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b\": rpc error: code = NotFound desc = could not find container \"9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b\": container with ID starting with 9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b not found: ID does not exist" Jul 28 00:07:27.888083 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.888033 2562 scope.go:117] "RemoveContainer" containerID="f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311" Jul 28 00:07:27.888216 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.888201 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311"} err="failed to get container status \"f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311\": rpc error: code = NotFound desc = could not find container \"f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311\": container with ID starting with f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311 not found: ID does not exist" Jul 28 00:07:27.888259 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.888218 2562 scope.go:117] "RemoveContainer" containerID="8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87" Jul 28 00:07:27.888396 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.888379 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87"} err="failed to get container status \"8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87\": rpc error: code = NotFound desc = could not find container \"8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87\": container with ID starting with 8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87 not found: ID does not exist" Jul 28 00:07:27.888432 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.888396 2562 scope.go:117] "RemoveContainer" containerID="63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5" Jul 28 00:07:27.888568 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.888553 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5"} err="failed to get container status \"63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5\": rpc error: code = NotFound desc = could not find container \"63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5\": container with ID starting with 63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5 not found: ID does not exist" Jul 28 00:07:27.888568 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.888568 2562 scope.go:117] "RemoveContainer" containerID="757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6" Jul 28 00:07:27.888767 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.888750 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6"} err="failed to get container status \"757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6\": rpc error: code = NotFound desc = could not find container \"757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6\": container with ID starting with 757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6 not found: ID does not exist" Jul 28 00:07:27.888803 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.888767 2562 scope.go:117] "RemoveContainer" containerID="c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124" Jul 28 00:07:27.888939 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.888921 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124"} err="failed to get container status \"c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124\": rpc error: code = NotFound desc = could not find container \"c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124\": container with ID starting with c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124 not found: ID does not exist" Jul 28 00:07:27.888975 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.888939 2562 scope.go:117] "RemoveContainer" containerID="c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178" Jul 28 00:07:27.889110 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.889094 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178"} err="failed to get container status \"c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178\": rpc error: code = NotFound desc = could not find container \"c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178\": container with ID starting with c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178 not found: ID does not exist" Jul 28 00:07:27.889155 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.889111 2562 scope.go:117] "RemoveContainer" containerID="9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b" Jul 28 00:07:27.889258 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.889242 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b"} err="failed to get container status \"9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b\": rpc error: code = NotFound desc = could not find container \"9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b\": container with ID starting with 9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b not found: ID does not exist" Jul 28 00:07:27.889295 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.889258 2562 scope.go:117] "RemoveContainer" containerID="f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311" Jul 28 00:07:27.889442 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.889426 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311"} err="failed to get container status \"f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311\": rpc error: code = NotFound desc = could not find container \"f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311\": container with ID starting with f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311 not found: ID does not exist" Jul 28 00:07:27.889482 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.889441 2562 scope.go:117] "RemoveContainer" containerID="8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87" Jul 28 00:07:27.889653 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.889637 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87"} err="failed to get container status \"8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87\": rpc error: code = NotFound desc = could not find container \"8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87\": container with ID starting with 8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87 not found: ID does not exist" Jul 28 00:07:27.889704 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.889654 2562 scope.go:117] "RemoveContainer" containerID="63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5" Jul 28 00:07:27.889835 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.889820 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5"} err="failed to get container status \"63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5\": rpc error: code = NotFound desc = could not find container \"63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5\": container with ID starting with 63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5 not found: ID does not exist" Jul 28 00:07:27.889873 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.889835 2562 scope.go:117] "RemoveContainer" containerID="757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6" Jul 28 00:07:27.890041 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.890022 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6"} err="failed to get container status \"757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6\": rpc error: code = NotFound desc = could not find container \"757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6\": container with ID starting with 757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6 not found: ID does not exist" Jul 28 00:07:27.890083 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.890042 2562 scope.go:117] "RemoveContainer" containerID="c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124" Jul 28 00:07:27.890219 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.890204 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124"} err="failed to get container status \"c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124\": rpc error: code = NotFound desc = could not find container \"c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124\": container with ID starting with c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124 not found: ID does not exist" Jul 28 00:07:27.890219 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.890218 2562 scope.go:117] "RemoveContainer" containerID="c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178" Jul 28 00:07:27.890398 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.890382 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178"} err="failed to get container status \"c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178\": rpc error: code = NotFound desc = could not find container \"c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178\": container with ID starting with c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178 not found: ID does not exist" Jul 28 00:07:27.890437 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.890398 2562 scope.go:117] "RemoveContainer" containerID="9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b" Jul 28 00:07:27.890611 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.890555 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b"} err="failed to get container status \"9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b\": rpc error: code = NotFound desc = could not find container \"9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b\": container with ID starting with 9b397b7e3982093e8bdcf2c226ac7d29d33a4c6ab0dcb3592e3315c736149a4b not found: ID does not exist" Jul 28 00:07:27.890673 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.890619 2562 scope.go:117] "RemoveContainer" containerID="f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311" Jul 28 00:07:27.890838 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.890820 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311"} err="failed to get container status \"f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311\": rpc error: code = NotFound desc = could not find container \"f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311\": container with ID starting with f0c62c83825e2485c987dd82eef6b737134c9409674becb644dd10e49aa4c311 not found: ID does not exist" Jul 28 00:07:27.890874 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.890839 2562 scope.go:117] "RemoveContainer" containerID="8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87" Jul 28 00:07:27.891025 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.891009 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87"} err="failed to get container status \"8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87\": rpc error: code = NotFound desc = could not find container \"8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87\": container with ID starting with 8b51bde3ab545de76ea3f7f633ca593027f2d5b8f96a2abdfcb314f98ca04e87 not found: ID does not exist" Jul 28 00:07:27.891291 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.891026 2562 scope.go:117] "RemoveContainer" containerID="63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5" Jul 28 00:07:27.891291 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.891194 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5"} err="failed to get container status \"63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5\": rpc error: code = NotFound desc = could not find container \"63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5\": container with ID starting with 63e4911b36caf020a2a0b8dbc77c1e65d50adaec57a6572086f040d0421628f5 not found: ID does not exist" Jul 28 00:07:27.891291 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.891207 2562 scope.go:117] "RemoveContainer" containerID="757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6" Jul 28 00:07:27.891407 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.891371 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6"} err="failed to get container status \"757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6\": rpc error: code = NotFound desc = could not find container \"757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6\": container with ID starting with 757eea6329193573a79eb54a6e30c13239fd2a68e5e5feec519c47614f0b51b6 not found: ID does not exist" Jul 28 00:07:27.891407 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.891386 2562 scope.go:117] "RemoveContainer" containerID="c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124" Jul 28 00:07:27.891590 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.891555 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124"} err="failed to get container status \"c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124\": rpc error: code = NotFound desc = could not find container \"c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124\": container with ID starting with c3c1460e27751e8340da8295570d55b98b2bf94998d7e59d43c47e782a3b9124 not found: ID does not exist" Jul 28 00:07:27.891637 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.891595 2562 scope.go:117] "RemoveContainer" containerID="c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178" Jul 28 00:07:27.891842 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.891823 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178"} err="failed to get container status \"c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178\": rpc error: code = NotFound desc = could not find container \"c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178\": container with ID starting with c6e9ff9a95f67393bd068113a74d835577ba59557153f13523861e94ecf91178 not found: ID does not exist" Jul 28 00:07:27.930835 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.930810 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 00:07:27.931070 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.931058 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="kube-rbac-proxy" Jul 28 00:07:27.931110 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.931073 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="kube-rbac-proxy" Jul 28 00:07:27.931110 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.931080 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="kube-rbac-proxy-thanos" Jul 28 00:07:27.931110 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.931086 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="kube-rbac-proxy-thanos" Jul 28 00:07:27.931110 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.931096 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="prometheus" Jul 28 00:07:27.931110 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.931102 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="prometheus" Jul 28 00:07:27.931110 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.931109 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="kube-rbac-proxy-web" Jul 28 00:07:27.931301 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.931114 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="kube-rbac-proxy-web" Jul 28 00:07:27.931301 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.931124 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="init-config-reloader" Jul 28 00:07:27.931301 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.931128 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="init-config-reloader" Jul 28 00:07:27.931301 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.931134 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="config-reloader" Jul 28 00:07:27.931301 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.931139 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="config-reloader" Jul 28 00:07:27.931301 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.931146 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="thanos-sidecar" Jul 28 00:07:27.931301 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.931166 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="thanos-sidecar" Jul 28 00:07:27.931301 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.931201 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="kube-rbac-proxy-thanos" Jul 28 00:07:27.931301 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.931208 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="config-reloader" Jul 28 00:07:27.931301 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.931215 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="thanos-sidecar" Jul 28 00:07:27.931301 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.931220 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="kube-rbac-proxy-web" Jul 28 00:07:27.931301 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.931226 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="prometheus" Jul 28 00:07:27.931301 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.931231 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" containerName="kube-rbac-proxy" Jul 28 00:07:27.936195 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.936179 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:27.938425 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.938408 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 00:07:27.938495 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.938448 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 00:07:27.938706 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.938686 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 00:07:27.938759 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.938750 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 00:07:27.938968 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.938897 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 00:07:27.939051 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.938927 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 00:07:27.939051 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.939022 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 00:07:27.939188 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.939137 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-39g1lsr6rcjgi\"" Jul 28 00:07:27.939188 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.939176 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 00:07:27.939244 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.939232 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 00:07:27.939274 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.939248 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 00:07:27.939356 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.939342 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 00:07:27.939587 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.939559 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 00:07:27.939701 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.939688 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 00:07:27.939929 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.939913 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sbltp\"" Jul 28 00:07:27.944374 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.944355 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 00:07:27.946877 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.946861 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 00:07:27.958037 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:27.957977 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 00:07:28.024751 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.024730 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d47389f4-4eef-49e1-9d60-06e378e610ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.024841 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.024754 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d47389f4-4eef-49e1-9d60-06e378e610ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.024841 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.024770 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.024841 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.024791 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d47389f4-4eef-49e1-9d60-06e378e610ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.024841 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.024833 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.024968 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.024876 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.024968 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.024908 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.024968 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.024938 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.024968 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.024953 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d47389f4-4eef-49e1-9d60-06e378e610ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.025085 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.024975 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d47389f4-4eef-49e1-9d60-06e378e610ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.025085 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.024992 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-config\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.025085 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.025016 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d47389f4-4eef-49e1-9d60-06e378e610ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.025085 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.025037 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d47389f4-4eef-49e1-9d60-06e378e610ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.025085 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.025051 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.025085 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.025069 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d47389f4-4eef-49e1-9d60-06e378e610ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.025250 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.025111 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d47389f4-4eef-49e1-9d60-06e378e610ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.025250 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.025134 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms7bc\" (UniqueName: \"kubernetes.io/projected/d47389f4-4eef-49e1-9d60-06e378e610ed-kube-api-access-ms7bc\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.025250 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.025155 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d47389f4-4eef-49e1-9d60-06e378e610ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.025250 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.025175 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.025250 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.025194 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.126023 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.125975 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-config\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.126023 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.125997 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d47389f4-4eef-49e1-9d60-06e378e610ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.126023 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.126017 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d47389f4-4eef-49e1-9d60-06e378e610ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.126155 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.126033 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.126271 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.126250 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d47389f4-4eef-49e1-9d60-06e378e610ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.126316 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.126299 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d47389f4-4eef-49e1-9d60-06e378e610ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.126368 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.126327 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms7bc\" (UniqueName: \"kubernetes.io/projected/d47389f4-4eef-49e1-9d60-06e378e610ed-kube-api-access-ms7bc\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.126368 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.126356 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d47389f4-4eef-49e1-9d60-06e378e610ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.126467 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.126385 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.126467 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.126406 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.126610 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.126467 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d47389f4-4eef-49e1-9d60-06e378e610ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.126610 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.126491 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d47389f4-4eef-49e1-9d60-06e378e610ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.126610 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.126513 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.126610 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.126563 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d47389f4-4eef-49e1-9d60-06e378e610ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.126821 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.126613 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.126821 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.126642 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.126821 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.126680 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.126821 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.126707 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.126821 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.126731 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d47389f4-4eef-49e1-9d60-06e378e610ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.126821 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.126756 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d47389f4-4eef-49e1-9d60-06e378e610ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.127130 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.127108 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d47389f4-4eef-49e1-9d60-06e378e610ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.127183 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.127135 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d47389f4-4eef-49e1-9d60-06e378e610ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.127342 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.127315 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d47389f4-4eef-49e1-9d60-06e378e610ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.127899 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.127832 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d47389f4-4eef-49e1-9d60-06e378e610ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.128751 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.128729 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d47389f4-4eef-49e1-9d60-06e378e610ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.129387 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.129124 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d47389f4-4eef-49e1-9d60-06e378e610ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.129387 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.129240 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.129387 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.129357 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d47389f4-4eef-49e1-9d60-06e378e610ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.129838 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.129445 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-config\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.129896 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.129846 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d47389f4-4eef-49e1-9d60-06e378e610ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.129896 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.129869 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d47389f4-4eef-49e1-9d60-06e378e610ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.130508 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.130472 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.132051 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.132013 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.132157 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.132087 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.132268 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.132251 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.132325 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.132293 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.132493 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.132471 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.132962 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.132943 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d47389f4-4eef-49e1-9d60-06e378e610ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.133125 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.133107 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d47389f4-4eef-49e1-9d60-06e378e610ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.135658 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.135638 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms7bc\" (UniqueName: \"kubernetes.io/projected/d47389f4-4eef-49e1-9d60-06e378e610ed-kube-api-access-ms7bc\") pod \"prometheus-k8s-0\" (UID: \"d47389f4-4eef-49e1-9d60-06e378e610ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.246036 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.246014 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:28.383202 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.383180 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 00:07:28.385394 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:07:28.385369 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd47389f4_4eef_49e1_9d60_06e378e610ed.slice/crio-69b12996be90d8b01d7da1c73189e64f6ba2db292bad4871e9d51ab9b8ff3b83 WatchSource:0}: Error finding container 69b12996be90d8b01d7da1c73189e64f6ba2db292bad4871e9d51ab9b8ff3b83: Status 404 returned error can't find the container with id 69b12996be90d8b01d7da1c73189e64f6ba2db292bad4871e9d51ab9b8ff3b83 Jul 28 00:07:28.497173 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.497145 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fec428cd-87d2-41d8-a3ea-c71151f543cf" path="/var/lib/kubelet/pods/fec428cd-87d2-41d8-a3ea-c71151f543cf/volumes" Jul 28 00:07:28.832748 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.832717 2562 generic.go:356] "Generic (PLEG): container finished" podID="d47389f4-4eef-49e1-9d60-06e378e610ed" containerID="b1a46fe2b2746f0174b023f8d934e4270118259fe80996c3fe54144886061a2b" exitCode=0 Jul 28 00:07:28.832860 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.832803 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d47389f4-4eef-49e1-9d60-06e378e610ed","Type":"ContainerDied","Data":"b1a46fe2b2746f0174b023f8d934e4270118259fe80996c3fe54144886061a2b"} Jul 28 00:07:28.832936 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:28.832883 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d47389f4-4eef-49e1-9d60-06e378e610ed","Type":"ContainerStarted","Data":"69b12996be90d8b01d7da1c73189e64f6ba2db292bad4871e9d51ab9b8ff3b83"} Jul 28 00:07:29.842070 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:29.842038 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d47389f4-4eef-49e1-9d60-06e378e610ed","Type":"ContainerStarted","Data":"2d0eb1160c811394894f96eec7265777ab31ba7e4bc734305a79ca16c51fa451"} Jul 28 00:07:29.842480 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:29.842119 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d47389f4-4eef-49e1-9d60-06e378e610ed","Type":"ContainerStarted","Data":"d3ffb1c579111fcd88490993e8038073cbea38580370b73f097bca019daae170"} Jul 28 00:07:29.842480 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:29.842169 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d47389f4-4eef-49e1-9d60-06e378e610ed","Type":"ContainerStarted","Data":"39262ff0714e3c54cc4d08e36b4ab7b381dc5b3188face58271c19f16e60bc43"} Jul 28 00:07:29.842480 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:29.842214 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d47389f4-4eef-49e1-9d60-06e378e610ed","Type":"ContainerStarted","Data":"2d12e053d92dfd0ae09734aba1842ef4af6500526ac3a002bd3c28ab9d77d19b"} Jul 28 00:07:29.842480 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:29.842252 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d47389f4-4eef-49e1-9d60-06e378e610ed","Type":"ContainerStarted","Data":"49933697ab47d9eff44fe0e798c8df4918cc09a87a7d2a673184376bb79d6939"} Jul 28 00:07:29.842480 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:29.842292 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d47389f4-4eef-49e1-9d60-06e378e610ed","Type":"ContainerStarted","Data":"29e7e640fe7f5b95781308e5b6000c258ae56e3045444e7d2a73ecd70d360603"} Jul 28 00:07:29.877239 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:29.877147 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.8563451 podStartE2EDuration="2.877129783s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.784683ms" isStatefulPod=false podCreationTimestamp="2026-07-28 00:07:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:07:29.876029435 +0000 UTC m=+381.963041357" watchObservedRunningTime="2026-07-28 00:07:29.877129783 +0000 UTC m=+381.964141652" Jul 28 00:07:33.246927 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:07:33.246889 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:07:33.495053 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:07:33.495017 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:07:48.496225 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:07:48.496101 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:07:59.494880 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:07:59.494843 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:08:14.309802 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:08:14.309718 2562 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc" Jul 28 00:08:14.310158 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:08:14.309833 2562 kuberuntime_manager.go:1459] "Unhandled Error" err="container acm-agent start failed in pod klusterlet-addon-workmgr-5656cb958f-m8gw4_open-cluster-management-agent-addon(5399b003-7093-42ab-aa85-c56436fcbd53): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 28 00:08:14.310158 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:08:14.309879 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:08:28.247051 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:08:28.247015 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:08:28.264243 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:08:28.264209 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:08:29.082644 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:08:29.082549 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 00:08:29.494092 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:08:29.494038 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:08:43.494867 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:08:43.494738 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:08:56.494943 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:08:56.494895 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:09:11.494652 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:09:11.494597 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:09:25.494889 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:09:25.494831 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:09:38.496796 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:09:38.496754 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:09:51.494456 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:09:51.494419 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:10:04.494452 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:10:04.494397 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:10:19.494890 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:10:19.494846 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:10:32.494874 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:10:32.494823 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:10:45.494973 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:10:45.494917 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:10:57.494911 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:10:57.494824 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:11:10.496249 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:11:10.494238 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:11:24.495194 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:11:24.494999 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 00:11:24.495519 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:11:24.495221 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:11:38.496117 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:11:38.495970 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:11:53.494981 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:11:53.494926 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:12:04.494266 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:12:04.494154 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:12:18.496304 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:12:18.496257 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:12:32.494280 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:12:32.494101 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:12:46.494759 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:12:46.494650 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:13:01.494622 ip-10-0-132-108 kubenswrapper[2562]: E0728 00:13:01.494560 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc in registry.redhat.io/multicluster-engine/multicloud-manager-rhel9: received unexpected HTTP status: 502 Bad Gateway\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podUID="5399b003-7093-42ab-aa85-c56436fcbd53" Jul 28 00:13:20.116063 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:20.116017 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" event={"ID":"5399b003-7093-42ab-aa85-c56436fcbd53","Type":"ContainerStarted","Data":"ee3b2a7b301a4ca4c7ea74166af7d0784693608dcb78ec24fe98a7564b379373"} Jul 28 00:13:20.116605 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:20.116340 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" Jul 28 00:13:20.118213 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:20.118188 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" Jul 28 00:13:20.135118 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:20.135056 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5656cb958f-m8gw4" podStartSLOduration=1.7739888499999998 podStartE2EDuration="10m47.135038245s" totalImagesPullingTime="10m45.361049395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=6 observedRunningTime="2026-07-28 00:13:20.133185711 +0000 UTC m=+732.220197600" watchObservedRunningTime="2026-07-28 00:13:20.135038245 +0000 UTC m=+732.222050115" Jul 28 00:13:48.416297 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:48.416265 2562 ???:1] "http2: server: error reading preface from client 10.0.132.108:33632: read tcp 10.0.132.108:10250->10.0.132.108:33632: read: connection reset by peer" Jul 28 00:13:48.420554 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:48.420524 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6fn66_8d81b605-7b6c-4482-bf3c-e9be07ece7a1/global-pull-secret-syncer/0.log" Jul 28 00:13:48.566227 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:48.566199 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qk4l8_a267ae2d-361c-4e6b-9c8d-c80fe11793c9/konnectivity-agent/0.log" Jul 28 00:13:48.610223 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:48.610205 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-108.ec2.internal_30f65fb00ad2053bc625f5a773e5d6b7/haproxy/0.log" Jul 28 00:13:52.768527 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:52.768495 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-92zmv_6d853349-6a1e-4cd2-b876-b2526ed4818a/kube-state-metrics/0.log" Jul 28 00:13:52.789487 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:52.789467 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-92zmv_6d853349-6a1e-4cd2-b876-b2526ed4818a/kube-rbac-proxy-main/0.log" Jul 28 00:13:52.808457 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:52.808439 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-92zmv_6d853349-6a1e-4cd2-b876-b2526ed4818a/kube-rbac-proxy-self/0.log" Jul 28 00:13:52.917429 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:52.917410 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bmrmv_462d9293-d0e2-413e-9f6e-1de73f69b5a7/node-exporter/0.log" Jul 28 00:13:52.942911 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:52.942892 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bmrmv_462d9293-d0e2-413e-9f6e-1de73f69b5a7/kube-rbac-proxy/0.log" Jul 28 00:13:52.971318 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:52.971300 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bmrmv_462d9293-d0e2-413e-9f6e-1de73f69b5a7/init-textfile/0.log" Jul 28 00:13:53.240714 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:53.240600 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d47389f4-4eef-49e1-9d60-06e378e610ed/prometheus/0.log" Jul 28 00:13:53.256261 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:53.256231 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d47389f4-4eef-49e1-9d60-06e378e610ed/config-reloader/0.log" Jul 28 00:13:53.279012 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:53.278991 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d47389f4-4eef-49e1-9d60-06e378e610ed/thanos-sidecar/0.log" Jul 28 00:13:53.301469 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:53.301452 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d47389f4-4eef-49e1-9d60-06e378e610ed/kube-rbac-proxy-web/0.log" Jul 28 00:13:53.325524 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:53.325504 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d47389f4-4eef-49e1-9d60-06e378e610ed/kube-rbac-proxy/0.log" Jul 28 00:13:53.346242 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:53.346213 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d47389f4-4eef-49e1-9d60-06e378e610ed/kube-rbac-proxy-thanos/0.log" Jul 28 00:13:53.370370 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:53.370353 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d47389f4-4eef-49e1-9d60-06e378e610ed/init-config-reloader/0.log" Jul 28 00:13:56.122089 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.122059 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt"] Jul 28 00:13:56.124403 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.124385 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt" Jul 28 00:13:56.127424 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.127395 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6gfpx\"/\"kube-root-ca.crt\"" Jul 28 00:13:56.127615 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.127530 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6gfpx\"/\"default-dockercfg-5nmsn\"" Jul 28 00:13:56.127909 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.127890 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6gfpx\"/\"openshift-service-ca.crt\"" Jul 28 00:13:56.137235 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.137216 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt"] Jul 28 00:13:56.155874 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.155853 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgpxf\" (UniqueName: \"kubernetes.io/projected/bdd170ea-cf1f-4756-ada3-b8ae3470a501-kube-api-access-kgpxf\") pod \"perf-node-gather-daemonset-rcqtt\" (UID: \"bdd170ea-cf1f-4756-ada3-b8ae3470a501\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt" Jul 28 00:13:56.155983 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.155903 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bdd170ea-cf1f-4756-ada3-b8ae3470a501-proc\") pod \"perf-node-gather-daemonset-rcqtt\" (UID: \"bdd170ea-cf1f-4756-ada3-b8ae3470a501\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt" Jul 28 00:13:56.155983 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.155928 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bdd170ea-cf1f-4756-ada3-b8ae3470a501-podres\") pod \"perf-node-gather-daemonset-rcqtt\" (UID: \"bdd170ea-cf1f-4756-ada3-b8ae3470a501\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt" Jul 28 00:13:56.156055 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.156006 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdd170ea-cf1f-4756-ada3-b8ae3470a501-sys\") pod \"perf-node-gather-daemonset-rcqtt\" (UID: \"bdd170ea-cf1f-4756-ada3-b8ae3470a501\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt" Jul 28 00:13:56.156055 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.156034 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdd170ea-cf1f-4756-ada3-b8ae3470a501-lib-modules\") pod \"perf-node-gather-daemonset-rcqtt\" (UID: \"bdd170ea-cf1f-4756-ada3-b8ae3470a501\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt" Jul 28 00:13:56.257091 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.257066 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bdd170ea-cf1f-4756-ada3-b8ae3470a501-proc\") pod \"perf-node-gather-daemonset-rcqtt\" (UID: \"bdd170ea-cf1f-4756-ada3-b8ae3470a501\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt" Jul 28 00:13:56.257196 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.257102 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bdd170ea-cf1f-4756-ada3-b8ae3470a501-podres\") pod \"perf-node-gather-daemonset-rcqtt\" (UID: \"bdd170ea-cf1f-4756-ada3-b8ae3470a501\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt" Jul 28 00:13:56.257196 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.257136 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdd170ea-cf1f-4756-ada3-b8ae3470a501-sys\") pod \"perf-node-gather-daemonset-rcqtt\" (UID: \"bdd170ea-cf1f-4756-ada3-b8ae3470a501\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt" Jul 28 00:13:56.257196 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.257148 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bdd170ea-cf1f-4756-ada3-b8ae3470a501-proc\") pod \"perf-node-gather-daemonset-rcqtt\" (UID: \"bdd170ea-cf1f-4756-ada3-b8ae3470a501\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt" Jul 28 00:13:56.257196 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.257155 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdd170ea-cf1f-4756-ada3-b8ae3470a501-lib-modules\") pod \"perf-node-gather-daemonset-rcqtt\" (UID: \"bdd170ea-cf1f-4756-ada3-b8ae3470a501\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt" Jul 28 00:13:56.257395 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.257215 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdd170ea-cf1f-4756-ada3-b8ae3470a501-sys\") pod \"perf-node-gather-daemonset-rcqtt\" (UID: \"bdd170ea-cf1f-4756-ada3-b8ae3470a501\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt" Jul 28 00:13:56.257395 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.257237 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bdd170ea-cf1f-4756-ada3-b8ae3470a501-podres\") pod \"perf-node-gather-daemonset-rcqtt\" (UID: \"bdd170ea-cf1f-4756-ada3-b8ae3470a501\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt" Jul 28 00:13:56.257395 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.257235 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgpxf\" (UniqueName: \"kubernetes.io/projected/bdd170ea-cf1f-4756-ada3-b8ae3470a501-kube-api-access-kgpxf\") pod \"perf-node-gather-daemonset-rcqtt\" (UID: \"bdd170ea-cf1f-4756-ada3-b8ae3470a501\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt" Jul 28 00:13:56.257395 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.257268 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdd170ea-cf1f-4756-ada3-b8ae3470a501-lib-modules\") pod \"perf-node-gather-daemonset-rcqtt\" (UID: \"bdd170ea-cf1f-4756-ada3-b8ae3470a501\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt" Jul 28 00:13:56.265597 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.265554 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgpxf\" (UniqueName: \"kubernetes.io/projected/bdd170ea-cf1f-4756-ada3-b8ae3470a501-kube-api-access-kgpxf\") pod \"perf-node-gather-daemonset-rcqtt\" (UID: \"bdd170ea-cf1f-4756-ada3-b8ae3470a501\") " pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt" Jul 28 00:13:56.433979 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.433917 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt" Jul 28 00:13:56.560268 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.560239 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt"] Jul 28 00:13:56.563633 ip-10-0-132-108 kubenswrapper[2562]: W0728 00:13:56.563608 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbdd170ea_cf1f_4756_ada3_b8ae3470a501.slice/crio-edcaaba3b17c9a5158489aca8e7aad0a10efda4169a010fa8686bfb3066e830b WatchSource:0}: Error finding container edcaaba3b17c9a5158489aca8e7aad0a10efda4169a010fa8686bfb3066e830b: Status 404 returned error can't find the container with id edcaaba3b17c9a5158489aca8e7aad0a10efda4169a010fa8686bfb3066e830b Jul 28 00:13:56.978085 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.978057 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dvgml_f26cd91d-63b8-4b8c-94e6-6b3062ad83ee/dns/0.log" Jul 28 00:13:56.996959 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:56.996937 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dvgml_f26cd91d-63b8-4b8c-94e6-6b3062ad83ee/kube-rbac-proxy/0.log" Jul 28 00:13:57.140006 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:57.139986 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wj95q_35f7c804-20c6-4b56-91bc-e4e9546926f1/dns-node-resolver/0.log" Jul 28 00:13:57.250891 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:57.250839 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt" event={"ID":"bdd170ea-cf1f-4756-ada3-b8ae3470a501","Type":"ContainerStarted","Data":"df7a030a0310541a4bd071bf2cfe38e02e3341ff87802d263b26d939f102da0e"} Jul 28 00:13:57.250977 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:57.250888 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt" event={"ID":"bdd170ea-cf1f-4756-ada3-b8ae3470a501","Type":"ContainerStarted","Data":"edcaaba3b17c9a5158489aca8e7aad0a10efda4169a010fa8686bfb3066e830b"} Jul 28 00:13:57.250977 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:57.250916 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt" Jul 28 00:13:57.267725 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:57.267674 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt" podStartSLOduration=1.267656951 podStartE2EDuration="1.267656951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:13:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:13:57.266662029 +0000 UTC m=+769.353673898" watchObservedRunningTime="2026-07-28 00:13:57.267656951 +0000 UTC m=+769.354668821" Jul 28 00:13:57.635231 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:57.635216 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-psqlm_be369c59-0b1a-4743-a91e-6365573fe326/node-ca/0.log" Jul 28 00:13:58.570861 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:58.570840 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fvx4b_0bc6ef2e-56e8-4822-a0aa-72c4b47991e5/serve-healthcheck-canary/0.log" Jul 28 00:13:59.143495 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:59.143474 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cktm2_a3040796-37d1-4da9-921c-6353fa8f55b2/kube-rbac-proxy/0.log" Jul 28 00:13:59.163234 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:59.163212 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cktm2_a3040796-37d1-4da9-921c-6353fa8f55b2/exporter/0.log" Jul 28 00:13:59.184722 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:13:59.184705 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cktm2_a3040796-37d1-4da9-921c-6353fa8f55b2/extractor/0.log" Jul 28 00:14:03.265210 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:14:03.265176 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6gfpx/perf-node-gather-daemonset-rcqtt" Jul 28 00:14:04.360902 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:14:04.360870 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9vdmc_37a8f118-b676-45df-bb06-468b904da361/kube-multus-additional-cni-plugins/0.log" Jul 28 00:14:04.380747 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:14:04.380719 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9vdmc_37a8f118-b676-45df-bb06-468b904da361/egress-router-binary-copy/0.log" Jul 28 00:14:04.401316 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:14:04.401294 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9vdmc_37a8f118-b676-45df-bb06-468b904da361/cni-plugins/0.log" Jul 28 00:14:04.420806 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:14:04.420788 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9vdmc_37a8f118-b676-45df-bb06-468b904da361/bond-cni-plugin/0.log" Jul 28 00:14:04.439214 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:14:04.439199 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9vdmc_37a8f118-b676-45df-bb06-468b904da361/routeoverride-cni/0.log" Jul 28 00:14:04.460190 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:14:04.460173 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9vdmc_37a8f118-b676-45df-bb06-468b904da361/whereabouts-cni-bincopy/0.log" Jul 28 00:14:04.479470 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:14:04.479449 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9vdmc_37a8f118-b676-45df-bb06-468b904da361/whereabouts-cni/0.log" Jul 28 00:14:04.908778 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:14:04.908753 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sblhp_651aa53e-86d5-4e25-8d15-18b49e507a78/kube-multus/0.log" Jul 28 00:14:05.005623 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:14:05.005605 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jqdhz_ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71/network-metrics-daemon/0.log" Jul 28 00:14:05.023827 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:14:05.023784 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jqdhz_ce0e5ef5-3be4-4ebe-bf9d-29124fc6fe71/kube-rbac-proxy/0.log" Jul 28 00:14:06.068258 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:14:06.068230 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrbh_99d4672b-07d4-467a-a989-1f3e2db65e4a/ovn-controller/0.log" Jul 28 00:14:06.086779 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:14:06.086755 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrbh_99d4672b-07d4-467a-a989-1f3e2db65e4a/ovn-acl-logging/0.log" Jul 28 00:14:06.110434 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:14:06.110411 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrbh_99d4672b-07d4-467a-a989-1f3e2db65e4a/kube-rbac-proxy-node/0.log" Jul 28 00:14:06.132953 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:14:06.132930 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrbh_99d4672b-07d4-467a-a989-1f3e2db65e4a/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 00:14:06.155121 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:14:06.155092 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrbh_99d4672b-07d4-467a-a989-1f3e2db65e4a/northd/0.log" Jul 28 00:14:06.175243 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:14:06.175224 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrbh_99d4672b-07d4-467a-a989-1f3e2db65e4a/nbdb/0.log" Jul 28 00:14:06.195863 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:14:06.195844 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrbh_99d4672b-07d4-467a-a989-1f3e2db65e4a/sbdb/0.log" Jul 28 00:14:06.229525 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:14:06.229507 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvrbh_99d4672b-07d4-467a-a989-1f3e2db65e4a/ovnkube-controller/0.log" Jul 28 00:14:07.440558 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:14:07.440525 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-n4nkt_898d09b0-dd59-4773-a4a2-74618b9015d9/network-check-target-container/0.log" Jul 28 00:14:08.280510 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:14:08.280489 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-ttcz2_9330a140-5213-4bff-9bbd-eab56d087ae6/iptables-alerter/0.log" Jul 28 00:14:08.879547 ip-10-0-132-108 kubenswrapper[2562]: I0728 00:14:08.879523 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-rlgt4_3ec44345-cfc8-4a43-bdf7-0f13b7c9f843/tuned/0.log"