Jun 08 21:57:28.317465 ip-10-0-138-88 systemd[1]: Starting Kubernetes Kubelet... Jun 08 21:57:28.823746 ip-10-0-138-88 kubenswrapper[2549]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 21:57:28.823746 ip-10-0-138-88 kubenswrapper[2549]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 21:57:28.823746 ip-10-0-138-88 kubenswrapper[2549]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 21:57:28.823746 ip-10-0-138-88 kubenswrapper[2549]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 21:57:28.823746 ip-10-0-138-88 kubenswrapper[2549]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 21:57:28.823746 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.804922 2549 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 21:57:28.823746 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809901 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:57:28.823746 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809914 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:57:28.823746 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809918 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:57:28.823746 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809921 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:57:28.823746 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809925 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:57:28.823746 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809928 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:57:28.823746 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809931 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:57:28.823746 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809934 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:57:28.826814 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809936 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:57:28.826814 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809939 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:57:28.826814 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809942 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:57:28.826814 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809945 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:57:28.826814 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809948 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:57:28.826814 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809950 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:57:28.826814 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809953 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:57:28.826814 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809956 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:57:28.826814 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809958 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:57:28.826814 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809961 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:57:28.826814 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809964 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:57:28.826814 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809967 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:57:28.826814 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809970 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:57:28.826814 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809972 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:57:28.826814 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809975 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:57:28.826814 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809977 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:57:28.826814 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809980 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:57:28.826814 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809982 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:57:28.826814 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809991 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:57:28.826814 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809994 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:57:28.827381 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809997 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:57:28.827381 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.809999 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:57:28.827381 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810002 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:57:28.827381 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810005 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:57:28.827381 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810008 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:57:28.827381 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810011 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:57:28.827381 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810014 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:57:28.827381 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810016 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:57:28.827381 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810019 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:57:28.827381 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810021 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:57:28.827381 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810024 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:57:28.827381 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810026 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:57:28.827381 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810031 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:57:28.827381 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810034 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:57:28.827381 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810038 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:57:28.827381 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810043 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:57:28.827381 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810046 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:57:28.827381 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810049 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:57:28.827381 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810052 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:57:28.827919 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810055 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:57:28.827919 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810057 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:57:28.827919 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810060 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:57:28.827919 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810063 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:57:28.827919 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810065 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:57:28.827919 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810068 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:57:28.827919 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810071 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:57:28.827919 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810073 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:57:28.827919 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810076 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:57:28.827919 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810079 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:57:28.827919 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810081 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:57:28.827919 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810085 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:57:28.827919 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810088 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:57:28.827919 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810091 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:57:28.827919 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810094 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:57:28.827919 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810096 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:57:28.827919 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810099 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:57:28.827919 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810102 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:57:28.827919 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810104 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:57:28.827919 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810107 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:57:28.828720 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810109 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:57:28.828720 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810112 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:57:28.828720 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810115 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:57:28.828720 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810117 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:57:28.828720 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810120 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:57:28.828720 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810122 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:57:28.828720 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810125 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:57:28.828720 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810128 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:57:28.828720 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810130 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:57:28.828720 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810133 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:57:28.828720 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810135 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:57:28.828720 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810138 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:57:28.828720 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810142 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:57:28.828720 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810145 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:57:28.828720 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810148 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:57:28.828720 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810151 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:57:28.828720 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810153 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:57:28.828720 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810167 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:57:28.828720 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810169 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:57:28.828720 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810172 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:57:28.829280 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810175 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:57:28.829280 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810178 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:57:28.829280 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810180 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:57:28.829280 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810184 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:57:28.829280 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810190 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:57:28.829280 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810193 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:57:28.829280 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810196 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:57:28.829280 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810198 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:57:28.829280 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810201 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:57:28.829280 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810204 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:57:28.829280 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810206 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:57:28.829280 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810209 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:57:28.829280 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810944 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:57:28.829280 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810950 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:57:28.829280 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810953 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:57:28.829280 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810956 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:57:28.829280 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810959 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:57:28.829280 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810961 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:57:28.829280 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810964 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:57:28.829280 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810967 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:57:28.829838 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810970 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:57:28.829838 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810973 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:57:28.829838 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810975 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:57:28.829838 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810978 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:57:28.829838 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810981 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:57:28.829838 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810985 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:57:28.829838 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810987 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:57:28.829838 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810990 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:57:28.829838 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810993 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:57:28.829838 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810996 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:57:28.829838 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.810998 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:57:28.829838 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811002 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:57:28.829838 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811007 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:57:28.829838 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811011 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:57:28.829838 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811015 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:57:28.829838 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811018 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:57:28.829838 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811021 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:57:28.829838 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811024 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:57:28.829838 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811028 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:57:28.830564 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811030 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:57:28.830564 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811033 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:57:28.830564 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811036 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:57:28.830564 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811038 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:57:28.830564 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811041 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:57:28.830564 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811043 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:57:28.830564 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811046 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:57:28.830564 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811049 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:57:28.830564 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811052 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:57:28.830564 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811054 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:57:28.830564 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811057 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:57:28.830564 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811060 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:57:28.830564 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811063 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:57:28.830564 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811065 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:57:28.830564 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811069 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:57:28.830564 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811072 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:57:28.830564 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811075 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:57:28.830564 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811079 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:57:28.830564 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811083 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:57:28.830564 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811086 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:57:28.831153 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811088 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:57:28.831153 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811091 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:57:28.831153 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811094 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:57:28.831153 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811097 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:57:28.831153 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811100 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:57:28.831153 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811103 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:57:28.831153 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811107 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:57:28.831153 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811110 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:57:28.831153 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811113 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:57:28.831153 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811116 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:57:28.831153 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811118 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:57:28.831153 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811121 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:57:28.831153 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811123 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:57:28.831153 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811126 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:57:28.831153 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811128 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:57:28.831153 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811131 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:57:28.831153 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811133 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:57:28.831153 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811136 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:57:28.831153 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811139 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:57:28.953557 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811141 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:57:28.953557 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811143 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:57:28.953557 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811146 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:57:28.953557 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811149 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:57:28.953557 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811152 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:57:28.953557 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811169 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:57:28.953557 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811172 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:57:28.953557 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811175 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:57:28.953557 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811178 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:57:28.953557 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811181 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:57:28.953557 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811184 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:57:28.953557 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811186 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:57:28.953557 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811189 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:57:28.953557 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811191 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:57:28.953557 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811195 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:57:28.953557 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811197 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:57:28.953557 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811200 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:57:28.953557 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811203 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:57:28.953557 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811206 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:57:28.953557 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811209 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:57:28.884428 ip-10-0-138-88 systemd[1]: Started Kubernetes Kubelet. Jun 08 21:57:28.955066 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811211 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:57:28.955066 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811214 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:57:28.955066 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811217 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:57:28.955066 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811219 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:57:28.955066 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811221 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:57:28.955066 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811224 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:57:28.955066 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811227 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:57:28.955066 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811229 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:57:28.955066 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811232 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:57:28.955066 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811234 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:57:28.955066 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811237 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:57:28.955066 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811239 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:57:28.955066 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811242 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:57:28.955066 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811614 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:57:28.955066 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811619 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:57:28.955066 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811622 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:57:28.955066 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811624 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:57:28.955066 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811627 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:57:28.955066 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811630 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:57:28.955066 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811633 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:57:28.956679 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811635 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:57:28.956679 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811639 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:57:28.956679 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811641 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:57:28.956679 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811644 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:57:28.956679 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811647 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:57:28.956679 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811650 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:57:28.956679 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811653 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:57:28.956679 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811655 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:57:28.956679 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811658 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:57:28.956679 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811660 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:57:28.956679 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811663 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:57:28.956679 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811665 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:57:28.956679 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811668 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:57:28.956679 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811670 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:57:28.956679 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811673 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:57:28.956679 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811675 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:57:28.956679 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811678 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:57:28.956679 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811680 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:57:28.956679 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811683 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:57:28.956679 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811686 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:57:28.956679 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811688 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:57:28.957339 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811691 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:57:28.957339 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811693 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:57:28.957339 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811695 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:57:28.957339 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811698 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:57:28.957339 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811702 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:57:28.957339 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811705 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:57:28.957339 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811707 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:57:28.957339 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811710 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:57:28.957339 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811713 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:57:28.957339 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811715 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:57:28.957339 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811718 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:57:28.957339 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811720 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:57:28.957339 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811723 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:57:28.957339 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811732 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:57:28.957339 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811735 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:57:28.957339 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811737 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:57:28.957339 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811740 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:57:28.957339 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811742 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:57:28.957339 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811746 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:57:28.957339 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811749 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:57:29.161238 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811751 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:57:29.161238 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811754 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:57:29.161238 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811757 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:57:29.161238 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811759 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:57:29.161238 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811761 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:57:29.161238 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811765 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:57:29.161238 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811767 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:57:29.161238 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811769 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:57:29.161238 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811772 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:57:29.161238 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811774 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:57:29.161238 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811777 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:57:29.161238 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811779 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:57:29.161238 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811782 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:57:29.161238 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811784 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:57:29.161238 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811786 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:57:29.161238 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811789 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:57:29.161238 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811793 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:57:29.161238 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811795 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:57:29.161238 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811798 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:57:29.161238 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811800 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:57:29.162567 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811804 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:57:29.162567 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811806 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:57:29.162567 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811809 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:57:29.162567 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811812 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:57:29.162567 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811814 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:57:29.162567 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811817 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:57:29.162567 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811825 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:57:29.162567 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811828 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:57:29.162567 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811831 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:57:29.162567 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811833 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:57:29.162567 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811836 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:57:29.162567 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811838 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:57:29.162567 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811841 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:57:29.162567 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811844 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:57:29.162567 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811846 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:57:29.162567 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811849 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:57:29.162567 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811851 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:57:29.162567 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811855 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:57:29.162567 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811858 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:57:29.162567 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811860 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:57:29.163208 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811863 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:57:29.163208 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811865 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:57:29.163208 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811869 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:57:29.163208 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811872 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:57:29.163208 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811875 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:57:29.163208 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811878 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:57:29.163208 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811881 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:57:29.163208 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811884 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:57:29.163208 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811888 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:57:29.163208 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811891 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:57:29.163208 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.811897 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:57:29.163208 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.811978 2549 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 21:57:29.163208 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.811986 2549 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 21:57:29.163208 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.811998 2549 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 21:57:29.163208 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812002 2549 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 21:57:29.163208 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812006 2549 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 21:57:29.163208 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812010 2549 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 21:57:29.163208 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812014 2549 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 21:57:29.163208 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812018 2549 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 21:57:29.163208 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812025 2549 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812028 2549 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812032 2549 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812035 2549 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812038 2549 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812041 2549 flags.go:64] FLAG: --cgroup-root="" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812044 2549 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812047 2549 flags.go:64] FLAG: --client-ca-file="" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812050 2549 flags.go:64] FLAG: --cloud-provider="external" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812053 2549 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812059 2549 flags.go:64] FLAG: --cluster-domain="" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812062 2549 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812065 2549 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812068 2549 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812071 2549 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812075 2549 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812078 2549 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812082 2549 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812085 2549 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812088 2549 flags.go:64] FLAG: --contention-profiling="false" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812091 2549 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812095 2549 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812099 2549 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812103 2549 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 21:57:29.163958 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812108 2549 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812111 2549 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812114 2549 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812117 2549 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812120 2549 flags.go:64] FLAG: --enable-server="true" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812123 2549 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812128 2549 flags.go:64] FLAG: --event-burst="100" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812131 2549 flags.go:64] FLAG: --event-qps="50" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812134 2549 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812137 2549 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812140 2549 flags.go:64] FLAG: --eviction-hard="" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812144 2549 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812147 2549 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812151 2549 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812153 2549 flags.go:64] FLAG: --eviction-soft="" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812170 2549 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812174 2549 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812176 2549 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812179 2549 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812182 2549 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812185 2549 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812188 2549 flags.go:64] FLAG: --feature-gates="" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812192 2549 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812195 2549 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812198 2549 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 21:57:29.164658 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812201 2549 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812204 2549 flags.go:64] FLAG: --healthz-port="10248" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812207 2549 flags.go:64] FLAG: --help="false" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812210 2549 flags.go:64] FLAG: --hostname-override="ip-10-0-138-88.ec2.internal" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812216 2549 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812219 2549 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812223 2549 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812226 2549 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812230 2549 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812232 2549 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812235 2549 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812238 2549 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812241 2549 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812244 2549 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812247 2549 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812250 2549 flags.go:64] FLAG: --kube-reserved="" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812253 2549 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812256 2549 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812259 2549 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812262 2549 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812264 2549 flags.go:64] FLAG: --lock-file="" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812267 2549 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812270 2549 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812273 2549 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 21:57:29.165478 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812278 2549 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812281 2549 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812284 2549 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812287 2549 flags.go:64] FLAG: --logging-format="text" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812290 2549 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812293 2549 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812296 2549 flags.go:64] FLAG: --manifest-url="" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812299 2549 flags.go:64] FLAG: --manifest-url-header="" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812304 2549 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812307 2549 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812310 2549 flags.go:64] FLAG: --max-pods="110" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812313 2549 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812318 2549 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812320 2549 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812325 2549 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812328 2549 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812331 2549 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812334 2549 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812341 2549 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812344 2549 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812347 2549 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812350 2549 flags.go:64] FLAG: --pod-cidr="" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812353 2549 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 21:57:29.166241 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812358 2549 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812361 2549 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812364 2549 flags.go:64] FLAG: --pods-per-core="0" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812368 2549 flags.go:64] FLAG: --port="10250" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812371 2549 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812374 2549 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e0ccb1fb9148068d" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812377 2549 flags.go:64] FLAG: --qos-reserved="" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812389 2549 flags.go:64] FLAG: --read-only-port="10255" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812394 2549 flags.go:64] FLAG: --register-node="true" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812397 2549 flags.go:64] FLAG: --register-with-taints="" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812401 2549 flags.go:64] FLAG: --registry-burst="10" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812404 2549 flags.go:64] FLAG: --registry-qps="5" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812408 2549 flags.go:64] FLAG: --reserved-cpus="" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812411 2549 flags.go:64] FLAG: --reserved-memory="" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812415 2549 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812418 2549 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812421 2549 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812423 2549 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812427 2549 flags.go:64] FLAG: --runonce="false" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812430 2549 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812433 2549 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812437 2549 flags.go:64] FLAG: --seccomp-default="false" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812440 2549 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812443 2549 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812448 2549 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812452 2549 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 21:57:29.166989 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812455 2549 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812458 2549 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812461 2549 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812464 2549 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812466 2549 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812469 2549 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812472 2549 flags.go:64] FLAG: --system-cgroups="" Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812475 2549 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812480 2549 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812483 2549 flags.go:64] FLAG: --tls-cert-file="" Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812487 2549 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812491 2549 flags.go:64] FLAG: --tls-min-version="" Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812494 2549 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812497 2549 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812500 2549 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812502 2549 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812505 2549 flags.go:64] FLAG: --v="2" Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812509 2549 flags.go:64] FLAG: --version="false" Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812513 2549 flags.go:64] FLAG: --vmodule="" Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812517 2549 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.812520 2549 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812641 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812645 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812648 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:57:29.167891 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812651 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:57:29.168605 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812654 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:57:29.168605 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812656 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:57:29.168605 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812661 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:57:29.168605 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812664 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:57:29.168605 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812668 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:57:29.168605 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812671 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:57:29.168605 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812675 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:57:29.168605 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812678 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:57:29.168605 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812681 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:57:29.168605 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812684 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:57:29.168605 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812688 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:57:29.168605 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812691 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:57:29.168605 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812694 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:57:29.168605 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812697 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:57:29.168605 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812700 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:57:29.168605 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812703 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:57:29.168605 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812706 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:57:29.168605 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812709 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:57:29.168605 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812712 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:57:29.169217 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812714 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:57:29.169217 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812717 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:57:29.169217 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812720 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:57:29.169217 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812722 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:57:29.169217 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812725 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:57:29.169217 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812729 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:57:29.169217 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812733 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:57:29.169217 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812736 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:57:29.169217 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812738 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:57:29.169217 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812741 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:57:29.169217 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812743 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:57:29.169217 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812746 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:57:29.169217 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812748 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:57:29.169217 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812751 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:57:29.169217 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812753 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:57:29.169217 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812757 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:57:29.169217 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812760 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:57:29.169217 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812762 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:57:29.169217 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812766 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:57:29.169217 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812769 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:57:29.169768 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812771 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:57:29.169768 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812774 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:57:29.169768 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812777 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:57:29.169768 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812779 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:57:29.169768 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812782 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:57:29.169768 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812784 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:57:29.169768 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812787 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:57:29.169768 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812789 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:57:29.169768 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812792 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:57:29.169768 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812794 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:57:29.169768 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812797 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:57:29.169768 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812799 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:57:29.169768 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812803 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:57:29.169768 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812805 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:57:29.169768 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812808 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:57:29.169768 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812810 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:57:29.169768 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812813 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:57:29.169768 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812815 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:57:29.169768 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812818 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:57:29.169768 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812820 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:57:29.170298 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812823 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:57:29.170298 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812826 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:57:29.170298 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812828 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:57:29.170298 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812831 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:57:29.170298 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812833 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:57:29.170298 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812836 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:57:29.170298 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812839 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:57:29.170298 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812843 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:57:29.170298 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812845 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:57:29.170298 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812848 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:57:29.170298 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812852 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:57:29.170298 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812855 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:57:29.170298 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812857 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:57:29.170298 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812860 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:57:29.170298 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812862 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:57:29.170298 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812865 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:57:29.170298 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812867 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:57:29.170298 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812870 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:57:29.170298 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812874 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:57:29.170298 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812877 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:57:29.170815 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812880 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:57:29.170815 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812883 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:57:29.170815 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812886 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:57:29.170815 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812888 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:57:29.170815 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812891 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:57:29.170815 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812894 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:57:29.170815 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812897 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:57:29.170815 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812900 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:57:29.170815 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812902 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:57:29.170815 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812905 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:57:29.170815 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812907 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:57:29.170815 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812910 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:57:29.170815 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812912 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:57:29.170815 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812915 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:57:29.170815 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812917 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:57:29.170815 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.812920 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:57:29.171299 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.813652 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 21:57:29.171299 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.820424 2549 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 21:57:29.171299 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.820536 2549 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 21:57:29.171299 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.821252 2549 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 21:57:29.171299 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.821260 2549 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 21:57:29.171299 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821329 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:57:29.171299 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821334 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:57:29.171299 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821337 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:57:29.171299 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821340 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:57:29.171299 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821344 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:57:29.171299 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821347 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:57:29.171299 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821350 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:57:29.171299 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821353 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:57:29.171299 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821356 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:57:29.171299 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821358 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:57:29.171688 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821361 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:57:29.171688 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821364 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:57:29.171688 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821368 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:57:29.171688 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821372 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:57:29.171688 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821376 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:57:29.171688 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821379 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:57:29.171688 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821382 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:57:29.171688 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821386 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:57:29.171688 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821388 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:57:29.171688 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821391 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:57:29.171688 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821394 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:57:29.171688 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821397 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:57:29.171688 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821400 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:57:29.171688 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821403 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:57:29.171688 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821406 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:57:29.171688 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821409 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:57:29.171688 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821412 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:57:29.171688 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821415 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:57:29.171688 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821418 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:57:29.171688 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821421 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:57:29.172201 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821424 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:57:29.172201 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821427 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:57:29.172201 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821430 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:57:29.172201 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821432 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:57:29.172201 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821435 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:57:29.172201 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821438 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:57:29.172201 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821441 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:57:29.172201 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821443 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:57:29.172201 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821446 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:57:29.172201 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821450 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:57:29.172201 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821453 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:57:29.172201 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821456 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:57:29.172201 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821459 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:57:29.172201 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821462 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:57:29.172201 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821465 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:57:29.172201 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821468 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:57:29.172201 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821471 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:57:29.172201 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821473 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:57:29.172201 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821476 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:57:29.172682 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821478 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:57:29.172682 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821481 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:57:29.172682 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821484 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:57:29.172682 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821486 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:57:29.172682 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821488 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:57:29.172682 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821491 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:57:29.172682 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821493 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:57:29.172682 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821496 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:57:29.172682 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821499 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:57:29.172682 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821501 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:57:29.172682 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821504 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:57:29.172682 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821506 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:57:29.172682 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821509 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:57:29.172682 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821512 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:57:29.172682 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821515 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:57:29.172682 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821519 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:57:29.172682 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821522 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:57:29.172682 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821526 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:57:29.172682 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821528 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:57:29.172682 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821531 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:57:29.173180 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821533 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:57:29.173180 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821536 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:57:29.173180 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821538 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:57:29.173180 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821541 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:57:29.173180 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821543 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:57:29.173180 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821546 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:57:29.173180 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821548 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:57:29.173180 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821557 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:57:29.173180 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821560 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:57:29.173180 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821562 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:57:29.173180 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821565 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:57:29.173180 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821568 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:57:29.173180 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821571 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:57:29.173180 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821573 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:57:29.173180 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821576 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:57:29.173180 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821578 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:57:29.173180 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821581 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:57:29.173180 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821584 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:57:29.173180 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821586 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:57:29.173180 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821589 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:57:29.173676 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821592 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:57:29.173676 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821594 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:57:29.173676 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821597 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:57:29.173676 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821599 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:57:29.173676 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821602 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:57:29.173676 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821604 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:57:29.173676 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821607 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:57:29.173676 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821610 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:57:29.173676 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821613 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:57:29.173676 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821615 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:57:29.173676 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.821620 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 21:57:29.173676 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821739 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:57:29.173676 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821745 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:57:29.173676 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821748 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:57:29.173676 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821751 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:57:29.174049 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821754 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:57:29.174049 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821757 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:57:29.174049 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821760 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:57:29.174049 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821763 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:57:29.174049 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821767 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:57:29.174049 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821772 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:57:29.174049 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821775 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:57:29.174049 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821778 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:57:29.174049 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821781 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:57:29.174049 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821783 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:57:29.174049 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821786 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:57:29.174049 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821788 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:57:29.174049 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821791 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:57:29.174049 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821793 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:57:29.174049 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821796 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:57:29.174049 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821799 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:57:29.174049 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821801 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:57:29.174049 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821804 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:57:29.174049 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821807 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:57:29.176588 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821809 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:57:29.176588 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821812 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:57:29.176588 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821814 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:57:29.176588 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821817 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:57:29.176588 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821819 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:57:29.176588 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821822 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:57:29.176588 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821825 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:57:29.176588 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821827 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:57:29.176588 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821830 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:57:29.176588 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821834 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:57:29.176588 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821837 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:57:29.176588 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821840 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:57:29.176588 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821843 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:57:29.176588 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821846 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:57:29.176588 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821848 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:57:29.176588 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821851 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:57:29.176588 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821854 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:57:29.176588 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821858 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:57:29.176588 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821861 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:57:29.177068 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821864 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:57:29.177068 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821867 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:57:29.177068 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821869 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:57:29.177068 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821872 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:57:29.177068 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821875 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:57:29.177068 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821877 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:57:29.177068 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821880 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:57:29.177068 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821883 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:57:29.177068 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821885 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:57:29.177068 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821888 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:57:29.177068 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821890 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:57:29.177068 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821893 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:57:29.177068 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821896 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:57:29.177068 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821898 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:57:29.177068 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821902 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:57:29.177068 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821905 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:57:29.177068 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821908 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:57:29.177068 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821911 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:57:29.177068 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821914 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:57:29.177546 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821917 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:57:29.177546 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821919 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:57:29.177546 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821922 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:57:29.177546 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821924 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:57:29.177546 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821927 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:57:29.177546 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821929 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:57:29.177546 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821932 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:57:29.177546 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821934 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:57:29.177546 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821937 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:57:29.177546 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821940 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:57:29.177546 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821942 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:57:29.177546 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821946 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:57:29.177546 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821949 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:57:29.177546 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821952 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:57:29.177546 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821955 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:57:29.177546 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821958 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:57:29.177546 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821962 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:57:29.177546 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821965 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:57:29.177546 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821967 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:57:29.177546 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821970 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:57:29.178057 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821973 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:57:29.178057 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821975 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:57:29.178057 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821978 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:57:29.178057 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821980 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:57:29.178057 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821982 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:57:29.178057 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821985 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:57:29.178057 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821988 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:57:29.178057 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821990 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:57:29.178057 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821993 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:57:29.178057 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821995 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:57:29.178057 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.821998 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:57:29.178057 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.822001 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:57:29.178057 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.822003 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:57:29.178057 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.822006 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:57:29.178057 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.822009 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:57:29.178057 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.822011 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:57:29.178057 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.822014 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:57:29.178057 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:28.822016 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:57:29.178519 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.822021 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 21:57:29.178519 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.822138 2549 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 21:57:29.178519 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.826527 2549 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 21:57:29.178519 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.828253 2549 server.go:1019] "Starting client certificate rotation" Jun 08 21:57:29.178519 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.828351 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 21:57:29.178519 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.828389 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 21:57:29.178519 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.830749 2549 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 21:57:29.178519 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.834593 2549 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 21:57:29.178519 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.847635 2549 log.go:25] "Validated CRI v1 runtime API" Jun 08 21:57:29.178519 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.850004 2549 log.go:25] "Validated CRI v1 image API" Jun 08 21:57:29.178519 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.850861 2549 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 21:57:29.178519 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.854763 2549 fs.go:135] Filesystem UUIDs: map[1ea5c7f1-38b1-467d-b0fa-d02013d0e6b0:/dev/nvme0n1p3 6539ca42-c2b6-4502-8cae-f74b6f2d84d9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 08 21:57:29.178819 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.854777 2549 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 21:57:29.178819 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.857648 2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 21:57:29.178882 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.859848 2549 manager.go:216] Machine: {Timestamp:2026-06-08 21:57:28.858491552 +0000 UTC m=+0.407378331 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104593 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2eed6219c9728c367cf368c6dcf7f8 SystemUUID:ec2eed62-19c9-728c-367c-f368c6dcf7f8 BootID:85c1fe78-15cf-4e16-8ba5-43b85ec2637f Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8e:19:a4:a4:2b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8e:19:a4:a4:2b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:e7:f3:05:b0:a2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 21:57:29.178882 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.859954 2549 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 21:57:29.178882 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.860073 2549 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 21:57:29.178882 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.863617 2549 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 21:57:29.178882 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.863638 2549 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-88.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 21:57:29.178882 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.864292 2549 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 21:57:29.178882 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.864301 2549 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 21:57:29.178882 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.864309 2549 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 21:57:29.178882 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.865074 2549 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 21:57:29.178882 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.865871 2549 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 21:57:29.178882 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.868816 2549 state_mem.go:36] "Initialized new in-memory state store" Jun 08 21:57:29.178882 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.868945 2549 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 21:57:29.178882 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.868980 2549 kubelet.go:486] "Attempting to sync node with API server" Jun 08 21:57:29.178882 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.868997 2549 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 21:57:29.178882 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.869014 2549 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 21:57:29.178882 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.869024 2549 kubelet.go:398] "Adding apiserver pod source" Jun 08 21:57:29.178882 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.869033 2549 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 21:57:29.178882 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.869408 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.869428 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.876457 2549 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.877951 2549 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.877989 2549 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.877995 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-czr77" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.879088 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.879104 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.879113 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.879121 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.879131 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.879137 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.879145 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.879150 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.879170 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.879177 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.879193 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.879198 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.880083 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.880093 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.882955 2549 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-88.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:28.882984 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:28.882999 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-88.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.883349 2549 server.go:1268] "Started kubelet" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.883511 2549 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.883575 2549 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.883879 2549 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.887569 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-czr77" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.890877 2549 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.891945 2549 server.go:310] "Adding debug handlers to kubelet server" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.892588 2549 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.892952 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.893914 2549 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:28.892685 2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-88.ec2.internal.18b739e89d583a5b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-88.ec2.internal,UID:ip-10-0-138-88.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-88.ec2.internal,},FirstTimestamp:2026-06-08 21:57:28.883321435 +0000 UTC m=+0.432208286,LastTimestamp:2026-06-08 21:57:28.883321435 +0000 UTC m=+0.432208286,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-88.ec2.internal,}" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.894003 2549 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.894010 2549 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.894123 2549 reconstruct.go:97] "Volume reconstruction finished" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.894128 2549 reconciler.go:29] "Reconciler: start to sync state" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:28.894152 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-88.ec2.internal\" not found" Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.895278 2549 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 21:57:29.179422 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.895288 2549 factory.go:55] Registering systemd factory Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.895296 2549 factory.go:223] Registration of the systemd container factory successfully Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.895585 2549 factory.go:153] Registering CRI-O factory Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.895607 2549 factory.go:223] Registration of the crio container factory successfully Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.895633 2549 factory.go:103] Registering Raw factory Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.895647 2549 manager.go:1196] Started watching for new ooms in manager Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:28.895908 2549 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.896449 2549 manager.go:349] Starting recovery of all containers Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.906807 2549 manager.go:354] Recovery completed Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.910927 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.913050 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-88.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.913084 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-88.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.913096 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-88.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.913759 2549 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.913769 2549 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.913788 2549 state_mem.go:36] "Initialized new in-memory state store" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.913772 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.914806 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-88.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.914838 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-88.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.914855 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-88.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.914990 2549 policy_none.go:49] "None policy: Start" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.915013 2549 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.915027 2549 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.915107 2549 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.916031 2549 policy_none.go:47] "Start" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:28.918102 2549 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-88.ec2.internal\" not found" node="ip-10-0-138-88.ec2.internal" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.951835 2549 manager.go:337] "Starting Device Plugin manager" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:28.951895 2549 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.951906 2549 server.go:87] "Starting device plugin registration server" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.952143 2549 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.952172 2549 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.952502 2549 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.952578 2549 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.952586 2549 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:28.953379 2549 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:28.953435 2549 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-88.ec2.internal\" not found" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.991301 2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.992467 2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.992501 2549 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.992521 2549 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:28.992598 2549 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:28.995334 2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.053598 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.054889 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-88.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.054917 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-88.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.054928 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-88.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.054956 2549 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-88.ec2.internal" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.064017 2549 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-88.ec2.internal" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:29.064038 2549 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-88.ec2.internal\": node \"ip-10-0-138-88.ec2.internal\" not found" Jun 08 21:57:29.180475 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:29.078124 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-88.ec2.internal\" not found" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.093001 2549 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-88.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-88.ec2.internal"] Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.093063 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.094019 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-88.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.094048 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-88.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.094058 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-88.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.094252 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/69e0e80181a08fcb92a4752ec5eca717-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-88.ec2.internal\" (UID: \"69e0e80181a08fcb92a4752ec5eca717\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-88.ec2.internal" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.094277 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69e0e80181a08fcb92a4752ec5eca717-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-88.ec2.internal\" (UID: \"69e0e80181a08fcb92a4752ec5eca717\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-88.ec2.internal" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.095262 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.095433 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-88.ec2.internal" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.095487 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.096053 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-88.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.096072 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-88.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.096086 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-88.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.097283 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-88.ec2.internal" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.097303 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.097412 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-88.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.097424 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-88.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.097432 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-88.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.098186 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-88.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.098203 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-88.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.098217 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-88.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:29.132984 2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-88.ec2.internal\" not found" node="ip-10-0-138-88.ec2.internal" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:29.138921 2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-88.ec2.internal\" not found" node="ip-10-0-138-88.ec2.internal" Jun 08 21:57:29.181753 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:29.178328 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-88.ec2.internal\" not found" Jun 08 21:57:29.194737 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.194714 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/69e0e80181a08fcb92a4752ec5eca717-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-88.ec2.internal\" (UID: \"69e0e80181a08fcb92a4752ec5eca717\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-88.ec2.internal" Jun 08 21:57:29.194820 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.194742 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69e0e80181a08fcb92a4752ec5eca717-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-88.ec2.internal\" (UID: \"69e0e80181a08fcb92a4752ec5eca717\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-88.ec2.internal" Jun 08 21:57:29.194820 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.194782 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69e0e80181a08fcb92a4752ec5eca717-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-88.ec2.internal\" (UID: \"69e0e80181a08fcb92a4752ec5eca717\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-88.ec2.internal" Jun 08 21:57:29.194881 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.194818 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/69e0e80181a08fcb92a4752ec5eca717-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-88.ec2.internal\" (UID: \"69e0e80181a08fcb92a4752ec5eca717\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-88.ec2.internal" Jun 08 21:57:29.279101 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:29.279058 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-88.ec2.internal\" not found" Jun 08 21:57:29.295330 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.295295 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e25ad584d13e34d4cb3733b3bdccab49-config\") pod \"kube-apiserver-proxy-ip-10-0-138-88.ec2.internal\" (UID: \"e25ad584d13e34d4cb3733b3bdccab49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-88.ec2.internal" Jun 08 21:57:29.379705 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:29.379680 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-88.ec2.internal\" not found" Jun 08 21:57:29.395944 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.395916 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e25ad584d13e34d4cb3733b3bdccab49-config\") pod \"kube-apiserver-proxy-ip-10-0-138-88.ec2.internal\" (UID: \"e25ad584d13e34d4cb3733b3bdccab49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-88.ec2.internal" Jun 08 21:57:29.396001 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.395975 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e25ad584d13e34d4cb3733b3bdccab49-config\") pod \"kube-apiserver-proxy-ip-10-0-138-88.ec2.internal\" (UID: \"e25ad584d13e34d4cb3733b3bdccab49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-88.ec2.internal" Jun 08 21:57:29.438063 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.438042 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-88.ec2.internal" Jun 08 21:57:29.442865 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.442846 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-88.ec2.internal" Jun 08 21:57:29.480783 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:29.480753 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-88.ec2.internal\" not found" Jun 08 21:57:29.581169 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:29.581136 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-88.ec2.internal\" not found" Jun 08 21:57:29.681642 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:29.681609 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-88.ec2.internal\" not found" Jun 08 21:57:29.782180 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:29.782079 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-88.ec2.internal\" not found" Jun 08 21:57:29.827581 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.827550 2549 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 21:57:29.828219 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.827705 2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 21:57:29.828219 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.827738 2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 21:57:29.883088 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:29.883052 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-88.ec2.internal\" not found" Jun 08 21:57:29.892571 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.892537 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 21:52:28 +0000 UTC" deadline="2027-11-18 09:56:26.325209796 +0000 UTC" Jun 08 21:57:29.892571 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.892567 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12659h58m56.432646696s" Jun 08 21:57:29.971804 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:29.971630 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode25ad584d13e34d4cb3733b3bdccab49.slice/crio-317a87cb72f00bd5c52ffb5f0f0c33cf855bb4fa80adc1ea592116211054b189 WatchSource:0}: Error finding container 317a87cb72f00bd5c52ffb5f0f0c33cf855bb4fa80adc1ea592116211054b189: Status 404 returned error can't find the container with id 317a87cb72f00bd5c52ffb5f0f0c33cf855bb4fa80adc1ea592116211054b189 Jun 08 21:57:29.972333 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:29.972308 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69e0e80181a08fcb92a4752ec5eca717.slice/crio-28c03de00799f0c30762a759912b38874db726d219b24973ec29df553a4121a8 WatchSource:0}: Error finding container 28c03de00799f0c30762a759912b38874db726d219b24973ec29df553a4121a8: Status 404 returned error can't find the container with id 28c03de00799f0c30762a759912b38874db726d219b24973ec29df553a4121a8 Jun 08 21:57:29.977365 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.977350 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 21:57:29.983989 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:29.983964 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-88.ec2.internal\" not found" Jun 08 21:57:29.996719 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.996675 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-88.ec2.internal" event={"ID":"69e0e80181a08fcb92a4752ec5eca717","Type":"ContainerStarted","Data":"28c03de00799f0c30762a759912b38874db726d219b24973ec29df553a4121a8"} Jun 08 21:57:29.997702 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:29.997681 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-88.ec2.internal" event={"ID":"e25ad584d13e34d4cb3733b3bdccab49","Type":"ContainerStarted","Data":"317a87cb72f00bd5c52ffb5f0f0c33cf855bb4fa80adc1ea592116211054b189"} Jun 08 21:57:30.085016 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:30.084949 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-88.ec2.internal\" not found" Jun 08 21:57:30.176444 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.176410 2549 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:57:30.185694 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:30.185672 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-88.ec2.internal\" not found" Jun 08 21:57:30.242657 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.242622 2549 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:57:30.294903 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.294861 2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-88.ec2.internal" Jun 08 21:57:30.306337 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.306303 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 21:57:30.307417 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.307389 2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-88.ec2.internal" Jun 08 21:57:30.316115 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.316093 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 21:57:30.849516 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.849480 2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:57:30.870712 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.870684 2549 apiserver.go:52] "Watching apiserver" Jun 08 21:57:30.879383 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.879357 2549 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 21:57:30.880715 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.880679 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-dddlj","openshift-network-diagnostics/network-check-target-vs6km","kube-system/konnectivity-agent-nnkbc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8","openshift-cluster-node-tuning-operator/tuned-z6j2x","openshift-dns/node-resolver-j7qkw","openshift-multus/multus-additional-cni-plugins-pp9j6","openshift-multus/network-metrics-daemon-4pmzz","openshift-network-operator/iptables-alerter-4wv7c","openshift-ovn-kubernetes/ovnkube-node-qqzs7","kube-system/global-pull-secret-syncer-vv87w","kube-system/kube-apiserver-proxy-ip-10-0-138-88.ec2.internal","openshift-image-registry/node-ca-psfzx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-88.ec2.internal"] Jun 08 21:57:30.882294 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.882267 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:30.883437 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.883415 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-psfzx" Jun 08 21:57:30.884659 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.884639 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nnkbc" Jun 08 21:57:30.884800 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.884781 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 21:57:30.885053 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.885030 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 21:57:30.885201 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.885184 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 21:57:30.885276 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.885186 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 21:57:30.885276 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.885217 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 21:57:30.885416 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.885399 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9lkdl\"" Jun 08 21:57:30.885787 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.885660 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 21:57:30.885787 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.885682 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 21:57:30.885787 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.885697 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 21:57:30.888967 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.886704 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nj6xg\"" Jun 08 21:57:30.888967 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.886971 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 21:57:30.888967 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.887006 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 21:57:30.888967 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.887192 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v2vvh\"" Jun 08 21:57:30.888967 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.887857 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:30.890242 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.889940 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:30.890330 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.890275 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 21:57:30.890498 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.890474 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-szr9r\"" Jun 08 21:57:30.890610 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.890541 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 21:57:30.890772 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.890754 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 21:57:30.891402 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.891381 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j7qkw" Jun 08 21:57:30.892475 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.892455 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b2dkt\"" Jun 08 21:57:30.892573 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.892461 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 21:57:30.892655 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.892636 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 21:57:30.893516 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.893495 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4wv7c" Jun 08 21:57:30.893612 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.893586 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 21:57:30.893873 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.893855 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 21:57:30.894130 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.893935 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qsrt9\"" Jun 08 21:57:30.894130 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.894007 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 21:57:30.894997 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.894977 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dddlj" Jun 08 21:57:30.895671 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.895652 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sm2lz\"" Jun 08 21:57:30.895887 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.895868 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 21:57:30.896204 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.896186 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 21:57:30.896275 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.896219 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 21:57:30.896348 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.896333 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:30.896440 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:30.896410 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs6km" podUID="38f827a0-8c60-4ca9-8a81-98e05477d762" Jun 08 21:57:30.897203 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.897186 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w7w99\"" Jun 08 21:57:30.897298 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.897272 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 21:57:30.897660 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.897638 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:30.899067 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.899049 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:30.899179 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:30.899116 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vv87w" podUID="80169240-476c-4146-8a59-63cf33decac4" Jun 08 21:57:30.899977 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.899900 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 21:57:30.900126 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.900108 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 21:57:30.900225 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.900207 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 21:57:30.900284 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.900248 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 21:57:30.900399 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.900379 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 21:57:30.900480 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.900385 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:30.900480 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:30.900463 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pmzz" podUID="12b6a387-cd80-4157-8c91-00fdb3ee3676" Jun 08 21:57:30.900594 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.900510 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 21:57:30.900649 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.900596 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6ps69\"" Jun 08 21:57:30.904514 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.904493 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-os-release\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:30.904610 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.904527 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59f23391-dc4a-4dec-b7bf-6263e375f0d0-agent-certs\") pod \"konnectivity-agent-nnkbc\" (UID: \"59f23391-dc4a-4dec-b7bf-6263e375f0d0\") " pod="kube-system/konnectivity-agent-nnkbc" Jun 08 21:57:30.904610 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.904555 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z28g4\" (UniqueName: \"kubernetes.io/projected/a28deb3e-bbc1-4ce0-a5b0-717125c9d872-kube-api-access-z28g4\") pod \"node-ca-psfzx\" (UID: \"a28deb3e-bbc1-4ce0-a5b0-717125c9d872\") " pod="openshift-image-registry/node-ca-psfzx" Jun 08 21:57:30.904610 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.904581 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-multus-socket-dir-parent\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:30.904820 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.904618 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-host-run-k8s-cni-cncf-io\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:30.904820 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.904665 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88a8a02d-821d-4ef8-b073-8901d5505dd2-tmp-dir\") pod \"node-resolver-j7qkw\" (UID: \"88a8a02d-821d-4ef8-b073-8901d5505dd2\") " pod="openshift-dns/node-resolver-j7qkw" Jun 08 21:57:30.904820 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.904696 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-cni-binary-copy\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:30.904820 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.904726 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:30.904820 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.904752 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qvk8\" (UniqueName: \"kubernetes.io/projected/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-kube-api-access-7qvk8\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:30.904820 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.904790 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlzkg\" (UniqueName: \"kubernetes.io/projected/88a8a02d-821d-4ef8-b073-8901d5505dd2-kube-api-access-jlzkg\") pod \"node-resolver-j7qkw\" (UID: \"88a8a02d-821d-4ef8-b073-8901d5505dd2\") " pod="openshift-dns/node-resolver-j7qkw" Jun 08 21:57:30.904820 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.904817 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/88a8a02d-821d-4ef8-b073-8901d5505dd2-hosts-file\") pod \"node-resolver-j7qkw\" (UID: \"88a8a02d-821d-4ef8-b073-8901d5505dd2\") " pod="openshift-dns/node-resolver-j7qkw" Jun 08 21:57:30.905116 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.904858 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-host-run-multus-certs\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:30.905116 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.904885 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/91f2e421-30e3-425d-9017-576eff7f47b7-etc-selinux\") pod \"aws-ebs-csi-driver-node-cpmk8\" (UID: \"91f2e421-30e3-425d-9017-576eff7f47b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:30.905116 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.904907 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-host-var-lib-kubelet\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:30.905116 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.904932 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-system-cni-dir\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:30.905116 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.904953 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-lib-modules\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:30.905116 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.904970 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96e292e7-6c56-4a6c-82cb-8a963bb54608-host-slash\") pod \"iptables-alerter-4wv7c\" (UID: \"96e292e7-6c56-4a6c-82cb-8a963bb54608\") " pod="openshift-network-operator/iptables-alerter-4wv7c" Jun 08 21:57:30.905116 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.904993 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnbrg\" (UniqueName: \"kubernetes.io/projected/96e292e7-6c56-4a6c-82cb-8a963bb54608-kube-api-access-wnbrg\") pod \"iptables-alerter-4wv7c\" (UID: \"96e292e7-6c56-4a6c-82cb-8a963bb54608\") " pod="openshift-network-operator/iptables-alerter-4wv7c" Jun 08 21:57:30.905116 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905033 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-host-run-netns\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:30.905116 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905066 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-host-var-lib-cni-bin\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:30.905116 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905092 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/91f2e421-30e3-425d-9017-576eff7f47b7-registration-dir\") pod \"aws-ebs-csi-driver-node-cpmk8\" (UID: \"91f2e421-30e3-425d-9017-576eff7f47b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:30.905116 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905116 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-cnibin\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:30.905644 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905137 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-etc-sysctl-d\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:30.905644 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905176 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-host-var-lib-cni-multus\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:30.905644 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905207 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-run\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:30.905644 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905228 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-sys\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:30.905644 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905249 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/91f2e421-30e3-425d-9017-576eff7f47b7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cpmk8\" (UID: \"91f2e421-30e3-425d-9017-576eff7f47b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:30.905644 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905284 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-multus-conf-dir\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:30.905644 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905325 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:30.905644 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905358 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-etc-modprobe-d\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:30.905644 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905396 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-etc-sysctl-conf\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:30.905644 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905439 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-etc-systemd\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:30.905644 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905475 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-var-lib-kubelet\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:30.905644 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905503 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmlgc\" (UniqueName: \"kubernetes.io/projected/863504e7-abe7-4100-8f40-55c12bb6a39b-kube-api-access-cmlgc\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:30.905644 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905526 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/91f2e421-30e3-425d-9017-576eff7f47b7-sys-fs\") pod \"aws-ebs-csi-driver-node-cpmk8\" (UID: \"91f2e421-30e3-425d-9017-576eff7f47b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:30.905644 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905549 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-system-cni-dir\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:30.905644 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905572 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-os-release\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:30.905644 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905601 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/91f2e421-30e3-425d-9017-576eff7f47b7-socket-dir\") pod \"aws-ebs-csi-driver-node-cpmk8\" (UID: \"91f2e421-30e3-425d-9017-576eff7f47b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:30.906447 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905628 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59f23391-dc4a-4dec-b7bf-6263e375f0d0-konnectivity-ca\") pod \"konnectivity-agent-nnkbc\" (UID: \"59f23391-dc4a-4dec-b7bf-6263e375f0d0\") " pod="kube-system/konnectivity-agent-nnkbc" Jun 08 21:57:30.906447 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905649 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-etc-kubernetes\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:30.906447 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905669 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5dda922b-0f2f-4727-9730-6988a0b48044-multus-daemon-config\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:30.906447 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905691 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-multus-cni-dir\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:30.906447 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905709 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/863504e7-abe7-4100-8f40-55c12bb6a39b-tmp\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:30.906447 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905731 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a28deb3e-bbc1-4ce0-a5b0-717125c9d872-host\") pod \"node-ca-psfzx\" (UID: \"a28deb3e-bbc1-4ce0-a5b0-717125c9d872\") " pod="openshift-image-registry/node-ca-psfzx" Jun 08 21:57:30.906447 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905760 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a28deb3e-bbc1-4ce0-a5b0-717125c9d872-serviceca\") pod \"node-ca-psfzx\" (UID: \"a28deb3e-bbc1-4ce0-a5b0-717125c9d872\") " pod="openshift-image-registry/node-ca-psfzx" Jun 08 21:57:30.906447 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905783 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-etc-kubernetes\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:30.906447 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905829 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll78b\" (UniqueName: \"kubernetes.io/projected/91f2e421-30e3-425d-9017-576eff7f47b7-kube-api-access-ll78b\") pod \"aws-ebs-csi-driver-node-cpmk8\" (UID: \"91f2e421-30e3-425d-9017-576eff7f47b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:30.906447 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905864 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dda922b-0f2f-4727-9730-6988a0b48044-cni-binary-copy\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:30.906447 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905887 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzdd6\" (UniqueName: \"kubernetes.io/projected/5dda922b-0f2f-4727-9730-6988a0b48044-kube-api-access-pzdd6\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:30.906447 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905912 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:30.906447 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905932 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-host\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:30.906447 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905953 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-etc-sysconfig\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:30.906447 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.905991 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/863504e7-abe7-4100-8f40-55c12bb6a39b-etc-tuned\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:30.906447 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.906029 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/96e292e7-6c56-4a6c-82cb-8a963bb54608-iptables-alerter-script\") pod \"iptables-alerter-4wv7c\" (UID: \"96e292e7-6c56-4a6c-82cb-8a963bb54608\") " pod="openshift-network-operator/iptables-alerter-4wv7c" Jun 08 21:57:30.906447 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.906052 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/91f2e421-30e3-425d-9017-576eff7f47b7-device-dir\") pod \"aws-ebs-csi-driver-node-cpmk8\" (UID: \"91f2e421-30e3-425d-9017-576eff7f47b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:30.907340 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.906073 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-cnibin\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:30.907340 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.906089 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-hostroot\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:30.908286 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.908262 2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 21:57:30.925967 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.925940 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vmpng" Jun 08 21:57:30.931670 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.931649 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vmpng" Jun 08 21:57:30.995685 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:30.995653 2549 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 21:57:31.006694 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.006658 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/863504e7-abe7-4100-8f40-55c12bb6a39b-tmp\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.006859 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.006696 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a28deb3e-bbc1-4ce0-a5b0-717125c9d872-host\") pod \"node-ca-psfzx\" (UID: \"a28deb3e-bbc1-4ce0-a5b0-717125c9d872\") " pod="openshift-image-registry/node-ca-psfzx" Jun 08 21:57:31.006859 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.006724 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a28deb3e-bbc1-4ce0-a5b0-717125c9d872-serviceca\") pod \"node-ca-psfzx\" (UID: \"a28deb3e-bbc1-4ce0-a5b0-717125c9d872\") " pod="openshift-image-registry/node-ca-psfzx" Jun 08 21:57:31.006859 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.006748 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-etc-kubernetes\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.006859 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.006811 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a28deb3e-bbc1-4ce0-a5b0-717125c9d872-host\") pod \"node-ca-psfzx\" (UID: \"a28deb3e-bbc1-4ce0-a5b0-717125c9d872\") " pod="openshift-image-registry/node-ca-psfzx" Jun 08 21:57:31.006859 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.006841 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-etc-kubernetes\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.007119 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.006932 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-node-log\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.007119 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.006974 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/80169240-476c-4146-8a59-63cf33decac4-dbus\") pod \"global-pull-secret-syncer-vv87w\" (UID: \"80169240-476c-4146-8a59-63cf33decac4\") " pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:31.007119 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007004 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret\") pod \"global-pull-secret-syncer-vv87w\" (UID: \"80169240-476c-4146-8a59-63cf33decac4\") " pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:31.007119 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007058 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll78b\" (UniqueName: \"kubernetes.io/projected/91f2e421-30e3-425d-9017-576eff7f47b7-kube-api-access-ll78b\") pod \"aws-ebs-csi-driver-node-cpmk8\" (UID: \"91f2e421-30e3-425d-9017-576eff7f47b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:31.007119 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007084 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dda922b-0f2f-4727-9730-6988a0b48044-cni-binary-copy\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.007119 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007079 2549 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 21:57:31.007119 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007113 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzdd6\" (UniqueName: \"kubernetes.io/projected/5dda922b-0f2f-4727-9730-6988a0b48044-kube-api-access-pzdd6\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.007464 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007137 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:31.007464 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007180 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-host\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.007464 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007206 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-host-run-ovn-kubernetes\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.007464 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007231 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-etc-sysconfig\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.007464 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007244 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a28deb3e-bbc1-4ce0-a5b0-717125c9d872-serviceca\") pod \"node-ca-psfzx\" (UID: \"a28deb3e-bbc1-4ce0-a5b0-717125c9d872\") " pod="openshift-image-registry/node-ca-psfzx" Jun 08 21:57:31.007464 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007253 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/863504e7-abe7-4100-8f40-55c12bb6a39b-etc-tuned\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.007464 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007277 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/96e292e7-6c56-4a6c-82cb-8a963bb54608-iptables-alerter-script\") pod \"iptables-alerter-4wv7c\" (UID: \"96e292e7-6c56-4a6c-82cb-8a963bb54608\") " pod="openshift-network-operator/iptables-alerter-4wv7c" Jun 08 21:57:31.007464 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007300 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/91f2e421-30e3-425d-9017-576eff7f47b7-device-dir\") pod \"aws-ebs-csi-driver-node-cpmk8\" (UID: \"91f2e421-30e3-425d-9017-576eff7f47b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:31.007464 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007302 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-host\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.007464 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007322 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-etc-sysconfig\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.007464 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007328 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-cnibin\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.007464 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007351 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-hostroot\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.007464 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007369 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/91f2e421-30e3-425d-9017-576eff7f47b7-device-dir\") pod \"aws-ebs-csi-driver-node-cpmk8\" (UID: \"91f2e421-30e3-425d-9017-576eff7f47b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:31.007464 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007374 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-os-release\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:31.007464 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007399 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59f23391-dc4a-4dec-b7bf-6263e375f0d0-agent-certs\") pod \"konnectivity-agent-nnkbc\" (UID: \"59f23391-dc4a-4dec-b7bf-6263e375f0d0\") " pod="kube-system/konnectivity-agent-nnkbc" Jun 08 21:57:31.007464 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007415 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-cnibin\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.007464 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007422 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-host-run-netns\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.008184 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007469 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-run-systemd\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.008184 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007473 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-os-release\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:31.008184 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007501 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/45dc9f10-d2cc-4e5c-8871-09027d251cb4-ovnkube-config\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.008184 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007528 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z28g4\" (UniqueName: \"kubernetes.io/projected/a28deb3e-bbc1-4ce0-a5b0-717125c9d872-kube-api-access-z28g4\") pod \"node-ca-psfzx\" (UID: \"a28deb3e-bbc1-4ce0-a5b0-717125c9d872\") " pod="openshift-image-registry/node-ca-psfzx" Jun 08 21:57:31.008184 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007552 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-multus-socket-dir-parent\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.008184 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007575 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-log-socket\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.008184 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007600 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-host-run-k8s-cni-cncf-io\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.008184 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007623 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/80169240-476c-4146-8a59-63cf33decac4-kubelet-config\") pod \"global-pull-secret-syncer-vv87w\" (UID: \"80169240-476c-4146-8a59-63cf33decac4\") " pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:31.008184 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007648 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88a8a02d-821d-4ef8-b073-8901d5505dd2-tmp-dir\") pod \"node-resolver-j7qkw\" (UID: \"88a8a02d-821d-4ef8-b073-8901d5505dd2\") " pod="openshift-dns/node-resolver-j7qkw" Jun 08 21:57:31.008184 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007673 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-cni-binary-copy\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:31.008184 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007702 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:31.008184 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007730 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qvk8\" (UniqueName: \"kubernetes.io/projected/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-kube-api-access-7qvk8\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:31.008184 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007744 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dda922b-0f2f-4727-9730-6988a0b48044-cni-binary-copy\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.008184 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007744 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:31.008184 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007757 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlzkg\" (UniqueName: \"kubernetes.io/projected/88a8a02d-821d-4ef8-b073-8901d5505dd2-kube-api-access-jlzkg\") pod \"node-resolver-j7qkw\" (UID: \"88a8a02d-821d-4ef8-b073-8901d5505dd2\") " pod="openshift-dns/node-resolver-j7qkw" Jun 08 21:57:31.008184 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007786 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/45dc9f10-d2cc-4e5c-8871-09027d251cb4-ovnkube-script-lib\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.008184 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007864 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/96e292e7-6c56-4a6c-82cb-8a963bb54608-iptables-alerter-script\") pod \"iptables-alerter-4wv7c\" (UID: \"96e292e7-6c56-4a6c-82cb-8a963bb54608\") " pod="openshift-network-operator/iptables-alerter-4wv7c" Jun 08 21:57:31.008937 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007885 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-hostroot\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.008937 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007912 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/88a8a02d-821d-4ef8-b073-8901d5505dd2-hosts-file\") pod \"node-resolver-j7qkw\" (UID: \"88a8a02d-821d-4ef8-b073-8901d5505dd2\") " pod="openshift-dns/node-resolver-j7qkw" Jun 08 21:57:31.008937 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007940 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-host-run-multus-certs\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.008937 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.007968 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/91f2e421-30e3-425d-9017-576eff7f47b7-etc-selinux\") pod \"aws-ebs-csi-driver-node-cpmk8\" (UID: \"91f2e421-30e3-425d-9017-576eff7f47b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:31.008937 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008020 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-host-var-lib-kubelet\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.008937 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008044 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-system-cni-dir\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:31.008937 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008068 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-lib-modules\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.008937 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008091 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96e292e7-6c56-4a6c-82cb-8a963bb54608-host-slash\") pod \"iptables-alerter-4wv7c\" (UID: \"96e292e7-6c56-4a6c-82cb-8a963bb54608\") " pod="openshift-network-operator/iptables-alerter-4wv7c" Jun 08 21:57:31.008937 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008117 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnbrg\" (UniqueName: \"kubernetes.io/projected/96e292e7-6c56-4a6c-82cb-8a963bb54608-kube-api-access-wnbrg\") pod \"iptables-alerter-4wv7c\" (UID: \"96e292e7-6c56-4a6c-82cb-8a963bb54608\") " pod="openshift-network-operator/iptables-alerter-4wv7c" Jun 08 21:57:31.008937 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008134 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88a8a02d-821d-4ef8-b073-8901d5505dd2-tmp-dir\") pod \"node-resolver-j7qkw\" (UID: \"88a8a02d-821d-4ef8-b073-8901d5505dd2\") " pod="openshift-dns/node-resolver-j7qkw" Jun 08 21:57:31.008937 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008141 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-host-run-netns\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.008937 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008172 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/88a8a02d-821d-4ef8-b073-8901d5505dd2-hosts-file\") pod \"node-resolver-j7qkw\" (UID: \"88a8a02d-821d-4ef8-b073-8901d5505dd2\") " pod="openshift-dns/node-resolver-j7qkw" Jun 08 21:57:31.008937 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008191 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-host-var-lib-cni-bin\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.008937 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008245 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-host-run-k8s-cni-cncf-io\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.008937 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008250 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-system-cni-dir\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:31.008937 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008247 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/91f2e421-30e3-425d-9017-576eff7f47b7-registration-dir\") pod \"aws-ebs-csi-driver-node-cpmk8\" (UID: \"91f2e421-30e3-425d-9017-576eff7f47b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:31.008937 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008272 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:31.009696 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008284 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-cnibin\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:31.009696 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008297 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-multus-socket-dir-parent\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.009696 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008306 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-etc-sysctl-d\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.009696 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008324 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96e292e7-6c56-4a6c-82cb-8a963bb54608-host-slash\") pod \"iptables-alerter-4wv7c\" (UID: \"96e292e7-6c56-4a6c-82cb-8a963bb54608\") " pod="openshift-network-operator/iptables-alerter-4wv7c" Jun 08 21:57:31.009696 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008329 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-etc-openvswitch\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.009696 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008337 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-host-run-netns\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.009696 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008350 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-run-openvswitch\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.009696 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008357 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-host-var-lib-cni-bin\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.009696 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008400 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/91f2e421-30e3-425d-9017-576eff7f47b7-etc-selinux\") pod \"aws-ebs-csi-driver-node-cpmk8\" (UID: \"91f2e421-30e3-425d-9017-576eff7f47b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:31.009696 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008409 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/91f2e421-30e3-425d-9017-576eff7f47b7-registration-dir\") pod \"aws-ebs-csi-driver-node-cpmk8\" (UID: \"91f2e421-30e3-425d-9017-576eff7f47b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:31.009696 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008533 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-host-run-multus-certs\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.009696 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008580 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-host-var-lib-kubelet\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.009696 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008582 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-lib-modules\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.009696 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008609 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-host-var-lib-cni-multus\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.009696 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008617 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-etc-sysctl-d\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.009696 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008634 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-cnibin\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:31.009696 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008672 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-run\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.009696 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008700 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-sys\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.010516 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008739 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/91f2e421-30e3-425d-9017-576eff7f47b7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cpmk8\" (UID: \"91f2e421-30e3-425d-9017-576eff7f47b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:31.010516 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008752 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-run\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.010516 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008768 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grxjr\" (UniqueName: \"kubernetes.io/projected/12b6a387-cd80-4157-8c91-00fdb3ee3676-kube-api-access-grxjr\") pod \"network-metrics-daemon-4pmzz\" (UID: \"12b6a387-cd80-4157-8c91-00fdb3ee3676\") " pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:31.010516 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008813 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-sys\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.010516 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008824 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-cni-binary-copy\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:31.010516 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008839 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-host-var-lib-cni-multus\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.010516 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008841 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/91f2e421-30e3-425d-9017-576eff7f47b7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cpmk8\" (UID: \"91f2e421-30e3-425d-9017-576eff7f47b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:31.010516 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008877 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-systemd-units\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.010516 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008916 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-multus-conf-dir\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.010516 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008944 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:31.010516 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.008997 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-multus-conf-dir\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.010516 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009014 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-etc-modprobe-d\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.010516 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009045 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-etc-sysctl-conf\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.010516 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009067 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-etc-systemd\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.010516 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009090 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-var-lib-kubelet\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.010516 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009106 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-etc-modprobe-d\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.010516 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009136 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:31.011289 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009127 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmlgc\" (UniqueName: \"kubernetes.io/projected/863504e7-abe7-4100-8f40-55c12bb6a39b-kube-api-access-cmlgc\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.011289 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009182 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-etc-systemd\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.011289 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009203 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67q2k\" (UniqueName: \"kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k\") pod \"network-check-target-vs6km\" (UID: \"38f827a0-8c60-4ca9-8a81-98e05477d762\") " pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:31.011289 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009225 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-etc-sysctl-conf\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.011289 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009232 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/91f2e421-30e3-425d-9017-576eff7f47b7-sys-fs\") pod \"aws-ebs-csi-driver-node-cpmk8\" (UID: \"91f2e421-30e3-425d-9017-576eff7f47b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:31.011289 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009259 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-var-lib-kubelet\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.011289 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009263 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-system-cni-dir\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.011289 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009280 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/91f2e421-30e3-425d-9017-576eff7f47b7-sys-fs\") pod \"aws-ebs-csi-driver-node-cpmk8\" (UID: \"91f2e421-30e3-425d-9017-576eff7f47b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:31.011289 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009295 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-os-release\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.011289 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009303 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-system-cni-dir\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.011289 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009347 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs\") pod \"network-metrics-daemon-4pmzz\" (UID: \"12b6a387-cd80-4157-8c91-00fdb3ee3676\") " pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:31.011289 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009362 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-os-release\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.011289 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009375 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-host-kubelet\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.011289 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009398 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-host-slash\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.011289 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009431 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-host-cni-bin\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.011289 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009455 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.011289 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009497 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-host-cni-netd\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.011985 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009524 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82rq2\" (UniqueName: \"kubernetes.io/projected/45dc9f10-d2cc-4e5c-8871-09027d251cb4-kube-api-access-82rq2\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.011985 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009553 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/91f2e421-30e3-425d-9017-576eff7f47b7-socket-dir\") pod \"aws-ebs-csi-driver-node-cpmk8\" (UID: \"91f2e421-30e3-425d-9017-576eff7f47b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:31.011985 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009578 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59f23391-dc4a-4dec-b7bf-6263e375f0d0-konnectivity-ca\") pod \"konnectivity-agent-nnkbc\" (UID: \"59f23391-dc4a-4dec-b7bf-6263e375f0d0\") " pod="kube-system/konnectivity-agent-nnkbc" Jun 08 21:57:31.011985 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009601 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-etc-kubernetes\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.011985 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009623 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-run-ovn\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.011985 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009647 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/45dc9f10-d2cc-4e5c-8871-09027d251cb4-env-overrides\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.011985 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009666 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/91f2e421-30e3-425d-9017-576eff7f47b7-socket-dir\") pod \"aws-ebs-csi-driver-node-cpmk8\" (UID: \"91f2e421-30e3-425d-9017-576eff7f47b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:31.011985 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009672 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/45dc9f10-d2cc-4e5c-8871-09027d251cb4-ovn-node-metrics-cert\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.011985 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009696 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5dda922b-0f2f-4727-9730-6988a0b48044-multus-daemon-config\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.011985 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009723 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-multus-cni-dir\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.011985 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009742 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/863504e7-abe7-4100-8f40-55c12bb6a39b-etc-kubernetes\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.011985 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009748 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-var-lib-openvswitch\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.011985 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.009929 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dda922b-0f2f-4727-9730-6988a0b48044-multus-cni-dir\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.011985 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.010146 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59f23391-dc4a-4dec-b7bf-6263e375f0d0-konnectivity-ca\") pod \"konnectivity-agent-nnkbc\" (UID: \"59f23391-dc4a-4dec-b7bf-6263e375f0d0\") " pod="kube-system/konnectivity-agent-nnkbc" Jun 08 21:57:31.011985 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.010292 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5dda922b-0f2f-4727-9730-6988a0b48044-multus-daemon-config\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.011985 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.010969 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/863504e7-abe7-4100-8f40-55c12bb6a39b-etc-tuned\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.011985 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.011034 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/863504e7-abe7-4100-8f40-55c12bb6a39b-tmp\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.012585 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.011396 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59f23391-dc4a-4dec-b7bf-6263e375f0d0-agent-certs\") pod \"konnectivity-agent-nnkbc\" (UID: \"59f23391-dc4a-4dec-b7bf-6263e375f0d0\") " pod="kube-system/konnectivity-agent-nnkbc" Jun 08 21:57:31.016930 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.016903 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qvk8\" (UniqueName: \"kubernetes.io/projected/7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6-kube-api-access-7qvk8\") pod \"multus-additional-cni-plugins-pp9j6\" (UID: \"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6\") " pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:31.017918 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.017880 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzdd6\" (UniqueName: \"kubernetes.io/projected/5dda922b-0f2f-4727-9730-6988a0b48044-kube-api-access-pzdd6\") pod \"multus-dddlj\" (UID: \"5dda922b-0f2f-4727-9730-6988a0b48044\") " pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.018085 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.018058 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z28g4\" (UniqueName: \"kubernetes.io/projected/a28deb3e-bbc1-4ce0-a5b0-717125c9d872-kube-api-access-z28g4\") pod \"node-ca-psfzx\" (UID: \"a28deb3e-bbc1-4ce0-a5b0-717125c9d872\") " pod="openshift-image-registry/node-ca-psfzx" Jun 08 21:57:31.018326 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.018288 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlzkg\" (UniqueName: \"kubernetes.io/projected/88a8a02d-821d-4ef8-b073-8901d5505dd2-kube-api-access-jlzkg\") pod \"node-resolver-j7qkw\" (UID: \"88a8a02d-821d-4ef8-b073-8901d5505dd2\") " pod="openshift-dns/node-resolver-j7qkw" Jun 08 21:57:31.018442 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.018370 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmlgc\" (UniqueName: \"kubernetes.io/projected/863504e7-abe7-4100-8f40-55c12bb6a39b-kube-api-access-cmlgc\") pod \"tuned-z6j2x\" (UID: \"863504e7-abe7-4100-8f40-55c12bb6a39b\") " pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.019224 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.019204 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnbrg\" (UniqueName: \"kubernetes.io/projected/96e292e7-6c56-4a6c-82cb-8a963bb54608-kube-api-access-wnbrg\") pod \"iptables-alerter-4wv7c\" (UID: \"96e292e7-6c56-4a6c-82cb-8a963bb54608\") " pod="openshift-network-operator/iptables-alerter-4wv7c" Jun 08 21:57:31.019826 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.019809 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll78b\" (UniqueName: \"kubernetes.io/projected/91f2e421-30e3-425d-9017-576eff7f47b7-kube-api-access-ll78b\") pod \"aws-ebs-csi-driver-node-cpmk8\" (UID: \"91f2e421-30e3-425d-9017-576eff7f47b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:31.061381 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.061349 2549 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:57:31.110783 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.110666 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-etc-openvswitch\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.110783 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.110713 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-run-openvswitch\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.110783 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.110739 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grxjr\" (UniqueName: \"kubernetes.io/projected/12b6a387-cd80-4157-8c91-00fdb3ee3676-kube-api-access-grxjr\") pod \"network-metrics-daemon-4pmzz\" (UID: \"12b6a387-cd80-4157-8c91-00fdb3ee3676\") " pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:31.110783 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.110763 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-systemd-units\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.110783 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.110776 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-etc-openvswitch\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111220 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.110791 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67q2k\" (UniqueName: \"kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k\") pod \"network-check-target-vs6km\" (UID: \"38f827a0-8c60-4ca9-8a81-98e05477d762\") " pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:31.111220 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.110788 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-run-openvswitch\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111220 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.110830 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-systemd-units\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111220 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.110852 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs\") pod \"network-metrics-daemon-4pmzz\" (UID: \"12b6a387-cd80-4157-8c91-00fdb3ee3676\") " pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:31.111220 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.110868 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-host-kubelet\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111220 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.110890 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-host-slash\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111220 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.110911 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-host-cni-bin\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111220 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.110935 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111220 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:31.110957 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:31.111220 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.110954 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-host-kubelet\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111220 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.110986 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-host-cni-netd\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111220 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111024 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111220 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:31.111032 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs podName:12b6a387-cd80-4157-8c91-00fdb3ee3676 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:31.611009076 +0000 UTC m=+3.159895861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs") pod "network-metrics-daemon-4pmzz" (UID: "12b6a387-cd80-4157-8c91-00fdb3ee3676") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:31.111220 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.110958 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-host-cni-netd\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111220 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111026 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-host-slash\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111220 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111061 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82rq2\" (UniqueName: \"kubernetes.io/projected/45dc9f10-d2cc-4e5c-8871-09027d251cb4-kube-api-access-82rq2\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111220 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111087 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-run-ovn\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111997 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111029 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-host-cni-bin\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111997 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111146 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-run-ovn\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111997 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111109 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/45dc9f10-d2cc-4e5c-8871-09027d251cb4-env-overrides\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111997 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111199 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/45dc9f10-d2cc-4e5c-8871-09027d251cb4-ovn-node-metrics-cert\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111997 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111226 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-var-lib-openvswitch\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111997 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111252 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-node-log\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111997 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111274 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/80169240-476c-4146-8a59-63cf33decac4-dbus\") pod \"global-pull-secret-syncer-vv87w\" (UID: \"80169240-476c-4146-8a59-63cf33decac4\") " pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:31.111997 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111298 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret\") pod \"global-pull-secret-syncer-vv87w\" (UID: \"80169240-476c-4146-8a59-63cf33decac4\") " pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:31.111997 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111328 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-host-run-ovn-kubernetes\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111997 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111343 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-node-log\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111997 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111357 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-host-run-netns\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111997 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111396 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-var-lib-openvswitch\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111997 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111403 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-host-run-netns\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111997 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111428 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-run-systemd\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111997 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111456 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/45dc9f10-d2cc-4e5c-8871-09027d251cb4-ovnkube-config\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111997 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111457 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/45dc9f10-d2cc-4e5c-8871-09027d251cb4-env-overrides\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.111997 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111492 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-log-socket\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.112617 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111515 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/80169240-476c-4146-8a59-63cf33decac4-kubelet-config\") pod \"global-pull-secret-syncer-vv87w\" (UID: \"80169240-476c-4146-8a59-63cf33decac4\") " pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:31.112617 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:31.111526 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:31.112617 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111533 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-run-systemd\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.112617 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111537 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/45dc9f10-d2cc-4e5c-8871-09027d251cb4-ovnkube-script-lib\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.112617 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111558 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-host-run-ovn-kubernetes\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.112617 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111524 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/80169240-476c-4146-8a59-63cf33decac4-dbus\") pod \"global-pull-secret-syncer-vv87w\" (UID: \"80169240-476c-4146-8a59-63cf33decac4\") " pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:31.112617 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:31.111583 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret podName:80169240-476c-4146-8a59-63cf33decac4 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:31.61156682 +0000 UTC m=+3.160453602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret") pod "global-pull-secret-syncer-vv87w" (UID: "80169240-476c-4146-8a59-63cf33decac4") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:31.112617 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111622 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/80169240-476c-4146-8a59-63cf33decac4-kubelet-config\") pod \"global-pull-secret-syncer-vv87w\" (UID: \"80169240-476c-4146-8a59-63cf33decac4\") " pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:31.112617 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111669 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/45dc9f10-d2cc-4e5c-8871-09027d251cb4-log-socket\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.112617 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111988 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/45dc9f10-d2cc-4e5c-8871-09027d251cb4-ovnkube-script-lib\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.112617 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.111994 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/45dc9f10-d2cc-4e5c-8871-09027d251cb4-ovnkube-config\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.113466 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.113446 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/45dc9f10-d2cc-4e5c-8871-09027d251cb4-ovn-node-metrics-cert\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.119875 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:31.119852 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:57:31.119875 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:31.119874 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:57:31.120026 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:31.119888 2549 projected.go:196] Error preparing data for projected volume kube-api-access-67q2k for pod openshift-network-diagnostics/network-check-target-vs6km: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:31.120026 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:31.119938 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k podName:38f827a0-8c60-4ca9-8a81-98e05477d762 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:31.619923065 +0000 UTC m=+3.168809852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-67q2k" (UniqueName: "kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k") pod "network-check-target-vs6km" (UID: "38f827a0-8c60-4ca9-8a81-98e05477d762") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:31.122226 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.122202 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grxjr\" (UniqueName: \"kubernetes.io/projected/12b6a387-cd80-4157-8c91-00fdb3ee3676-kube-api-access-grxjr\") pod \"network-metrics-daemon-4pmzz\" (UID: \"12b6a387-cd80-4157-8c91-00fdb3ee3676\") " pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:31.122383 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.122365 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82rq2\" (UniqueName: \"kubernetes.io/projected/45dc9f10-d2cc-4e5c-8871-09027d251cb4-kube-api-access-82rq2\") pod \"ovnkube-node-qqzs7\" (UID: \"45dc9f10-d2cc-4e5c-8871-09027d251cb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.195714 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.195667 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pp9j6" Jun 08 21:57:31.203324 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.203293 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-psfzx" Jun 08 21:57:31.211985 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.211956 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nnkbc" Jun 08 21:57:31.217538 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.217512 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" Jun 08 21:57:31.225174 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.225136 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" Jun 08 21:57:31.230758 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.230740 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j7qkw" Jun 08 21:57:31.239483 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.239462 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4wv7c" Jun 08 21:57:31.245208 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.245183 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dddlj" Jun 08 21:57:31.251895 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.251873 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:31.614572 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.614545 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret\") pod \"global-pull-secret-syncer-vv87w\" (UID: \"80169240-476c-4146-8a59-63cf33decac4\") " pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:31.614733 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.614636 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs\") pod \"network-metrics-daemon-4pmzz\" (UID: \"12b6a387-cd80-4157-8c91-00fdb3ee3676\") " pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:31.614733 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:31.614701 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:31.614733 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:31.614720 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:31.614832 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:31.614769 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret podName:80169240-476c-4146-8a59-63cf33decac4 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:32.614751064 +0000 UTC m=+4.163637833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret") pod "global-pull-secret-syncer-vv87w" (UID: "80169240-476c-4146-8a59-63cf33decac4") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:31.614832 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:31.614784 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs podName:12b6a387-cd80-4157-8c91-00fdb3ee3676 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:32.614777861 +0000 UTC m=+4.163664626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs") pod "network-metrics-daemon-4pmzz" (UID: "12b6a387-cd80-4157-8c91-00fdb3ee3676") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:31.714905 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.714873 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67q2k\" (UniqueName: \"kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k\") pod \"network-check-target-vs6km\" (UID: \"38f827a0-8c60-4ca9-8a81-98e05477d762\") " pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:31.715056 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:31.715019 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:57:31.715056 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:31.715034 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:57:31.715056 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:31.715043 2549 projected.go:196] Error preparing data for projected volume kube-api-access-67q2k for pod openshift-network-diagnostics/network-check-target-vs6km: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:31.715154 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:31.715086 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k podName:38f827a0-8c60-4ca9-8a81-98e05477d762 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:32.715072591 +0000 UTC m=+4.263959356 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-67q2k" (UniqueName: "kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k") pod "network-check-target-vs6km" (UID: "38f827a0-8c60-4ca9-8a81-98e05477d762") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:31.747398 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:31.747363 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88a8a02d_821d_4ef8_b073_8901d5505dd2.slice/crio-a53307dffa82acfeb17618f896b488bb5db45d4b12c364bbe7236fbbf68dfd95 WatchSource:0}: Error finding container a53307dffa82acfeb17618f896b488bb5db45d4b12c364bbe7236fbbf68dfd95: Status 404 returned error can't find the container with id a53307dffa82acfeb17618f896b488bb5db45d4b12c364bbe7236fbbf68dfd95 Jun 08 21:57:31.748675 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:31.748631 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e2d3d71_aa21_4d3b_8b72_f27cd1cb5fc6.slice/crio-28f9daaffbbbb1864848ca59acf111189297c2f5a6f41ec3d97ef8e3743e7678 WatchSource:0}: Error finding container 28f9daaffbbbb1864848ca59acf111189297c2f5a6f41ec3d97ef8e3743e7678: Status 404 returned error can't find the container with id 28f9daaffbbbb1864848ca59acf111189297c2f5a6f41ec3d97ef8e3743e7678 Jun 08 21:57:31.750572 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:31.750480 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dda922b_0f2f_4727_9730_6988a0b48044.slice/crio-d7ae5fbc64e9ddfa4a45c7949bbfa1c9bdc38a61c088ea94f4aff6d787599da8 WatchSource:0}: Error finding container d7ae5fbc64e9ddfa4a45c7949bbfa1c9bdc38a61c088ea94f4aff6d787599da8: Status 404 returned error can't find the container with id d7ae5fbc64e9ddfa4a45c7949bbfa1c9bdc38a61c088ea94f4aff6d787599da8 Jun 08 21:57:31.753935 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:31.753914 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91f2e421_30e3_425d_9017_576eff7f47b7.slice/crio-d78b1114652d2a2638b5a082ccfec831162d8d872b08725a2df7a54faf123f98 WatchSource:0}: Error finding container d78b1114652d2a2638b5a082ccfec831162d8d872b08725a2df7a54faf123f98: Status 404 returned error can't find the container with id d78b1114652d2a2638b5a082ccfec831162d8d872b08725a2df7a54faf123f98 Jun 08 21:57:31.755420 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:31.755397 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod863504e7_abe7_4100_8f40_55c12bb6a39b.slice/crio-66885e78b082ae366e6405038c85a9e8bd54d6ff14a8c152a405ad98782e8796 WatchSource:0}: Error finding container 66885e78b082ae366e6405038c85a9e8bd54d6ff14a8c152a405ad98782e8796: Status 404 returned error can't find the container with id 66885e78b082ae366e6405038c85a9e8bd54d6ff14a8c152a405ad98782e8796 Jun 08 21:57:31.756884 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:31.756865 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda28deb3e_bbc1_4ce0_a5b0_717125c9d872.slice/crio-98abee5864a04b1459474a938c8d1b5a448c6914ab3ff7a362d34e8e27be5c24 WatchSource:0}: Error finding container 98abee5864a04b1459474a938c8d1b5a448c6914ab3ff7a362d34e8e27be5c24: Status 404 returned error can't find the container with id 98abee5864a04b1459474a938c8d1b5a448c6914ab3ff7a362d34e8e27be5c24 Jun 08 21:57:31.758885 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:31.758863 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45dc9f10_d2cc_4e5c_8871_09027d251cb4.slice/crio-811b354195455d6589ab90671bc90bccc81fe625c1f6a5a322232766edd2c8a8 WatchSource:0}: Error finding container 811b354195455d6589ab90671bc90bccc81fe625c1f6a5a322232766edd2c8a8: Status 404 returned error can't find the container with id 811b354195455d6589ab90671bc90bccc81fe625c1f6a5a322232766edd2c8a8 Jun 08 21:57:31.759256 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:31.759142 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f23391_dc4a_4dec_b7bf_6263e375f0d0.slice/crio-40b24ef5abf5865e738b1f1d177ca3e48a57f0ca98405ef71f9213f76d043c2b WatchSource:0}: Error finding container 40b24ef5abf5865e738b1f1d177ca3e48a57f0ca98405ef71f9213f76d043c2b: Status 404 returned error can't find the container with id 40b24ef5abf5865e738b1f1d177ca3e48a57f0ca98405ef71f9213f76d043c2b Jun 08 21:57:31.759848 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:57:31.759825 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96e292e7_6c56_4a6c_82cb_8a963bb54608.slice/crio-5b74cd0003694ab4f75bbc6d1d42c26851c2a03d5a04d47908c24bc130b81d49 WatchSource:0}: Error finding container 5b74cd0003694ab4f75bbc6d1d42c26851c2a03d5a04d47908c24bc130b81d49: Status 404 returned error can't find the container with id 5b74cd0003694ab4f75bbc6d1d42c26851c2a03d5a04d47908c24bc130b81d49 Jun 08 21:57:31.934644 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.934593 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 21:52:30 +0000 UTC" deadline="2027-12-07 19:01:16.281801154 +0000 UTC" Jun 08 21:57:31.934644 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:31.934638 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13125h3m44.347166822s" Jun 08 21:57:32.001221 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:32.001190 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4wv7c" event={"ID":"96e292e7-6c56-4a6c-82cb-8a963bb54608","Type":"ContainerStarted","Data":"5b74cd0003694ab4f75bbc6d1d42c26851c2a03d5a04d47908c24bc130b81d49"} Jun 08 21:57:32.002312 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:32.002277 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" event={"ID":"863504e7-abe7-4100-8f40-55c12bb6a39b","Type":"ContainerStarted","Data":"66885e78b082ae366e6405038c85a9e8bd54d6ff14a8c152a405ad98782e8796"} Jun 08 21:57:32.003386 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:32.003368 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" event={"ID":"91f2e421-30e3-425d-9017-576eff7f47b7","Type":"ContainerStarted","Data":"d78b1114652d2a2638b5a082ccfec831162d8d872b08725a2df7a54faf123f98"} Jun 08 21:57:32.004547 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:32.004522 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pp9j6" event={"ID":"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6","Type":"ContainerStarted","Data":"28f9daaffbbbb1864848ca59acf111189297c2f5a6f41ec3d97ef8e3743e7678"} Jun 08 21:57:32.005623 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:32.005602 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j7qkw" event={"ID":"88a8a02d-821d-4ef8-b073-8901d5505dd2","Type":"ContainerStarted","Data":"a53307dffa82acfeb17618f896b488bb5db45d4b12c364bbe7236fbbf68dfd95"} Jun 08 21:57:32.007544 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:32.007525 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-88.ec2.internal" event={"ID":"e25ad584d13e34d4cb3733b3bdccab49","Type":"ContainerStarted","Data":"8ad0c5ad49b62db8cd52db9867ba7501c38bf4e67035b4e933a046944a9d0a8e"} Jun 08 21:57:32.008663 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:32.008637 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nnkbc" event={"ID":"59f23391-dc4a-4dec-b7bf-6263e375f0d0","Type":"ContainerStarted","Data":"40b24ef5abf5865e738b1f1d177ca3e48a57f0ca98405ef71f9213f76d043c2b"} Jun 08 21:57:32.009699 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:32.009682 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" event={"ID":"45dc9f10-d2cc-4e5c-8871-09027d251cb4","Type":"ContainerStarted","Data":"811b354195455d6589ab90671bc90bccc81fe625c1f6a5a322232766edd2c8a8"} Jun 08 21:57:32.010771 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:32.010743 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-psfzx" event={"ID":"a28deb3e-bbc1-4ce0-a5b0-717125c9d872","Type":"ContainerStarted","Data":"98abee5864a04b1459474a938c8d1b5a448c6914ab3ff7a362d34e8e27be5c24"} Jun 08 21:57:32.011927 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:32.011909 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dddlj" event={"ID":"5dda922b-0f2f-4727-9730-6988a0b48044","Type":"ContainerStarted","Data":"d7ae5fbc64e9ddfa4a45c7949bbfa1c9bdc38a61c088ea94f4aff6d787599da8"} Jun 08 21:57:32.022663 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:32.022617 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-88.ec2.internal" podStartSLOduration=2.022605519 podStartE2EDuration="2.022605519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:57:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:57:32.021019069 +0000 UTC m=+3.569905868" watchObservedRunningTime="2026-06-08 21:57:32.022605519 +0000 UTC m=+3.571492306" Jun 08 21:57:32.620408 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:32.620372 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs\") pod \"network-metrics-daemon-4pmzz\" (UID: \"12b6a387-cd80-4157-8c91-00fdb3ee3676\") " pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:32.620598 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:32.620427 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret\") pod \"global-pull-secret-syncer-vv87w\" (UID: \"80169240-476c-4146-8a59-63cf33decac4\") " pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:32.620668 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:32.620611 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:32.620713 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:32.620681 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret podName:80169240-476c-4146-8a59-63cf33decac4 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:34.620662564 +0000 UTC m=+6.169549347 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret") pod "global-pull-secret-syncer-vv87w" (UID: "80169240-476c-4146-8a59-63cf33decac4") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:32.627904 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:32.625376 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:32.627904 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:32.625478 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs podName:12b6a387-cd80-4157-8c91-00fdb3ee3676 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:34.625452091 +0000 UTC m=+6.174338866 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs") pod "network-metrics-daemon-4pmzz" (UID: "12b6a387-cd80-4157-8c91-00fdb3ee3676") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:32.720894 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:32.720826 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67q2k\" (UniqueName: \"kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k\") pod \"network-check-target-vs6km\" (UID: \"38f827a0-8c60-4ca9-8a81-98e05477d762\") " pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:32.721191 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:32.721153 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:57:32.721265 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:32.721201 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:57:32.721265 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:32.721215 2549 projected.go:196] Error preparing data for projected volume kube-api-access-67q2k for pod openshift-network-diagnostics/network-check-target-vs6km: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:32.721359 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:32.721276 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k podName:38f827a0-8c60-4ca9-8a81-98e05477d762 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:34.721255838 +0000 UTC m=+6.270142626 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-67q2k" (UniqueName: "kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k") pod "network-check-target-vs6km" (UID: "38f827a0-8c60-4ca9-8a81-98e05477d762") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:32.935796 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:32.935729 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 21:52:30 +0000 UTC" deadline="2027-12-29 19:37:21.281583869 +0000 UTC" Jun 08 21:57:32.935796 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:32.935796 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13653h39m48.345792419s" Jun 08 21:57:32.996577 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:32.995925 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:32.996577 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:32.996057 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs6km" podUID="38f827a0-8c60-4ca9-8a81-98e05477d762" Jun 08 21:57:32.996577 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:32.996262 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:32.996577 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:32.996370 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pmzz" podUID="12b6a387-cd80-4157-8c91-00fdb3ee3676" Jun 08 21:57:32.996577 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:32.996434 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:32.996577 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:32.996502 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vv87w" podUID="80169240-476c-4146-8a59-63cf33decac4" Jun 08 21:57:33.040969 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:33.040931 2549 generic.go:356] "Generic (PLEG): container finished" podID="69e0e80181a08fcb92a4752ec5eca717" containerID="10960f540696d9ce089954c2e5a75810d1e6df5cddb85580e4cbb9df7d6b48a4" exitCode=0 Jun 08 21:57:33.041527 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:33.041499 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-88.ec2.internal" event={"ID":"69e0e80181a08fcb92a4752ec5eca717","Type":"ContainerDied","Data":"10960f540696d9ce089954c2e5a75810d1e6df5cddb85580e4cbb9df7d6b48a4"} Jun 08 21:57:34.057576 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:34.057539 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-88.ec2.internal" event={"ID":"69e0e80181a08fcb92a4752ec5eca717","Type":"ContainerStarted","Data":"091fda090dca44da2c68e7402dcc21a1b685daf1172e9f66e33f5fa37bc3efbb"} Jun 08 21:57:34.636484 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:34.636448 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret\") pod \"global-pull-secret-syncer-vv87w\" (UID: \"80169240-476c-4146-8a59-63cf33decac4\") " pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:34.636688 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:34.636548 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs\") pod \"network-metrics-daemon-4pmzz\" (UID: \"12b6a387-cd80-4157-8c91-00fdb3ee3676\") " pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:34.636688 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:34.636683 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:34.636847 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:34.636745 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs podName:12b6a387-cd80-4157-8c91-00fdb3ee3676 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:38.636725341 +0000 UTC m=+10.185612109 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs") pod "network-metrics-daemon-4pmzz" (UID: "12b6a387-cd80-4157-8c91-00fdb3ee3676") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:34.637051 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:34.637032 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:34.637108 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:34.637092 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret podName:80169240-476c-4146-8a59-63cf33decac4 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:38.637075868 +0000 UTC m=+10.185962644 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret") pod "global-pull-secret-syncer-vv87w" (UID: "80169240-476c-4146-8a59-63cf33decac4") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:34.737425 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:34.737386 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67q2k\" (UniqueName: \"kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k\") pod \"network-check-target-vs6km\" (UID: \"38f827a0-8c60-4ca9-8a81-98e05477d762\") " pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:34.737610 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:34.737554 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:57:34.737610 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:34.737571 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:57:34.737610 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:34.737584 2549 projected.go:196] Error preparing data for projected volume kube-api-access-67q2k for pod openshift-network-diagnostics/network-check-target-vs6km: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:34.737763 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:34.737645 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k podName:38f827a0-8c60-4ca9-8a81-98e05477d762 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:38.737624955 +0000 UTC m=+10.286511727 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-67q2k" (UniqueName: "kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k") pod "network-check-target-vs6km" (UID: "38f827a0-8c60-4ca9-8a81-98e05477d762") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:34.993784 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:34.992720 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:34.993784 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:34.993062 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs6km" podUID="38f827a0-8c60-4ca9-8a81-98e05477d762" Jun 08 21:57:34.993784 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:34.993466 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:34.993784 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:34.993567 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vv87w" podUID="80169240-476c-4146-8a59-63cf33decac4" Jun 08 21:57:34.993784 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:34.993655 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:34.993784 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:34.993748 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pmzz" podUID="12b6a387-cd80-4157-8c91-00fdb3ee3676" Jun 08 21:57:36.997500 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:36.997463 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:36.997973 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:36.997598 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pmzz" podUID="12b6a387-cd80-4157-8c91-00fdb3ee3676" Jun 08 21:57:36.998035 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:36.998003 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:36.998110 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:36.998089 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs6km" podUID="38f827a0-8c60-4ca9-8a81-98e05477d762" Jun 08 21:57:36.998185 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:36.998108 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:36.998232 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:36.998205 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vv87w" podUID="80169240-476c-4146-8a59-63cf33decac4" Jun 08 21:57:38.674068 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:38.674013 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs\") pod \"network-metrics-daemon-4pmzz\" (UID: \"12b6a387-cd80-4157-8c91-00fdb3ee3676\") " pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:38.674527 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:38.674098 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret\") pod \"global-pull-secret-syncer-vv87w\" (UID: \"80169240-476c-4146-8a59-63cf33decac4\") " pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:38.674527 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:38.674192 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:38.674527 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:38.674192 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:38.674527 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:38.674270 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret podName:80169240-476c-4146-8a59-63cf33decac4 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:46.674248626 +0000 UTC m=+18.223135400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret") pod "global-pull-secret-syncer-vv87w" (UID: "80169240-476c-4146-8a59-63cf33decac4") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:38.674527 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:38.674304 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs podName:12b6a387-cd80-4157-8c91-00fdb3ee3676 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:46.674288723 +0000 UTC m=+18.223175489 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs") pod "network-metrics-daemon-4pmzz" (UID: "12b6a387-cd80-4157-8c91-00fdb3ee3676") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:38.775086 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:38.775029 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67q2k\" (UniqueName: \"kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k\") pod \"network-check-target-vs6km\" (UID: \"38f827a0-8c60-4ca9-8a81-98e05477d762\") " pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:38.775243 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:38.775219 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:57:38.775304 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:38.775243 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:57:38.775304 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:38.775256 2549 projected.go:196] Error preparing data for projected volume kube-api-access-67q2k for pod openshift-network-diagnostics/network-check-target-vs6km: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:38.775373 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:38.775312 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k podName:38f827a0-8c60-4ca9-8a81-98e05477d762 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:46.775295928 +0000 UTC m=+18.324182707 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-67q2k" (UniqueName: "kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k") pod "network-check-target-vs6km" (UID: "38f827a0-8c60-4ca9-8a81-98e05477d762") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:38.995277 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:38.994490 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:38.995277 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:38.994598 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs6km" podUID="38f827a0-8c60-4ca9-8a81-98e05477d762" Jun 08 21:57:38.995277 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:38.994954 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:38.995277 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:38.995053 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vv87w" podUID="80169240-476c-4146-8a59-63cf33decac4" Jun 08 21:57:38.995277 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:38.995103 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:38.995277 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:38.995191 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pmzz" podUID="12b6a387-cd80-4157-8c91-00fdb3ee3676" Jun 08 21:57:40.993417 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:40.993383 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:40.993902 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:40.993383 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:40.993902 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:40.993519 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs6km" podUID="38f827a0-8c60-4ca9-8a81-98e05477d762" Jun 08 21:57:40.993902 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:40.993388 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:40.993902 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:40.993623 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vv87w" podUID="80169240-476c-4146-8a59-63cf33decac4" Jun 08 21:57:40.993902 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:40.993689 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pmzz" podUID="12b6a387-cd80-4157-8c91-00fdb3ee3676" Jun 08 21:57:42.994254 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:42.993704 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:42.994254 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:42.993740 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:42.994254 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:42.993860 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs6km" podUID="38f827a0-8c60-4ca9-8a81-98e05477d762" Jun 08 21:57:42.994254 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:42.993870 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:42.994254 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:42.993968 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pmzz" podUID="12b6a387-cd80-4157-8c91-00fdb3ee3676" Jun 08 21:57:42.994254 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:42.994046 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vv87w" podUID="80169240-476c-4146-8a59-63cf33decac4" Jun 08 21:57:44.993374 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:44.993334 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:44.993841 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:44.993387 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:44.993841 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:44.993348 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:44.993841 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:44.993474 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vv87w" podUID="80169240-476c-4146-8a59-63cf33decac4" Jun 08 21:57:44.993841 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:44.993580 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pmzz" podUID="12b6a387-cd80-4157-8c91-00fdb3ee3676" Jun 08 21:57:44.993841 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:44.993657 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs6km" podUID="38f827a0-8c60-4ca9-8a81-98e05477d762" Jun 08 21:57:46.736920 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:46.736888 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs\") pod \"network-metrics-daemon-4pmzz\" (UID: \"12b6a387-cd80-4157-8c91-00fdb3ee3676\") " pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:46.736920 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:46.736936 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret\") pod \"global-pull-secret-syncer-vv87w\" (UID: \"80169240-476c-4146-8a59-63cf33decac4\") " pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:46.737549 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:46.737052 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:46.737549 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:46.737105 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret podName:80169240-476c-4146-8a59-63cf33decac4 nodeName:}" failed. No retries permitted until 2026-06-08 21:58:02.737092603 +0000 UTC m=+34.285979368 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret") pod "global-pull-secret-syncer-vv87w" (UID: "80169240-476c-4146-8a59-63cf33decac4") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:46.737549 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:46.737052 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:46.737549 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:46.737209 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs podName:12b6a387-cd80-4157-8c91-00fdb3ee3676 nodeName:}" failed. No retries permitted until 2026-06-08 21:58:02.737192847 +0000 UTC m=+34.286079617 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs") pod "network-metrics-daemon-4pmzz" (UID: "12b6a387-cd80-4157-8c91-00fdb3ee3676") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:46.837432 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:46.837357 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67q2k\" (UniqueName: \"kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k\") pod \"network-check-target-vs6km\" (UID: \"38f827a0-8c60-4ca9-8a81-98e05477d762\") " pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:46.837584 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:46.837521 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:57:46.837584 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:46.837540 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:57:46.837584 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:46.837552 2549 projected.go:196] Error preparing data for projected volume kube-api-access-67q2k for pod openshift-network-diagnostics/network-check-target-vs6km: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:46.837696 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:46.837608 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k podName:38f827a0-8c60-4ca9-8a81-98e05477d762 nodeName:}" failed. No retries permitted until 2026-06-08 21:58:02.837595089 +0000 UTC m=+34.386481855 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-67q2k" (UniqueName: "kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k") pod "network-check-target-vs6km" (UID: "38f827a0-8c60-4ca9-8a81-98e05477d762") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:46.993292 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:46.993251 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:46.993292 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:46.993285 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:46.993515 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:46.993413 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:46.993515 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:46.993408 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vv87w" podUID="80169240-476c-4146-8a59-63cf33decac4" Jun 08 21:57:46.993611 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:46.993515 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs6km" podUID="38f827a0-8c60-4ca9-8a81-98e05477d762" Jun 08 21:57:46.993611 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:46.993604 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pmzz" podUID="12b6a387-cd80-4157-8c91-00fdb3ee3676" Jun 08 21:57:48.994283 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:48.994249 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:48.994870 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:48.994367 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:48.994995 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:48.994395 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:48.995052 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:48.995019 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vv87w" podUID="80169240-476c-4146-8a59-63cf33decac4" Jun 08 21:57:48.995597 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:48.995567 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pmzz" podUID="12b6a387-cd80-4157-8c91-00fdb3ee3676" Jun 08 21:57:48.995699 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:48.995682 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs6km" podUID="38f827a0-8c60-4ca9-8a81-98e05477d762" Jun 08 21:57:50.995009 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:50.994980 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:50.995707 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:50.995106 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs6km" podUID="38f827a0-8c60-4ca9-8a81-98e05477d762" Jun 08 21:57:50.995707 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:50.995509 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:50.995707 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:50.995599 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vv87w" podUID="80169240-476c-4146-8a59-63cf33decac4" Jun 08 21:57:50.995707 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:50.995648 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:50.995907 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:50.995730 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pmzz" podUID="12b6a387-cd80-4157-8c91-00fdb3ee3676" Jun 08 21:57:51.095487 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:51.095102 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" event={"ID":"863504e7-abe7-4100-8f40-55c12bb6a39b","Type":"ContainerStarted","Data":"99d6c37eb2ca86477b852d169842402ab14d3b8e8d9d2b51ba5986b1fec90cf0"} Jun 08 21:57:51.121186 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:51.121110 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-z6j2x" podStartSLOduration=2.974617344 podStartE2EDuration="22.121091083s" totalImagesPullingTime="19.146473739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:57:51.120050947 +0000 UTC m=+22.668937761" watchObservedRunningTime="2026-06-08 21:57:51.121091083 +0000 UTC m=+22.669977872" Jun 08 21:57:51.122039 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:51.121993 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-88.ec2.internal" podStartSLOduration=21.121979828 podStartE2EDuration="21.121979828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:57:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:57:34.077651076 +0000 UTC m=+5.626537866" watchObservedRunningTime="2026-06-08 21:57:51.121979828 +0000 UTC m=+22.670866616" Jun 08 21:57:52.105785 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.105580 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nnkbc" event={"ID":"59f23391-dc4a-4dec-b7bf-6263e375f0d0","Type":"ContainerStarted","Data":"cdd56258b605e68e618a3aa0d1878d7c00d8147c2529858d0bd72346f9b827aa"} Jun 08 21:57:52.108520 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.108492 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" event={"ID":"45dc9f10-d2cc-4e5c-8871-09027d251cb4","Type":"ContainerStarted","Data":"55d9ff9259b85080ae8fea5b72e1951e08738e53935c5ae758681cd6340dfb3a"} Jun 08 21:57:52.108648 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.108581 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" event={"ID":"45dc9f10-d2cc-4e5c-8871-09027d251cb4","Type":"ContainerStarted","Data":"212e47391cf7eabe4b2b624df0ede85118ef8a343f4af2f5726d9d8edf39f02c"} Jun 08 21:57:52.108648 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.108631 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" event={"ID":"45dc9f10-d2cc-4e5c-8871-09027d251cb4","Type":"ContainerStarted","Data":"f7b8a3c19f55fe70bb9ada675b02d20d2c4f60349952db472a592bb004362d06"} Jun 08 21:57:52.108753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.108662 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" event={"ID":"45dc9f10-d2cc-4e5c-8871-09027d251cb4","Type":"ContainerStarted","Data":"de04fbb15512e466eaa08f548e4239bcf55e1ed7ec5fb3adbee27b6a66f4e319"} Jun 08 21:57:52.108753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.108698 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" event={"ID":"45dc9f10-d2cc-4e5c-8871-09027d251cb4","Type":"ContainerStarted","Data":"ba8e333264745a266fa84e2b658e9ee776681b78732b1d905a3e8d6040caaa53"} Jun 08 21:57:52.108753 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.108743 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" event={"ID":"45dc9f10-d2cc-4e5c-8871-09027d251cb4","Type":"ContainerStarted","Data":"c408c6880d42e31350b137f3792b692424cc6adc5ed81bc07b0790576a3a22ec"} Jun 08 21:57:52.109820 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.109786 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-psfzx" event={"ID":"a28deb3e-bbc1-4ce0-a5b0-717125c9d872","Type":"ContainerStarted","Data":"29c00a7ed22b916a354dca6843816550b898af8328c9284d68d31223c5e70cb5"} Jun 08 21:57:52.111200 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.111155 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dddlj" event={"ID":"5dda922b-0f2f-4727-9730-6988a0b48044","Type":"ContainerStarted","Data":"798c232a81344f3cb89d75f3e5fd53120641a27bfbde3e38a502283b57a54471"} Jun 08 21:57:52.112602 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.112581 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" event={"ID":"91f2e421-30e3-425d-9017-576eff7f47b7","Type":"ContainerStarted","Data":"8a37a5f65f97763071e95652f206531a13e6f98c076014ac61e7d807b508c9fe"} Jun 08 21:57:52.113962 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.113934 2549 generic.go:356] "Generic (PLEG): container finished" podID="7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6" containerID="d894909925321caeae97d42911500969170b3dc25bcfcf7a0099085c5e7959a3" exitCode=0 Jun 08 21:57:52.114036 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.114000 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pp9j6" event={"ID":"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6","Type":"ContainerDied","Data":"d894909925321caeae97d42911500969170b3dc25bcfcf7a0099085c5e7959a3"} Jun 08 21:57:52.115520 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.115498 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j7qkw" event={"ID":"88a8a02d-821d-4ef8-b073-8901d5505dd2","Type":"ContainerStarted","Data":"3025ef6cd1bcf57af79f01012b0d6ed140b08d14260f85de2473d4ff1b50e9c5"} Jun 08 21:57:52.120881 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.120844 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nnkbc" podStartSLOduration=3.980268729 podStartE2EDuration="23.120830514s" totalImagesPullingTime="19.140561785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:57:52.120744884 +0000 UTC m=+23.669631673" watchObservedRunningTime="2026-06-08 21:57:52.120830514 +0000 UTC m=+23.669717284" Jun 08 21:57:52.121463 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.121439 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dddlj" podStartSLOduration=3.913236322 podStartE2EDuration="23.121431851s" totalImagesPullingTime="19.208195529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:57:51.136725889 +0000 UTC m=+22.685612690" watchObservedRunningTime="2026-06-08 21:57:52.121431851 +0000 UTC m=+23.670318646" Jun 08 21:57:52.134650 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.134608 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j7qkw" podStartSLOduration=3.982045138 podStartE2EDuration="23.13459221s" totalImagesPullingTime="19.152547072s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:57:52.134294726 +0000 UTC m=+23.683181524" watchObservedRunningTime="2026-06-08 21:57:52.13459221 +0000 UTC m=+23.683478999" Jun 08 21:57:52.383114 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.383091 2549 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 21:57:52.965556 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.965426 2549 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T21:57:52.383107716Z","UUID":"b839e9ad-39cc-4a9f-9841-34edd975b27a","Handler":null,"Name":"","Endpoint":""} Jun 08 21:57:52.967360 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.967233 2549 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 21:57:52.967360 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.967281 2549 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 21:57:52.993494 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.993062 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:52.993494 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.993097 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:52.993494 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:52.993094 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:52.993494 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:52.993211 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vv87w" podUID="80169240-476c-4146-8a59-63cf33decac4" Jun 08 21:57:52.993494 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:52.993342 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs6km" podUID="38f827a0-8c60-4ca9-8a81-98e05477d762" Jun 08 21:57:52.993494 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:52.993404 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pmzz" podUID="12b6a387-cd80-4157-8c91-00fdb3ee3676" Jun 08 21:57:53.120450 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:53.120019 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4wv7c" event={"ID":"96e292e7-6c56-4a6c-82cb-8a963bb54608","Type":"ContainerStarted","Data":"c7df20a4c273f737a31ced15a3470570d9e80d21965b754c1a7342971f62d432"} Jun 08 21:57:53.122287 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:53.122237 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" event={"ID":"91f2e421-30e3-425d-9017-576eff7f47b7","Type":"ContainerStarted","Data":"f755513b7e6f9be4d2d04701c70d3987228277af12a29b496188e61a837bd4e2"} Jun 08 21:57:53.137026 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:53.136979 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4wv7c" podStartSLOduration=4.984557251 podStartE2EDuration="24.136958892s" totalImagesPullingTime="19.152401641s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:57:53.136472357 +0000 UTC m=+24.685359147" watchObservedRunningTime="2026-06-08 21:57:53.136958892 +0000 UTC m=+24.685845727" Jun 08 21:57:53.137322 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:53.137297 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-psfzx" podStartSLOduration=4.989464555 podStartE2EDuration="24.137288122s" totalImagesPullingTime="19.147823567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:57:52.171647778 +0000 UTC m=+23.720534578" watchObservedRunningTime="2026-06-08 21:57:53.137288122 +0000 UTC m=+24.686174955" Jun 08 21:57:54.127151 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:54.127111 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" event={"ID":"91f2e421-30e3-425d-9017-576eff7f47b7","Type":"ContainerStarted","Data":"59f556fda7d96ae359d862e6aff732d4f89dbc7d6122c34681d325f9b1477c3f"} Jun 08 21:57:54.130811 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:54.130782 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" event={"ID":"45dc9f10-d2cc-4e5c-8871-09027d251cb4","Type":"ContainerStarted","Data":"3e135d23527d955a6ee3d5bdea08cf9c2cdcd50b130f6556f0f5d34679759e88"} Jun 08 21:57:54.147015 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:54.146972 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpmk8" podStartSLOduration=3.757238706 podStartE2EDuration="25.146957875s" totalImagesPullingTime="21.389719169s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:57:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:57:54.146754146 +0000 UTC m=+25.695640934" watchObservedRunningTime="2026-06-08 21:57:54.146957875 +0000 UTC m=+25.695844676" Jun 08 21:57:54.993102 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:54.993019 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:54.993102 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:54.993067 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:54.993340 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:54.993113 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:54.993340 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:54.993140 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs6km" podUID="38f827a0-8c60-4ca9-8a81-98e05477d762" Jun 08 21:57:54.993340 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:54.993199 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pmzz" podUID="12b6a387-cd80-4157-8c91-00fdb3ee3676" Jun 08 21:57:54.993340 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:54.993276 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vv87w" podUID="80169240-476c-4146-8a59-63cf33decac4" Jun 08 21:57:56.993132 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:56.993104 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:56.993706 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:56.993104 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:56.993706 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:56.993222 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:56.993706 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:56.993213 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vv87w" podUID="80169240-476c-4146-8a59-63cf33decac4" Jun 08 21:57:56.993706 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:56.993293 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs6km" podUID="38f827a0-8c60-4ca9-8a81-98e05477d762" Jun 08 21:57:56.993706 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:56.993369 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pmzz" podUID="12b6a387-cd80-4157-8c91-00fdb3ee3676" Jun 08 21:57:57.049669 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:57.049631 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nnkbc" Jun 08 21:57:57.050237 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:57.050221 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nnkbc" Jun 08 21:57:57.139034 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:57.138992 2549 generic.go:356] "Generic (PLEG): container finished" podID="7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6" containerID="afccd8cfb03ea1807c2516ac930bd545696aab9b9c9762dd9f446913d425643d" exitCode=0 Jun 08 21:57:57.139240 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:57.139077 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pp9j6" event={"ID":"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6","Type":"ContainerDied","Data":"afccd8cfb03ea1807c2516ac930bd545696aab9b9c9762dd9f446913d425643d"} Jun 08 21:57:57.142874 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:57.142847 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" event={"ID":"45dc9f10-d2cc-4e5c-8871-09027d251cb4","Type":"ContainerStarted","Data":"35f610909cd60d9602f41d57db90f19664c9bb98f03245a2258cb17f72989985"} Jun 08 21:57:57.143086 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:57.143067 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nnkbc" Jun 08 21:57:57.143529 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:57.143513 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nnkbc" Jun 08 21:57:57.185735 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:57.185690 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" podStartSLOduration=8.969262266 podStartE2EDuration="28.185674578s" totalImagesPullingTime="19.216412312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:57:57.184690534 +0000 UTC m=+28.733577325" watchObservedRunningTime="2026-06-08 21:57:57.185674578 +0000 UTC m=+28.734561365" Jun 08 21:57:58.147947 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:58.147913 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pp9j6" event={"ID":"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6","Type":"ContainerStarted","Data":"a3e4b9f5ef62be37506e99da076007cf605b6649657425319dd386701a883589"} Jun 08 21:57:58.148633 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:58.148614 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:58.148744 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:58.148694 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:58.148807 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:58.148747 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:58.167813 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:58.167785 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:58.176834 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:58.176810 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:57:58.389257 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:58.389011 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4pmzz"] Jun 08 21:57:58.389418 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:58.389374 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:58.389518 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:58.389497 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pmzz" podUID="12b6a387-cd80-4157-8c91-00fdb3ee3676" Jun 08 21:57:58.391894 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:58.391866 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vs6km"] Jun 08 21:57:58.392028 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:58.391961 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:58.392079 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:58.392035 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs6km" podUID="38f827a0-8c60-4ca9-8a81-98e05477d762" Jun 08 21:57:58.393296 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:58.393262 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vv87w"] Jun 08 21:57:58.393398 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:58.393358 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:58.393461 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:58.393442 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vv87w" podUID="80169240-476c-4146-8a59-63cf33decac4" Jun 08 21:57:59.151666 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:59.151626 2549 generic.go:356] "Generic (PLEG): container finished" podID="7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6" containerID="a3e4b9f5ef62be37506e99da076007cf605b6649657425319dd386701a883589" exitCode=0 Jun 08 21:57:59.152068 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:59.151711 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pp9j6" event={"ID":"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6","Type":"ContainerDied","Data":"a3e4b9f5ef62be37506e99da076007cf605b6649657425319dd386701a883589"} Jun 08 21:57:59.993047 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:59.993009 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:57:59.993047 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:59.993047 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:57:59.993286 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:57:59.993009 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:57:59.993286 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:59.993148 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vv87w" podUID="80169240-476c-4146-8a59-63cf33decac4" Jun 08 21:57:59.993352 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:59.993294 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pmzz" podUID="12b6a387-cd80-4157-8c91-00fdb3ee3676" Jun 08 21:57:59.993390 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:57:59.993363 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs6km" podUID="38f827a0-8c60-4ca9-8a81-98e05477d762" Jun 08 21:58:01.158491 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:01.158459 2549 generic.go:356] "Generic (PLEG): container finished" podID="7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6" containerID="8160458b230c2179adb09b3077070f537d84c4c7ec2bdb44568193f3b572768d" exitCode=0 Jun 08 21:58:01.159315 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:01.158512 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pp9j6" event={"ID":"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6","Type":"ContainerDied","Data":"8160458b230c2179adb09b3077070f537d84c4c7ec2bdb44568193f3b572768d"} Jun 08 21:58:01.994010 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:01.993814 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:58:01.994010 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:01.993837 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:58:01.994010 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:01.993965 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs6km" podUID="38f827a0-8c60-4ca9-8a81-98e05477d762" Jun 08 21:58:01.994284 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:01.994079 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vv87w" podUID="80169240-476c-4146-8a59-63cf33decac4" Jun 08 21:58:01.994284 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:01.994185 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:58:01.994396 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:01.994282 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4pmzz" podUID="12b6a387-cd80-4157-8c91-00fdb3ee3676" Jun 08 21:58:02.749446 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:02.749406 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs\") pod \"network-metrics-daemon-4pmzz\" (UID: \"12b6a387-cd80-4157-8c91-00fdb3ee3676\") " pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:58:02.749905 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:02.749464 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret\") pod \"global-pull-secret-syncer-vv87w\" (UID: \"80169240-476c-4146-8a59-63cf33decac4\") " pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:58:02.749905 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:02.749560 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:58:02.749905 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:02.749587 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:58:02.749905 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:02.749645 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret podName:80169240-476c-4146-8a59-63cf33decac4 nodeName:}" failed. No retries permitted until 2026-06-08 21:58:34.74962642 +0000 UTC m=+66.298513205 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret") pod "global-pull-secret-syncer-vv87w" (UID: "80169240-476c-4146-8a59-63cf33decac4") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:58:02.749905 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:02.749663 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs podName:12b6a387-cd80-4157-8c91-00fdb3ee3676 nodeName:}" failed. No retries permitted until 2026-06-08 21:58:34.74965384 +0000 UTC m=+66.298540609 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs") pod "network-metrics-daemon-4pmzz" (UID: "12b6a387-cd80-4157-8c91-00fdb3ee3676") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:58:02.850405 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:02.850365 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67q2k\" (UniqueName: \"kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k\") pod \"network-check-target-vs6km\" (UID: \"38f827a0-8c60-4ca9-8a81-98e05477d762\") " pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:58:02.850569 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:02.850539 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:58:02.850569 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:02.850567 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:58:02.850655 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:02.850581 2549 projected.go:196] Error preparing data for projected volume kube-api-access-67q2k for pod openshift-network-diagnostics/network-check-target-vs6km: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:58:02.850697 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:02.850669 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k podName:38f827a0-8c60-4ca9-8a81-98e05477d762 nodeName:}" failed. No retries permitted until 2026-06-08 21:58:34.850628338 +0000 UTC m=+66.399515106 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-67q2k" (UniqueName: "kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k") pod "network-check-target-vs6km" (UID: "38f827a0-8c60-4ca9-8a81-98e05477d762") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:58:03.800065 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.799983 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-88.ec2.internal" event="NodeReady" Jun 08 21:58:03.800495 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.800129 2549 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 21:58:03.845491 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.845459 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ckthn"] Jun 08 21:58:03.848092 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.848068 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ckthn" Jun 08 21:58:03.849371 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.849349 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mn57q"] Jun 08 21:58:03.850726 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.850707 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 21:58:03.850826 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.850785 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 21:58:03.851261 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.851244 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tq2ww\"" Jun 08 21:58:03.851927 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.851911 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mn57q" Jun 08 21:58:03.854476 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.854461 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 21:58:03.855517 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.855322 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 21:58:03.855517 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.855426 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 21:58:03.855666 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.855519 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-78746\"" Jun 08 21:58:03.859633 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.859594 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ckthn"] Jun 08 21:58:03.865079 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.864421 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mn57q"] Jun 08 21:58:03.956360 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.956323 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-config-volume\") pod \"dns-default-ckthn\" (UID: \"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50\") " pod="openshift-dns/dns-default-ckthn" Jun 08 21:58:03.956534 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.956367 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdd228a4-64ed-47a7-95c8-2144b2afafcd-cert\") pod \"ingress-canary-mn57q\" (UID: \"fdd228a4-64ed-47a7-95c8-2144b2afafcd\") " pod="openshift-ingress-canary/ingress-canary-mn57q" Jun 08 21:58:03.956534 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.956430 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls\") pod \"dns-default-ckthn\" (UID: \"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50\") " pod="openshift-dns/dns-default-ckthn" Jun 08 21:58:03.956534 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.956456 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-tmp-dir\") pod \"dns-default-ckthn\" (UID: \"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50\") " pod="openshift-dns/dns-default-ckthn" Jun 08 21:58:03.956534 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.956504 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnh9d\" (UniqueName: \"kubernetes.io/projected/fdd228a4-64ed-47a7-95c8-2144b2afafcd-kube-api-access-rnh9d\") pod \"ingress-canary-mn57q\" (UID: \"fdd228a4-64ed-47a7-95c8-2144b2afafcd\") " pod="openshift-ingress-canary/ingress-canary-mn57q" Jun 08 21:58:03.956725 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.956603 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-468q4\" (UniqueName: \"kubernetes.io/projected/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-kube-api-access-468q4\") pod \"dns-default-ckthn\" (UID: \"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50\") " pod="openshift-dns/dns-default-ckthn" Jun 08 21:58:03.993309 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.993271 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:58:03.993309 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.993300 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:58:03.993710 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.993290 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:58:03.997017 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.996777 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 21:58:03.997133 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.997066 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 21:58:03.997492 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.997466 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 21:58:03.997619 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.997519 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 21:58:03.999865 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.998216 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6cpnn\"" Jun 08 21:58:03.999865 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:03.998585 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5tds9\"" Jun 08 21:58:04.057719 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:04.057617 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-config-volume\") pod \"dns-default-ckthn\" (UID: \"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50\") " pod="openshift-dns/dns-default-ckthn" Jun 08 21:58:04.057719 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:04.057673 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdd228a4-64ed-47a7-95c8-2144b2afafcd-cert\") pod \"ingress-canary-mn57q\" (UID: \"fdd228a4-64ed-47a7-95c8-2144b2afafcd\") " pod="openshift-ingress-canary/ingress-canary-mn57q" Jun 08 21:58:04.057952 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:04.057871 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls\") pod \"dns-default-ckthn\" (UID: \"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50\") " pod="openshift-dns/dns-default-ckthn" Jun 08 21:58:04.057952 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:04.057938 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-tmp-dir\") pod \"dns-default-ckthn\" (UID: \"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50\") " pod="openshift-dns/dns-default-ckthn" Jun 08 21:58:04.058053 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:04.057981 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnh9d\" (UniqueName: \"kubernetes.io/projected/fdd228a4-64ed-47a7-95c8-2144b2afafcd-kube-api-access-rnh9d\") pod \"ingress-canary-mn57q\" (UID: \"fdd228a4-64ed-47a7-95c8-2144b2afafcd\") " pod="openshift-ingress-canary/ingress-canary-mn57q" Jun 08 21:58:04.058108 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:04.058080 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-468q4\" (UniqueName: \"kubernetes.io/projected/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-kube-api-access-468q4\") pod \"dns-default-ckthn\" (UID: \"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50\") " pod="openshift-dns/dns-default-ckthn" Jun 08 21:58:04.058476 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:04.058366 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-config-volume\") pod \"dns-default-ckthn\" (UID: \"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50\") " pod="openshift-dns/dns-default-ckthn" Jun 08 21:58:04.058476 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:04.058423 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-tmp-dir\") pod \"dns-default-ckthn\" (UID: \"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50\") " pod="openshift-dns/dns-default-ckthn" Jun 08 21:58:04.058476 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:04.058472 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:58:04.058655 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:04.058540 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls podName:4d30ffba-5f7b-446b-baef-d8b7b9cd9d50 nodeName:}" failed. No retries permitted until 2026-06-08 21:58:04.558520256 +0000 UTC m=+36.107407024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls") pod "dns-default-ckthn" (UID: "4d30ffba-5f7b-446b-baef-d8b7b9cd9d50") : secret "dns-default-metrics-tls" not found Jun 08 21:58:04.062704 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:04.062683 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdd228a4-64ed-47a7-95c8-2144b2afafcd-cert\") pod \"ingress-canary-mn57q\" (UID: \"fdd228a4-64ed-47a7-95c8-2144b2afafcd\") " pod="openshift-ingress-canary/ingress-canary-mn57q" Jun 08 21:58:04.067266 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:04.067239 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-468q4\" (UniqueName: \"kubernetes.io/projected/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-kube-api-access-468q4\") pod \"dns-default-ckthn\" (UID: \"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50\") " pod="openshift-dns/dns-default-ckthn" Jun 08 21:58:04.067401 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:04.067308 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnh9d\" (UniqueName: \"kubernetes.io/projected/fdd228a4-64ed-47a7-95c8-2144b2afafcd-kube-api-access-rnh9d\") pod \"ingress-canary-mn57q\" (UID: \"fdd228a4-64ed-47a7-95c8-2144b2afafcd\") " pod="openshift-ingress-canary/ingress-canary-mn57q" Jun 08 21:58:04.168412 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:04.168384 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mn57q" Jun 08 21:58:04.561940 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:04.561883 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls\") pod \"dns-default-ckthn\" (UID: \"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50\") " pod="openshift-dns/dns-default-ckthn" Jun 08 21:58:04.562112 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:04.562034 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:58:04.562209 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:04.562116 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls podName:4d30ffba-5f7b-446b-baef-d8b7b9cd9d50 nodeName:}" failed. No retries permitted until 2026-06-08 21:58:05.562093104 +0000 UTC m=+37.110979873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls") pod "dns-default-ckthn" (UID: "4d30ffba-5f7b-446b-baef-d8b7b9cd9d50") : secret "dns-default-metrics-tls" not found Jun 08 21:58:05.114568 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:05.114541 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mn57q"] Jun 08 21:58:05.118876 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:58:05.118847 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdd228a4_64ed_47a7_95c8_2144b2afafcd.slice/crio-5b054dd16f6e03314617fd2cdc9e6f9d75a85f6c79eeae14c36fbc334e475f5b WatchSource:0}: Error finding container 5b054dd16f6e03314617fd2cdc9e6f9d75a85f6c79eeae14c36fbc334e475f5b: Status 404 returned error can't find the container with id 5b054dd16f6e03314617fd2cdc9e6f9d75a85f6c79eeae14c36fbc334e475f5b Jun 08 21:58:05.169839 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:05.169799 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mn57q" event={"ID":"fdd228a4-64ed-47a7-95c8-2144b2afafcd","Type":"ContainerStarted","Data":"5b054dd16f6e03314617fd2cdc9e6f9d75a85f6c79eeae14c36fbc334e475f5b"} Jun 08 21:58:05.172739 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:05.172704 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pp9j6" event={"ID":"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6","Type":"ContainerStarted","Data":"1df3debb58b02d221ca04afa2705120bbc8864e210bd176cb3ff627e01602d4e"} Jun 08 21:58:05.570394 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:05.570360 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls\") pod \"dns-default-ckthn\" (UID: \"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50\") " pod="openshift-dns/dns-default-ckthn" Jun 08 21:58:05.570617 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:05.570541 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:58:05.570673 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:05.570622 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls podName:4d30ffba-5f7b-446b-baef-d8b7b9cd9d50 nodeName:}" failed. No retries permitted until 2026-06-08 21:58:07.570600636 +0000 UTC m=+39.119487407 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls") pod "dns-default-ckthn" (UID: "4d30ffba-5f7b-446b-baef-d8b7b9cd9d50") : secret "dns-default-metrics-tls" not found Jun 08 21:58:06.178244 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:06.178206 2549 generic.go:356] "Generic (PLEG): container finished" podID="7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6" containerID="1df3debb58b02d221ca04afa2705120bbc8864e210bd176cb3ff627e01602d4e" exitCode=0 Jun 08 21:58:06.178704 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:06.178295 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pp9j6" event={"ID":"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6","Type":"ContainerDied","Data":"1df3debb58b02d221ca04afa2705120bbc8864e210bd176cb3ff627e01602d4e"} Jun 08 21:58:07.182662 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:07.182453 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mn57q" event={"ID":"fdd228a4-64ed-47a7-95c8-2144b2afafcd","Type":"ContainerStarted","Data":"b344f8021564281185b337ec5d1f7909b6bd53f09492943fe2380678f2617ee9"} Jun 08 21:58:07.185289 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:07.185264 2549 generic.go:356] "Generic (PLEG): container finished" podID="7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6" containerID="37414228e4ad9b1218a89afa45b84d3dc948a417b154fa4aeead4f576fe0684c" exitCode=0 Jun 08 21:58:07.185430 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:07.185299 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pp9j6" event={"ID":"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6","Type":"ContainerDied","Data":"37414228e4ad9b1218a89afa45b84d3dc948a417b154fa4aeead4f576fe0684c"} Jun 08 21:58:07.199112 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:07.199028 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mn57q" podStartSLOduration=2.723319991 podStartE2EDuration="4.199011076s" totalImagesPullingTime="1.475691085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:58:07.198950339 +0000 UTC m=+38.747837129" watchObservedRunningTime="2026-06-08 21:58:07.199011076 +0000 UTC m=+38.747897863" Jun 08 21:58:07.586195 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:07.586070 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls\") pod \"dns-default-ckthn\" (UID: \"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50\") " pod="openshift-dns/dns-default-ckthn" Jun 08 21:58:07.586360 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:07.586212 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:58:07.586360 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:07.586266 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls podName:4d30ffba-5f7b-446b-baef-d8b7b9cd9d50 nodeName:}" failed. No retries permitted until 2026-06-08 21:58:11.586252653 +0000 UTC m=+43.135139418 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls") pod "dns-default-ckthn" (UID: "4d30ffba-5f7b-446b-baef-d8b7b9cd9d50") : secret "dns-default-metrics-tls" not found Jun 08 21:58:08.191744 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:08.191710 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pp9j6" event={"ID":"7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6","Type":"ContainerStarted","Data":"dc5f89bec461f5fc78cce4f4704c379b72bf9377258b5b5be60b17caa01cf9ae"} Jun 08 21:58:08.216001 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:08.215949 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pp9j6" podStartSLOduration=10.022170839 podStartE2EDuration="39.215933175s" totalImagesPullingTime="29.193762336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:57:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:58:08.214596907 +0000 UTC m=+39.763483694" watchObservedRunningTime="2026-06-08 21:58:08.215933175 +0000 UTC m=+39.764819962" Jun 08 21:58:11.613420 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:11.613351 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls\") pod \"dns-default-ckthn\" (UID: \"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50\") " pod="openshift-dns/dns-default-ckthn" Jun 08 21:58:11.613879 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:11.613515 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:58:11.613879 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:11.613583 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls podName:4d30ffba-5f7b-446b-baef-d8b7b9cd9d50 nodeName:}" failed. No retries permitted until 2026-06-08 21:58:19.613567316 +0000 UTC m=+51.162454081 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls") pod "dns-default-ckthn" (UID: "4d30ffba-5f7b-446b-baef-d8b7b9cd9d50") : secret "dns-default-metrics-tls" not found Jun 08 21:58:19.670356 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:19.670315 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls\") pod \"dns-default-ckthn\" (UID: \"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50\") " pod="openshift-dns/dns-default-ckthn" Jun 08 21:58:19.670832 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:19.670476 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:58:19.670832 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:19.670554 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls podName:4d30ffba-5f7b-446b-baef-d8b7b9cd9d50 nodeName:}" failed. No retries permitted until 2026-06-08 21:58:35.670536968 +0000 UTC m=+67.219423734 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls") pod "dns-default-ckthn" (UID: "4d30ffba-5f7b-446b-baef-d8b7b9cd9d50") : secret "dns-default-metrics-tls" not found Jun 08 21:58:30.164959 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:30.164934 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qqzs7" Jun 08 21:58:34.768547 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:34.768501 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs\") pod \"network-metrics-daemon-4pmzz\" (UID: \"12b6a387-cd80-4157-8c91-00fdb3ee3676\") " pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:58:34.768547 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:34.768551 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret\") pod \"global-pull-secret-syncer-vv87w\" (UID: \"80169240-476c-4146-8a59-63cf33decac4\") " pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:58:34.771660 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:34.771637 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 21:58:34.771716 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:34.771637 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 21:58:34.779679 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:34.779660 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 21:58:34.779737 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:34.779717 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs podName:12b6a387-cd80-4157-8c91-00fdb3ee3676 nodeName:}" failed. No retries permitted until 2026-06-08 21:59:38.779700657 +0000 UTC m=+130.328587428 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs") pod "network-metrics-daemon-4pmzz" (UID: "12b6a387-cd80-4157-8c91-00fdb3ee3676") : secret "metrics-daemon-secret" not found Jun 08 21:58:34.782793 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:34.782773 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80169240-476c-4146-8a59-63cf33decac4-original-pull-secret\") pod \"global-pull-secret-syncer-vv87w\" (UID: \"80169240-476c-4146-8a59-63cf33decac4\") " pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:58:34.869175 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:34.869135 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67q2k\" (UniqueName: \"kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k\") pod \"network-check-target-vs6km\" (UID: \"38f827a0-8c60-4ca9-8a81-98e05477d762\") " pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:58:34.872001 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:34.871983 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 21:58:34.882571 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:34.882550 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 21:58:34.892910 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:34.892882 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67q2k\" (UniqueName: \"kubernetes.io/projected/38f827a0-8c60-4ca9-8a81-98e05477d762-kube-api-access-67q2k\") pod \"network-check-target-vs6km\" (UID: \"38f827a0-8c60-4ca9-8a81-98e05477d762\") " pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:58:34.915791 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:34.915770 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5tds9\"" Jun 08 21:58:34.918708 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:34.918692 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vv87w" Jun 08 21:58:34.923864 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:34.923843 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:58:35.047357 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:35.047281 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vv87w"] Jun 08 21:58:35.050262 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:58:35.050231 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80169240_476c_4146_8a59_63cf33decac4.slice/crio-88ef92a7790111aedc0aadf77d0dae72184c97e7a0fd2689396711abc7e0a257 WatchSource:0}: Error finding container 88ef92a7790111aedc0aadf77d0dae72184c97e7a0fd2689396711abc7e0a257: Status 404 returned error can't find the container with id 88ef92a7790111aedc0aadf77d0dae72184c97e7a0fd2689396711abc7e0a257 Jun 08 21:58:35.062899 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:35.062873 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vs6km"] Jun 08 21:58:35.067101 ip-10-0-138-88 kubenswrapper[2549]: W0608 21:58:35.067077 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38f827a0_8c60_4ca9_8a81_98e05477d762.slice/crio-1e3e4be72a552bf6e132cb0f6e8605ec86b3bdd8e4a4c68e93a72f832b31d843 WatchSource:0}: Error finding container 1e3e4be72a552bf6e132cb0f6e8605ec86b3bdd8e4a4c68e93a72f832b31d843: Status 404 returned error can't find the container with id 1e3e4be72a552bf6e132cb0f6e8605ec86b3bdd8e4a4c68e93a72f832b31d843 Jun 08 21:58:35.254098 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:35.254065 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vv87w" event={"ID":"80169240-476c-4146-8a59-63cf33decac4","Type":"ContainerStarted","Data":"88ef92a7790111aedc0aadf77d0dae72184c97e7a0fd2689396711abc7e0a257"} Jun 08 21:58:35.255041 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:35.255010 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vs6km" event={"ID":"38f827a0-8c60-4ca9-8a81-98e05477d762","Type":"ContainerStarted","Data":"1e3e4be72a552bf6e132cb0f6e8605ec86b3bdd8e4a4c68e93a72f832b31d843"} Jun 08 21:58:35.676253 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:35.676212 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls\") pod \"dns-default-ckthn\" (UID: \"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50\") " pod="openshift-dns/dns-default-ckthn" Jun 08 21:58:35.676447 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:35.676360 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:58:35.676447 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:58:35.676419 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls podName:4d30ffba-5f7b-446b-baef-d8b7b9cd9d50 nodeName:}" failed. No retries permitted until 2026-06-08 21:59:07.676405326 +0000 UTC m=+99.225292092 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls") pod "dns-default-ckthn" (UID: "4d30ffba-5f7b-446b-baef-d8b7b9cd9d50") : secret "dns-default-metrics-tls" not found Jun 08 21:58:40.271019 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:40.270981 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vs6km" event={"ID":"38f827a0-8c60-4ca9-8a81-98e05477d762","Type":"ContainerStarted","Data":"376a19f7bc30b83747cdccf63f2ba4f8a7157fc0124e94cd3e0cfb49ba14721b"} Jun 08 21:58:40.271499 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:40.271042 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:58:40.272384 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:40.272360 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vv87w" event={"ID":"80169240-476c-4146-8a59-63cf33decac4","Type":"ContainerStarted","Data":"04390750b69a02709a6b1f63cab56a6a17710cf37605d6e341743d5ead10a21c"} Jun 08 21:58:40.290725 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:40.290667 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vs6km" podStartSLOduration=66.668998736 podStartE2EDuration="1m11.290650614s" totalImagesPullingTime="4.621651878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:58:40.290534167 +0000 UTC m=+71.839420955" watchObservedRunningTime="2026-06-08 21:58:40.290650614 +0000 UTC m=+71.839537406" Jun 08 21:58:40.304845 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:58:40.304802 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vv87w" podStartSLOduration=66.654885665 podStartE2EDuration="1m11.304788564s" totalImagesPullingTime="4.649902899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:58:40.304097504 +0000 UTC m=+71.852984293" watchObservedRunningTime="2026-06-08 21:58:40.304788564 +0000 UTC m=+71.853675352" Jun 08 21:59:07.687454 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:59:07.687311 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls\") pod \"dns-default-ckthn\" (UID: \"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50\") " pod="openshift-dns/dns-default-ckthn" Jun 08 21:59:07.687950 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:59:07.687464 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:59:07.687950 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:59:07.687548 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls podName:4d30ffba-5f7b-446b-baef-d8b7b9cd9d50 nodeName:}" failed. No retries permitted until 2026-06-08 22:00:11.687528609 +0000 UTC m=+163.236415376 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls") pod "dns-default-ckthn" (UID: "4d30ffba-5f7b-446b-baef-d8b7b9cd9d50") : secret "dns-default-metrics-tls" not found Jun 08 21:59:11.277557 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:59:11.277519 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vs6km" Jun 08 21:59:38.799080 ip-10-0-138-88 kubenswrapper[2549]: I0608 21:59:38.799035 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs\") pod \"network-metrics-daemon-4pmzz\" (UID: \"12b6a387-cd80-4157-8c91-00fdb3ee3676\") " pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 21:59:38.799592 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:59:38.799178 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 21:59:38.799592 ip-10-0-138-88 kubenswrapper[2549]: E0608 21:59:38.799246 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs podName:12b6a387-cd80-4157-8c91-00fdb3ee3676 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:40.799228672 +0000 UTC m=+252.348115456 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs") pod "network-metrics-daemon-4pmzz" (UID: "12b6a387-cd80-4157-8c91-00fdb3ee3676") : secret "metrics-daemon-secret" not found Jun 08 22:00:06.860578 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:00:06.860525 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ckthn" podUID="4d30ffba-5f7b-446b-baef-d8b7b9cd9d50" Jun 08 22:00:07.006248 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:00:07.006209 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4pmzz" podUID="12b6a387-cd80-4157-8c91-00fdb3ee3676" Jun 08 22:00:07.477238 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:00:07.477211 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ckthn" Jun 08 22:00:11.720317 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:00:11.720278 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls\") pod \"dns-default-ckthn\" (UID: \"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50\") " pod="openshift-dns/dns-default-ckthn" Jun 08 22:00:11.720805 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:00:11.720389 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 22:00:11.720805 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:00:11.720455 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls podName:4d30ffba-5f7b-446b-baef-d8b7b9cd9d50 nodeName:}" failed. No retries permitted until 2026-06-08 22:02:13.720439638 +0000 UTC m=+285.269326404 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls") pod "dns-default-ckthn" (UID: "4d30ffba-5f7b-446b-baef-d8b7b9cd9d50") : secret "dns-default-metrics-tls" not found Jun 08 22:00:18.994398 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:00:18.994327 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 22:01:24.225495 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.225462 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-ztclm"] Jun 08 22:01:24.227281 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.227267 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-ztclm" Jun 08 22:01:24.230859 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.230834 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-jqsxv\"" Jun 08 22:01:24.233141 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.232794 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-276ck"] Jun 08 22:01:24.234748 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.234732 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-276ck" Jun 08 22:01:24.260604 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.260570 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 08 22:01:24.260604 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.260599 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 08 22:01:24.260788 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.260627 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 08 22:01:24.260845 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.260833 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zj5vn\"" Jun 08 22:01:24.276880 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.276858 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-ztclm"] Jun 08 22:01:24.279748 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.279717 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-276ck"] Jun 08 22:01:24.316300 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.316270 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/198f4f07-ca89-4683-8bfd-2bc9abb51f22-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-276ck\" (UID: \"198f4f07-ca89-4683-8bfd-2bc9abb51f22\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-276ck" Jun 08 22:01:24.316477 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.316308 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb8k7\" (UniqueName: \"kubernetes.io/projected/f108f1d1-011a-483f-a7f6-a8e0ec0fcc9a-kube-api-access-bb8k7\") pod \"network-check-source-dbd9cf844-ztclm\" (UID: \"f108f1d1-011a-483f-a7f6-a8e0ec0fcc9a\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-ztclm" Jun 08 22:01:24.316477 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.316332 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5zmh\" (UniqueName: \"kubernetes.io/projected/198f4f07-ca89-4683-8bfd-2bc9abb51f22-kube-api-access-b5zmh\") pod \"cluster-samples-operator-854f8b96b6-276ck\" (UID: \"198f4f07-ca89-4683-8bfd-2bc9abb51f22\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-276ck" Jun 08 22:01:24.337135 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.337101 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zn4gt"] Jun 08 22:01:24.339317 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.339300 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zn4gt" Jun 08 22:01:24.342729 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.342711 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 08 22:01:24.342852 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.342717 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-t2fmw\"" Jun 08 22:01:24.343072 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.343056 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 08 22:01:24.347700 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.347684 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-76bc7cf865-5m4b9"] Jun 08 22:01:24.349274 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.349257 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-rzp7c"] Jun 08 22:01:24.349386 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.349367 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:24.350800 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.350784 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" Jun 08 22:01:24.354209 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.354190 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gx95n\"" Jun 08 22:01:24.354594 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.354579 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 08 22:01:24.354666 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.354576 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 08 22:01:24.354863 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.354847 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 08 22:01:24.355009 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.354992 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 22:01:24.359041 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.359022 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 08 22:01:24.359825 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.359804 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 22:01:24.359922 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.359843 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zn4gt"] Jun 08 22:01:24.362625 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.362607 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 08 22:01:24.362791 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.362755 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-k8p5z\"" Jun 08 22:01:24.362965 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.362946 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 08 22:01:24.363275 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.363255 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 08 22:01:24.364497 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.364478 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 08 22:01:24.370369 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.370351 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 08 22:01:24.370840 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.370822 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-rzp7c"] Jun 08 22:01:24.389782 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.389753 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76bc7cf865-5m4b9"] Jun 08 22:01:24.416693 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.416667 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-default-certificate\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:24.416870 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.416712 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t546g\" (UniqueName: \"kubernetes.io/projected/a3d06fd7-338d-40ab-8562-beca27147b46-kube-api-access-t546g\") pod \"volume-data-source-validator-78dd696465-zn4gt\" (UID: \"a3d06fd7-338d-40ab-8562-beca27147b46\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zn4gt" Jun 08 22:01:24.416870 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.416733 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/198f4f07-ca89-4683-8bfd-2bc9abb51f22-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-276ck\" (UID: \"198f4f07-ca89-4683-8bfd-2bc9abb51f22\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-276ck" Jun 08 22:01:24.416870 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.416778 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ecc09a2e-0137-45ae-9982-e8f714b875c5-serving-cert\") pod \"console-operator-668fdbf85c-rzp7c\" (UID: \"ecc09a2e-0137-45ae-9982-e8f714b875c5\") " pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" Jun 08 22:01:24.416870 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:24.416809 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 22:01:24.416870 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.416814 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb8k7\" (UniqueName: \"kubernetes.io/projected/f108f1d1-011a-483f-a7f6-a8e0ec0fcc9a-kube-api-access-bb8k7\") pod \"network-check-source-dbd9cf844-ztclm\" (UID: \"f108f1d1-011a-483f-a7f6-a8e0ec0fcc9a\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-ztclm" Jun 08 22:01:24.416870 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.416837 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-stats-auth\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:24.416870 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:24.416851 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198f4f07-ca89-4683-8bfd-2bc9abb51f22-samples-operator-tls podName:198f4f07-ca89-4683-8bfd-2bc9abb51f22 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:24.916838179 +0000 UTC m=+236.465724945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/198f4f07-ca89-4683-8bfd-2bc9abb51f22-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-276ck" (UID: "198f4f07-ca89-4683-8bfd-2bc9abb51f22") : secret "samples-operator-tls" not found Jun 08 22:01:24.416870 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.416872 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-metrics-certs\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:24.417280 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.416888 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vz2m\" (UniqueName: \"kubernetes.io/projected/be1775e2-0996-430c-bc0f-0ad7f5faeedb-kube-api-access-6vz2m\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:24.417280 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.416903 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ecc09a2e-0137-45ae-9982-e8f714b875c5-config\") pod \"console-operator-668fdbf85c-rzp7c\" (UID: \"ecc09a2e-0137-45ae-9982-e8f714b875c5\") " pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" Jun 08 22:01:24.417280 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.416926 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5zmh\" (UniqueName: \"kubernetes.io/projected/198f4f07-ca89-4683-8bfd-2bc9abb51f22-kube-api-access-b5zmh\") pod \"cluster-samples-operator-854f8b96b6-276ck\" (UID: \"198f4f07-ca89-4683-8bfd-2bc9abb51f22\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-276ck" Jun 08 22:01:24.417280 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.416959 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpb4w\" (UniqueName: \"kubernetes.io/projected/ecc09a2e-0137-45ae-9982-e8f714b875c5-kube-api-access-gpb4w\") pod \"console-operator-668fdbf85c-rzp7c\" (UID: \"ecc09a2e-0137-45ae-9982-e8f714b875c5\") " pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" Jun 08 22:01:24.417280 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.417079 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ecc09a2e-0137-45ae-9982-e8f714b875c5-trusted-ca\") pod \"console-operator-668fdbf85c-rzp7c\" (UID: \"ecc09a2e-0137-45ae-9982-e8f714b875c5\") " pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" Jun 08 22:01:24.417280 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.417116 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be1775e2-0996-430c-bc0f-0ad7f5faeedb-service-ca-bundle\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:24.428322 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.428303 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5zmh\" (UniqueName: \"kubernetes.io/projected/198f4f07-ca89-4683-8bfd-2bc9abb51f22-kube-api-access-b5zmh\") pod \"cluster-samples-operator-854f8b96b6-276ck\" (UID: \"198f4f07-ca89-4683-8bfd-2bc9abb51f22\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-276ck" Jun 08 22:01:24.428568 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.428551 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb8k7\" (UniqueName: \"kubernetes.io/projected/f108f1d1-011a-483f-a7f6-a8e0ec0fcc9a-kube-api-access-bb8k7\") pod \"network-check-source-dbd9cf844-ztclm\" (UID: \"f108f1d1-011a-483f-a7f6-a8e0ec0fcc9a\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-ztclm" Jun 08 22:01:24.518228 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.518113 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-default-certificate\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:24.518228 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.518204 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t546g\" (UniqueName: \"kubernetes.io/projected/a3d06fd7-338d-40ab-8562-beca27147b46-kube-api-access-t546g\") pod \"volume-data-source-validator-78dd696465-zn4gt\" (UID: \"a3d06fd7-338d-40ab-8562-beca27147b46\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zn4gt" Jun 08 22:01:24.518432 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.518238 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ecc09a2e-0137-45ae-9982-e8f714b875c5-serving-cert\") pod \"console-operator-668fdbf85c-rzp7c\" (UID: \"ecc09a2e-0137-45ae-9982-e8f714b875c5\") " pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" Jun 08 22:01:24.518432 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.518265 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-stats-auth\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:24.518432 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.518287 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-metrics-certs\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:24.518432 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:24.518358 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 22:01:24.518432 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.518410 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vz2m\" (UniqueName: \"kubernetes.io/projected/be1775e2-0996-430c-bc0f-0ad7f5faeedb-kube-api-access-6vz2m\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:24.518432 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:24.518425 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-metrics-certs podName:be1775e2-0996-430c-bc0f-0ad7f5faeedb nodeName:}" failed. No retries permitted until 2026-06-08 22:01:25.018404625 +0000 UTC m=+236.567291395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-metrics-certs") pod "router-default-76bc7cf865-5m4b9" (UID: "be1775e2-0996-430c-bc0f-0ad7f5faeedb") : secret "router-metrics-certs-default" not found Jun 08 22:01:24.518704 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.518449 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ecc09a2e-0137-45ae-9982-e8f714b875c5-config\") pod \"console-operator-668fdbf85c-rzp7c\" (UID: \"ecc09a2e-0137-45ae-9982-e8f714b875c5\") " pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" Jun 08 22:01:24.518704 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.518487 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpb4w\" (UniqueName: \"kubernetes.io/projected/ecc09a2e-0137-45ae-9982-e8f714b875c5-kube-api-access-gpb4w\") pod \"console-operator-668fdbf85c-rzp7c\" (UID: \"ecc09a2e-0137-45ae-9982-e8f714b875c5\") " pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" Jun 08 22:01:24.518704 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.518518 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ecc09a2e-0137-45ae-9982-e8f714b875c5-trusted-ca\") pod \"console-operator-668fdbf85c-rzp7c\" (UID: \"ecc09a2e-0137-45ae-9982-e8f714b875c5\") " pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" Jun 08 22:01:24.518704 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.518545 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be1775e2-0996-430c-bc0f-0ad7f5faeedb-service-ca-bundle\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:24.518704 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:24.518685 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be1775e2-0996-430c-bc0f-0ad7f5faeedb-service-ca-bundle podName:be1775e2-0996-430c-bc0f-0ad7f5faeedb nodeName:}" failed. No retries permitted until 2026-06-08 22:01:25.018671376 +0000 UTC m=+236.567558159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/be1775e2-0996-430c-bc0f-0ad7f5faeedb-service-ca-bundle") pod "router-default-76bc7cf865-5m4b9" (UID: "be1775e2-0996-430c-bc0f-0ad7f5faeedb") : configmap references non-existent config key: service-ca.crt Jun 08 22:01:24.519260 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.519239 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ecc09a2e-0137-45ae-9982-e8f714b875c5-config\") pod \"console-operator-668fdbf85c-rzp7c\" (UID: \"ecc09a2e-0137-45ae-9982-e8f714b875c5\") " pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" Jun 08 22:01:24.519545 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.519529 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ecc09a2e-0137-45ae-9982-e8f714b875c5-trusted-ca\") pod \"console-operator-668fdbf85c-rzp7c\" (UID: \"ecc09a2e-0137-45ae-9982-e8f714b875c5\") " pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" Jun 08 22:01:24.520610 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.520593 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-default-certificate\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:24.521018 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.520998 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-stats-auth\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:24.521018 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.521009 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ecc09a2e-0137-45ae-9982-e8f714b875c5-serving-cert\") pod \"console-operator-668fdbf85c-rzp7c\" (UID: \"ecc09a2e-0137-45ae-9982-e8f714b875c5\") " pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" Jun 08 22:01:24.526940 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.526916 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpb4w\" (UniqueName: \"kubernetes.io/projected/ecc09a2e-0137-45ae-9982-e8f714b875c5-kube-api-access-gpb4w\") pod \"console-operator-668fdbf85c-rzp7c\" (UID: \"ecc09a2e-0137-45ae-9982-e8f714b875c5\") " pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" Jun 08 22:01:24.527384 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.527354 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t546g\" (UniqueName: \"kubernetes.io/projected/a3d06fd7-338d-40ab-8562-beca27147b46-kube-api-access-t546g\") pod \"volume-data-source-validator-78dd696465-zn4gt\" (UID: \"a3d06fd7-338d-40ab-8562-beca27147b46\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zn4gt" Jun 08 22:01:24.527708 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.527681 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vz2m\" (UniqueName: \"kubernetes.io/projected/be1775e2-0996-430c-bc0f-0ad7f5faeedb-kube-api-access-6vz2m\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:24.535413 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.535384 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-ztclm" Jun 08 22:01:24.648955 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.648922 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zn4gt" Jun 08 22:01:24.657205 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.657179 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-ztclm"] Jun 08 22:01:24.660035 ip-10-0-138-88 kubenswrapper[2549]: W0608 22:01:24.660012 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf108f1d1_011a_483f_a7f6_a8e0ec0fcc9a.slice/crio-2d41abdbe07be5fdd96b59fbdff5fc5ac157f60eea238cfa772a0b451b4475e0 WatchSource:0}: Error finding container 2d41abdbe07be5fdd96b59fbdff5fc5ac157f60eea238cfa772a0b451b4475e0: Status 404 returned error can't find the container with id 2d41abdbe07be5fdd96b59fbdff5fc5ac157f60eea238cfa772a0b451b4475e0 Jun 08 22:01:24.665770 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.665752 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" Jun 08 22:01:24.792224 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.792086 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zn4gt"] Jun 08 22:01:24.795875 ip-10-0-138-88 kubenswrapper[2549]: W0608 22:01:24.795851 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3d06fd7_338d_40ab_8562_beca27147b46.slice/crio-0a585a32e236dbf3dd96b89de1693629363a9a218f8e107c7e49bd364315cef3 WatchSource:0}: Error finding container 0a585a32e236dbf3dd96b89de1693629363a9a218f8e107c7e49bd364315cef3: Status 404 returned error can't find the container with id 0a585a32e236dbf3dd96b89de1693629363a9a218f8e107c7e49bd364315cef3 Jun 08 22:01:24.806888 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.806861 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-rzp7c"] Jun 08 22:01:24.809952 ip-10-0-138-88 kubenswrapper[2549]: W0608 22:01:24.809923 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecc09a2e_0137_45ae_9982_e8f714b875c5.slice/crio-cc5d12d38f280c58a6944fabe73c5ab7a41f8aff5e7189935b10630e2ce256a4 WatchSource:0}: Error finding container cc5d12d38f280c58a6944fabe73c5ab7a41f8aff5e7189935b10630e2ce256a4: Status 404 returned error can't find the container with id cc5d12d38f280c58a6944fabe73c5ab7a41f8aff5e7189935b10630e2ce256a4 Jun 08 22:01:24.922311 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:24.922274 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/198f4f07-ca89-4683-8bfd-2bc9abb51f22-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-276ck\" (UID: \"198f4f07-ca89-4683-8bfd-2bc9abb51f22\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-276ck" Jun 08 22:01:24.922490 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:24.922400 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 22:01:24.922490 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:24.922461 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198f4f07-ca89-4683-8bfd-2bc9abb51f22-samples-operator-tls podName:198f4f07-ca89-4683-8bfd-2bc9abb51f22 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:25.922446023 +0000 UTC m=+237.471332788 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/198f4f07-ca89-4683-8bfd-2bc9abb51f22-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-276ck" (UID: "198f4f07-ca89-4683-8bfd-2bc9abb51f22") : secret "samples-operator-tls" not found Jun 08 22:01:25.023466 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:25.023428 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-metrics-certs\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:25.023643 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:25.023498 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be1775e2-0996-430c-bc0f-0ad7f5faeedb-service-ca-bundle\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:25.023643 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:25.023599 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 22:01:25.023764 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:25.023660 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be1775e2-0996-430c-bc0f-0ad7f5faeedb-service-ca-bundle podName:be1775e2-0996-430c-bc0f-0ad7f5faeedb nodeName:}" failed. No retries permitted until 2026-06-08 22:01:26.023640968 +0000 UTC m=+237.572527742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/be1775e2-0996-430c-bc0f-0ad7f5faeedb-service-ca-bundle") pod "router-default-76bc7cf865-5m4b9" (UID: "be1775e2-0996-430c-bc0f-0ad7f5faeedb") : configmap references non-existent config key: service-ca.crt Jun 08 22:01:25.023764 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:25.023680 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-metrics-certs podName:be1775e2-0996-430c-bc0f-0ad7f5faeedb nodeName:}" failed. No retries permitted until 2026-06-08 22:01:26.023671343 +0000 UTC m=+237.572558115 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-metrics-certs") pod "router-default-76bc7cf865-5m4b9" (UID: "be1775e2-0996-430c-bc0f-0ad7f5faeedb") : secret "router-metrics-certs-default" not found Jun 08 22:01:25.663544 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:25.663447 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-ztclm" event={"ID":"f108f1d1-011a-483f-a7f6-a8e0ec0fcc9a","Type":"ContainerStarted","Data":"97611990c6a9ebf4fcb789c7d5914bc58cb5b09d12523e26237a3607cdaa5d0a"} Jun 08 22:01:25.663544 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:25.663510 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-ztclm" event={"ID":"f108f1d1-011a-483f-a7f6-a8e0ec0fcc9a","Type":"ContainerStarted","Data":"2d41abdbe07be5fdd96b59fbdff5fc5ac157f60eea238cfa772a0b451b4475e0"} Jun 08 22:01:25.665216 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:25.665186 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" event={"ID":"ecc09a2e-0137-45ae-9982-e8f714b875c5","Type":"ContainerStarted","Data":"cc5d12d38f280c58a6944fabe73c5ab7a41f8aff5e7189935b10630e2ce256a4"} Jun 08 22:01:25.666528 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:25.666502 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zn4gt" event={"ID":"a3d06fd7-338d-40ab-8562-beca27147b46","Type":"ContainerStarted","Data":"0a585a32e236dbf3dd96b89de1693629363a9a218f8e107c7e49bd364315cef3"} Jun 08 22:01:25.680285 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:25.680236 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-ztclm" podStartSLOduration=1.680220214 podStartE2EDuration="1.680220214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:01:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:01:25.678832336 +0000 UTC m=+237.227719125" watchObservedRunningTime="2026-06-08 22:01:25.680220214 +0000 UTC m=+237.229107002" Jun 08 22:01:25.932115 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:25.932029 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/198f4f07-ca89-4683-8bfd-2bc9abb51f22-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-276ck\" (UID: \"198f4f07-ca89-4683-8bfd-2bc9abb51f22\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-276ck" Jun 08 22:01:25.932267 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:25.932209 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 22:01:25.932321 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:25.932288 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198f4f07-ca89-4683-8bfd-2bc9abb51f22-samples-operator-tls podName:198f4f07-ca89-4683-8bfd-2bc9abb51f22 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:27.932267856 +0000 UTC m=+239.481154627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/198f4f07-ca89-4683-8bfd-2bc9abb51f22-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-276ck" (UID: "198f4f07-ca89-4683-8bfd-2bc9abb51f22") : secret "samples-operator-tls" not found Jun 08 22:01:26.033432 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:26.033393 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-metrics-certs\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:26.033631 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:26.033466 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be1775e2-0996-430c-bc0f-0ad7f5faeedb-service-ca-bundle\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:26.033631 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:26.033586 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 22:01:26.033736 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:26.033640 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be1775e2-0996-430c-bc0f-0ad7f5faeedb-service-ca-bundle podName:be1775e2-0996-430c-bc0f-0ad7f5faeedb nodeName:}" failed. No retries permitted until 2026-06-08 22:01:28.033620818 +0000 UTC m=+239.582507590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/be1775e2-0996-430c-bc0f-0ad7f5faeedb-service-ca-bundle") pod "router-default-76bc7cf865-5m4b9" (UID: "be1775e2-0996-430c-bc0f-0ad7f5faeedb") : configmap references non-existent config key: service-ca.crt Jun 08 22:01:26.033736 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:26.033665 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-metrics-certs podName:be1775e2-0996-430c-bc0f-0ad7f5faeedb nodeName:}" failed. No retries permitted until 2026-06-08 22:01:28.033654234 +0000 UTC m=+239.582541020 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-metrics-certs") pod "router-default-76bc7cf865-5m4b9" (UID: "be1775e2-0996-430c-bc0f-0ad7f5faeedb") : secret "router-metrics-certs-default" not found Jun 08 22:01:26.669946 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:26.669917 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zn4gt" event={"ID":"a3d06fd7-338d-40ab-8562-beca27147b46","Type":"ContainerStarted","Data":"35fdc2ba701fcd0520cf91f4411135a09e97fc3afe43ca9abfd64e2ebbbb1e38"} Jun 08 22:01:26.685503 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:26.685469 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-zn4gt" podStartSLOduration=1.693202646 podStartE2EDuration="2.685454332s" totalImagesPullingTime="992.251686ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:01:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:01:26.684665186 +0000 UTC m=+238.233551985" watchObservedRunningTime="2026-06-08 22:01:26.685454332 +0000 UTC m=+238.234341119" Jun 08 22:01:27.673953 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:27.673927 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rzp7c_ecc09a2e-0137-45ae-9982-e8f714b875c5/console-operator/0.log" Jun 08 22:01:27.674420 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:27.673964 2549 generic.go:356] "Generic (PLEG): container finished" podID="ecc09a2e-0137-45ae-9982-e8f714b875c5" containerID="f8d0300e9734ec820fe8af5e45ee2021c1facaf61b8bf3a85a3eb5e4ed0f37ba" exitCode=255 Jun 08 22:01:27.674420 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:27.674049 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" event={"ID":"ecc09a2e-0137-45ae-9982-e8f714b875c5","Type":"ContainerDied","Data":"f8d0300e9734ec820fe8af5e45ee2021c1facaf61b8bf3a85a3eb5e4ed0f37ba"} Jun 08 22:01:27.674420 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:27.674235 2549 scope.go:117] "RemoveContainer" containerID="f8d0300e9734ec820fe8af5e45ee2021c1facaf61b8bf3a85a3eb5e4ed0f37ba" Jun 08 22:01:27.946262 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:27.946172 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/198f4f07-ca89-4683-8bfd-2bc9abb51f22-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-276ck\" (UID: \"198f4f07-ca89-4683-8bfd-2bc9abb51f22\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-276ck" Jun 08 22:01:27.946408 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:27.946259 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 22:01:27.946408 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:27.946324 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198f4f07-ca89-4683-8bfd-2bc9abb51f22-samples-operator-tls podName:198f4f07-ca89-4683-8bfd-2bc9abb51f22 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:31.946308278 +0000 UTC m=+243.495195048 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/198f4f07-ca89-4683-8bfd-2bc9abb51f22-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-276ck" (UID: "198f4f07-ca89-4683-8bfd-2bc9abb51f22") : secret "samples-operator-tls" not found Jun 08 22:01:28.046784 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:28.046751 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be1775e2-0996-430c-bc0f-0ad7f5faeedb-service-ca-bundle\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:28.046913 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:28.046832 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-metrics-certs\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:28.046950 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:28.046920 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be1775e2-0996-430c-bc0f-0ad7f5faeedb-service-ca-bundle podName:be1775e2-0996-430c-bc0f-0ad7f5faeedb nodeName:}" failed. No retries permitted until 2026-06-08 22:01:32.046902735 +0000 UTC m=+243.595789501 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/be1775e2-0996-430c-bc0f-0ad7f5faeedb-service-ca-bundle") pod "router-default-76bc7cf865-5m4b9" (UID: "be1775e2-0996-430c-bc0f-0ad7f5faeedb") : configmap references non-existent config key: service-ca.crt Jun 08 22:01:28.046950 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:28.046927 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 22:01:28.047028 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:28.046957 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-metrics-certs podName:be1775e2-0996-430c-bc0f-0ad7f5faeedb nodeName:}" failed. No retries permitted until 2026-06-08 22:01:32.046950246 +0000 UTC m=+243.595837012 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-metrics-certs") pod "router-default-76bc7cf865-5m4b9" (UID: "be1775e2-0996-430c-bc0f-0ad7f5faeedb") : secret "router-metrics-certs-default" not found Jun 08 22:01:28.679015 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:28.678987 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rzp7c_ecc09a2e-0137-45ae-9982-e8f714b875c5/console-operator/1.log" Jun 08 22:01:28.679406 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:28.679397 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rzp7c_ecc09a2e-0137-45ae-9982-e8f714b875c5/console-operator/0.log" Jun 08 22:01:28.679455 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:28.679426 2549 generic.go:356] "Generic (PLEG): container finished" podID="ecc09a2e-0137-45ae-9982-e8f714b875c5" containerID="dc64bfb73c7bbe93bfae4bc7284712dfc8419e2aceeca1c4835d4d6b839c0de8" exitCode=255 Jun 08 22:01:28.679493 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:28.679463 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" event={"ID":"ecc09a2e-0137-45ae-9982-e8f714b875c5","Type":"ContainerDied","Data":"dc64bfb73c7bbe93bfae4bc7284712dfc8419e2aceeca1c4835d4d6b839c0de8"} Jun 08 22:01:28.679536 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:28.679503 2549 scope.go:117] "RemoveContainer" containerID="f8d0300e9734ec820fe8af5e45ee2021c1facaf61b8bf3a85a3eb5e4ed0f37ba" Jun 08 22:01:28.679713 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:28.679697 2549 scope.go:117] "RemoveContainer" containerID="dc64bfb73c7bbe93bfae4bc7284712dfc8419e2aceeca1c4835d4d6b839c0de8" Jun 08 22:01:28.679880 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:28.679861 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-rzp7c_openshift-console-operator(ecc09a2e-0137-45ae-9982-e8f714b875c5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" podUID="ecc09a2e-0137-45ae-9982-e8f714b875c5" Jun 08 22:01:29.683693 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:29.683665 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rzp7c_ecc09a2e-0137-45ae-9982-e8f714b875c5/console-operator/1.log" Jun 08 22:01:29.684044 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:29.683988 2549 scope.go:117] "RemoveContainer" containerID="dc64bfb73c7bbe93bfae4bc7284712dfc8419e2aceeca1c4835d4d6b839c0de8" Jun 08 22:01:29.684188 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:29.684150 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-rzp7c_openshift-console-operator(ecc09a2e-0137-45ae-9982-e8f714b875c5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" podUID="ecc09a2e-0137-45ae-9982-e8f714b875c5" Jun 08 22:01:30.606034 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:30.606006 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j7qkw_88a8a02d-821d-4ef8-b073-8901d5505dd2/dns-node-resolver/0.log" Jun 08 22:01:31.610862 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:31.610839 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-psfzx_a28deb3e-bbc1-4ce0-a5b0-717125c9d872/node-ca/0.log" Jun 08 22:01:31.977376 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:31.977347 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/198f4f07-ca89-4683-8bfd-2bc9abb51f22-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-276ck\" (UID: \"198f4f07-ca89-4683-8bfd-2bc9abb51f22\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-276ck" Jun 08 22:01:31.977555 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:31.977500 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 22:01:31.977598 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:31.977567 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198f4f07-ca89-4683-8bfd-2bc9abb51f22-samples-operator-tls podName:198f4f07-ca89-4683-8bfd-2bc9abb51f22 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:39.977549291 +0000 UTC m=+251.526436072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/198f4f07-ca89-4683-8bfd-2bc9abb51f22-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-276ck" (UID: "198f4f07-ca89-4683-8bfd-2bc9abb51f22") : secret "samples-operator-tls" not found Jun 08 22:01:32.078141 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:32.078102 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-metrics-certs\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:32.078335 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:32.078175 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be1775e2-0996-430c-bc0f-0ad7f5faeedb-service-ca-bundle\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:32.078335 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:32.078265 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 22:01:32.078335 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:32.078293 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be1775e2-0996-430c-bc0f-0ad7f5faeedb-service-ca-bundle podName:be1775e2-0996-430c-bc0f-0ad7f5faeedb nodeName:}" failed. No retries permitted until 2026-06-08 22:01:40.078271771 +0000 UTC m=+251.627158541 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/be1775e2-0996-430c-bc0f-0ad7f5faeedb-service-ca-bundle") pod "router-default-76bc7cf865-5m4b9" (UID: "be1775e2-0996-430c-bc0f-0ad7f5faeedb") : configmap references non-existent config key: service-ca.crt Jun 08 22:01:32.078335 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:32.078313 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-metrics-certs podName:be1775e2-0996-430c-bc0f-0ad7f5faeedb nodeName:}" failed. No retries permitted until 2026-06-08 22:01:40.078301785 +0000 UTC m=+251.627188551 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-metrics-certs") pod "router-default-76bc7cf865-5m4b9" (UID: "be1775e2-0996-430c-bc0f-0ad7f5faeedb") : secret "router-metrics-certs-default" not found Jun 08 22:01:32.405005 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:32.404934 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mn57q_fdd228a4-64ed-47a7-95c8-2144b2afafcd/serve-healthcheck-canary/0.log" Jun 08 22:01:34.666778 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:34.666747 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" Jun 08 22:01:34.667121 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:34.666827 2549 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" Jun 08 22:01:34.667246 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:34.667143 2549 scope.go:117] "RemoveContainer" containerID="dc64bfb73c7bbe93bfae4bc7284712dfc8419e2aceeca1c4835d4d6b839c0de8" Jun 08 22:01:34.667343 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:34.667323 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-rzp7c_openshift-console-operator(ecc09a2e-0137-45ae-9982-e8f714b875c5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" podUID="ecc09a2e-0137-45ae-9982-e8f714b875c5" Jun 08 22:01:40.033617 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:40.033555 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/198f4f07-ca89-4683-8bfd-2bc9abb51f22-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-276ck\" (UID: \"198f4f07-ca89-4683-8bfd-2bc9abb51f22\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-276ck" Jun 08 22:01:40.035964 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:40.035936 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/198f4f07-ca89-4683-8bfd-2bc9abb51f22-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-276ck\" (UID: \"198f4f07-ca89-4683-8bfd-2bc9abb51f22\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-276ck" Jun 08 22:01:40.134344 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:40.134293 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-metrics-certs\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:40.134543 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:40.134368 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be1775e2-0996-430c-bc0f-0ad7f5faeedb-service-ca-bundle\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:40.134965 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:40.134942 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be1775e2-0996-430c-bc0f-0ad7f5faeedb-service-ca-bundle\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:40.136712 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:40.136689 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be1775e2-0996-430c-bc0f-0ad7f5faeedb-metrics-certs\") pod \"router-default-76bc7cf865-5m4b9\" (UID: \"be1775e2-0996-430c-bc0f-0ad7f5faeedb\") " pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:40.145307 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:40.145288 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zj5vn\"" Jun 08 22:01:40.152907 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:40.152894 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-276ck" Jun 08 22:01:40.260961 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:40.260934 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gx95n\"" Jun 08 22:01:40.269005 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:40.268980 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:40.276579 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:40.276551 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-276ck"] Jun 08 22:01:40.400668 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:40.400643 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76bc7cf865-5m4b9"] Jun 08 22:01:40.402968 ip-10-0-138-88 kubenswrapper[2549]: W0608 22:01:40.402942 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe1775e2_0996_430c_bc0f_0ad7f5faeedb.slice/crio-119b127373f5a9eaec72172c9d307c5d399441bc9295274df2fd0a994f71769b WatchSource:0}: Error finding container 119b127373f5a9eaec72172c9d307c5d399441bc9295274df2fd0a994f71769b: Status 404 returned error can't find the container with id 119b127373f5a9eaec72172c9d307c5d399441bc9295274df2fd0a994f71769b Jun 08 22:01:40.719481 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:40.719443 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-276ck" event={"ID":"198f4f07-ca89-4683-8bfd-2bc9abb51f22","Type":"ContainerStarted","Data":"f0d8c6e5b28d7289c86164beb6a5df752131817d51b8607696ac9127f09e6a65"} Jun 08 22:01:40.720849 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:40.720826 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76bc7cf865-5m4b9" event={"ID":"be1775e2-0996-430c-bc0f-0ad7f5faeedb","Type":"ContainerStarted","Data":"d9380cbf1c89f894c8a01b940bdb15a07895bb8eb9997a9b3e8828daaec21821"} Jun 08 22:01:40.720959 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:40.720863 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76bc7cf865-5m4b9" event={"ID":"be1775e2-0996-430c-bc0f-0ad7f5faeedb","Type":"ContainerStarted","Data":"119b127373f5a9eaec72172c9d307c5d399441bc9295274df2fd0a994f71769b"} Jun 08 22:01:40.740477 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:40.740434 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-76bc7cf865-5m4b9" podStartSLOduration=16.740420525 podStartE2EDuration="16.740420525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:01:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:01:40.740090427 +0000 UTC m=+252.288977216" watchObservedRunningTime="2026-06-08 22:01:40.740420525 +0000 UTC m=+252.289307290" Jun 08 22:01:40.839923 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:40.839888 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs\") pod \"network-metrics-daemon-4pmzz\" (UID: \"12b6a387-cd80-4157-8c91-00fdb3ee3676\") " pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 22:01:40.840101 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:40.840021 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 22:01:40.840101 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:40.840081 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs podName:12b6a387-cd80-4157-8c91-00fdb3ee3676 nodeName:}" failed. No retries permitted until 2026-06-08 22:03:42.840062775 +0000 UTC m=+374.388949560 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs") pod "network-metrics-daemon-4pmzz" (UID: "12b6a387-cd80-4157-8c91-00fdb3ee3676") : secret "metrics-daemon-secret" not found Jun 08 22:01:41.269553 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:41.269512 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:41.272483 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:41.272450 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:41.723949 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:41.723916 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:41.725545 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:41.725524 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-76bc7cf865-5m4b9" Jun 08 22:01:42.728422 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:42.728387 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-276ck" event={"ID":"198f4f07-ca89-4683-8bfd-2bc9abb51f22","Type":"ContainerStarted","Data":"a9912a5317f51295d69554eae0542b15b293e64afbd6104cadab047ce7553028"} Jun 08 22:01:42.728809 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:42.728443 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-276ck" event={"ID":"198f4f07-ca89-4683-8bfd-2bc9abb51f22","Type":"ContainerStarted","Data":"0b1b8b016bd79990be0b35766513b74e45232b411a31710f920188186e05835e"} Jun 08 22:01:42.748350 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:42.748297 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-276ck" podStartSLOduration=17.215517179 podStartE2EDuration="18.748277926s" totalImagesPullingTime="1.532760747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:01:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:01:42.74771799 +0000 UTC m=+254.296604803" watchObservedRunningTime="2026-06-08 22:01:42.748277926 +0000 UTC m=+254.297164713" Jun 08 22:01:48.994077 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:48.993993 2549 scope.go:117] "RemoveContainer" containerID="dc64bfb73c7bbe93bfae4bc7284712dfc8419e2aceeca1c4835d4d6b839c0de8" Jun 08 22:01:49.659803 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.659764 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xkhl7"] Jun 08 22:01:49.661831 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.661810 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xkhl7" Jun 08 22:01:49.664729 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.664708 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 22:01:49.665962 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.665925 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p8cl5\"" Jun 08 22:01:49.665962 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.665932 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 22:01:49.665962 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.665955 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 22:01:49.666197 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.665957 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 22:01:49.679108 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.679083 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xkhl7"] Jun 08 22:01:49.749755 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.749730 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rzp7c_ecc09a2e-0137-45ae-9982-e8f714b875c5/console-operator/2.log" Jun 08 22:01:49.750197 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.750183 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rzp7c_ecc09a2e-0137-45ae-9982-e8f714b875c5/console-operator/1.log" Jun 08 22:01:49.750275 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.750215 2549 generic.go:356] "Generic (PLEG): container finished" podID="ecc09a2e-0137-45ae-9982-e8f714b875c5" containerID="5a8e7d94d0da30357756085720987b3ec32e988238d4f6074dc34e22a2917921" exitCode=255 Jun 08 22:01:49.750275 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.750242 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" event={"ID":"ecc09a2e-0137-45ae-9982-e8f714b875c5","Type":"ContainerDied","Data":"5a8e7d94d0da30357756085720987b3ec32e988238d4f6074dc34e22a2917921"} Jun 08 22:01:49.750384 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.750283 2549 scope.go:117] "RemoveContainer" containerID="dc64bfb73c7bbe93bfae4bc7284712dfc8419e2aceeca1c4835d4d6b839c0de8" Jun 08 22:01:49.750583 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.750568 2549 scope.go:117] "RemoveContainer" containerID="5a8e7d94d0da30357756085720987b3ec32e988238d4f6074dc34e22a2917921" Jun 08 22:01:49.750767 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:49.750745 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-rzp7c_openshift-console-operator(ecc09a2e-0137-45ae-9982-e8f714b875c5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" podUID="ecc09a2e-0137-45ae-9982-e8f714b875c5" Jun 08 22:01:49.803543 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.803505 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh7zg\" (UniqueName: \"kubernetes.io/projected/173d56f5-dd98-4f76-ae32-fb2963c58134-kube-api-access-sh7zg\") pod \"insights-runtime-extractor-xkhl7\" (UID: \"173d56f5-dd98-4f76-ae32-fb2963c58134\") " pod="openshift-insights/insights-runtime-extractor-xkhl7" Jun 08 22:01:49.803543 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.803555 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/173d56f5-dd98-4f76-ae32-fb2963c58134-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xkhl7\" (UID: \"173d56f5-dd98-4f76-ae32-fb2963c58134\") " pod="openshift-insights/insights-runtime-extractor-xkhl7" Jun 08 22:01:49.803771 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.803659 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/173d56f5-dd98-4f76-ae32-fb2963c58134-crio-socket\") pod \"insights-runtime-extractor-xkhl7\" (UID: \"173d56f5-dd98-4f76-ae32-fb2963c58134\") " pod="openshift-insights/insights-runtime-extractor-xkhl7" Jun 08 22:01:49.803771 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.803708 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/173d56f5-dd98-4f76-ae32-fb2963c58134-data-volume\") pod \"insights-runtime-extractor-xkhl7\" (UID: \"173d56f5-dd98-4f76-ae32-fb2963c58134\") " pod="openshift-insights/insights-runtime-extractor-xkhl7" Jun 08 22:01:49.803872 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.803761 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/173d56f5-dd98-4f76-ae32-fb2963c58134-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xkhl7\" (UID: \"173d56f5-dd98-4f76-ae32-fb2963c58134\") " pod="openshift-insights/insights-runtime-extractor-xkhl7" Jun 08 22:01:49.904503 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.904470 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/173d56f5-dd98-4f76-ae32-fb2963c58134-crio-socket\") pod \"insights-runtime-extractor-xkhl7\" (UID: \"173d56f5-dd98-4f76-ae32-fb2963c58134\") " pod="openshift-insights/insights-runtime-extractor-xkhl7" Jun 08 22:01:49.904628 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.904514 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/173d56f5-dd98-4f76-ae32-fb2963c58134-data-volume\") pod \"insights-runtime-extractor-xkhl7\" (UID: \"173d56f5-dd98-4f76-ae32-fb2963c58134\") " pod="openshift-insights/insights-runtime-extractor-xkhl7" Jun 08 22:01:49.904628 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.904534 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/173d56f5-dd98-4f76-ae32-fb2963c58134-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xkhl7\" (UID: \"173d56f5-dd98-4f76-ae32-fb2963c58134\") " pod="openshift-insights/insights-runtime-extractor-xkhl7" Jun 08 22:01:49.904628 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.904575 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh7zg\" (UniqueName: \"kubernetes.io/projected/173d56f5-dd98-4f76-ae32-fb2963c58134-kube-api-access-sh7zg\") pod \"insights-runtime-extractor-xkhl7\" (UID: \"173d56f5-dd98-4f76-ae32-fb2963c58134\") " pod="openshift-insights/insights-runtime-extractor-xkhl7" Jun 08 22:01:49.904628 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.904596 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/173d56f5-dd98-4f76-ae32-fb2963c58134-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xkhl7\" (UID: \"173d56f5-dd98-4f76-ae32-fb2963c58134\") " pod="openshift-insights/insights-runtime-extractor-xkhl7" Jun 08 22:01:49.904628 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.904604 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/173d56f5-dd98-4f76-ae32-fb2963c58134-crio-socket\") pod \"insights-runtime-extractor-xkhl7\" (UID: \"173d56f5-dd98-4f76-ae32-fb2963c58134\") " pod="openshift-insights/insights-runtime-extractor-xkhl7" Jun 08 22:01:49.904923 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.904901 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/173d56f5-dd98-4f76-ae32-fb2963c58134-data-volume\") pod \"insights-runtime-extractor-xkhl7\" (UID: \"173d56f5-dd98-4f76-ae32-fb2963c58134\") " pod="openshift-insights/insights-runtime-extractor-xkhl7" Jun 08 22:01:49.905136 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.905111 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/173d56f5-dd98-4f76-ae32-fb2963c58134-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xkhl7\" (UID: \"173d56f5-dd98-4f76-ae32-fb2963c58134\") " pod="openshift-insights/insights-runtime-extractor-xkhl7" Jun 08 22:01:49.906969 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.906952 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/173d56f5-dd98-4f76-ae32-fb2963c58134-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xkhl7\" (UID: \"173d56f5-dd98-4f76-ae32-fb2963c58134\") " pod="openshift-insights/insights-runtime-extractor-xkhl7" Jun 08 22:01:49.913017 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.912968 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh7zg\" (UniqueName: \"kubernetes.io/projected/173d56f5-dd98-4f76-ae32-fb2963c58134-kube-api-access-sh7zg\") pod \"insights-runtime-extractor-xkhl7\" (UID: \"173d56f5-dd98-4f76-ae32-fb2963c58134\") " pod="openshift-insights/insights-runtime-extractor-xkhl7" Jun 08 22:01:49.972340 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:49.972306 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xkhl7" Jun 08 22:01:50.098746 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:50.098715 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xkhl7"] Jun 08 22:01:50.102314 ip-10-0-138-88 kubenswrapper[2549]: W0608 22:01:50.102281 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173d56f5_dd98_4f76_ae32_fb2963c58134.slice/crio-0d6baeeefda715b3848542df046de1409badf927872e1e60a71ec9c31a50f0d9 WatchSource:0}: Error finding container 0d6baeeefda715b3848542df046de1409badf927872e1e60a71ec9c31a50f0d9: Status 404 returned error can't find the container with id 0d6baeeefda715b3848542df046de1409badf927872e1e60a71ec9c31a50f0d9 Jun 08 22:01:50.754551 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:50.754519 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xkhl7" event={"ID":"173d56f5-dd98-4f76-ae32-fb2963c58134","Type":"ContainerStarted","Data":"2c925cdbd50761d6382cee854548c064dde166b378e609ac4b22c0e2c592e567"} Jun 08 22:01:50.754716 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:50.754588 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xkhl7" event={"ID":"173d56f5-dd98-4f76-ae32-fb2963c58134","Type":"ContainerStarted","Data":"0d6baeeefda715b3848542df046de1409badf927872e1e60a71ec9c31a50f0d9"} Jun 08 22:01:50.756013 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:50.755994 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rzp7c_ecc09a2e-0137-45ae-9982-e8f714b875c5/console-operator/2.log" Jun 08 22:01:51.762532 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:51.762493 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xkhl7" event={"ID":"173d56f5-dd98-4f76-ae32-fb2963c58134","Type":"ContainerStarted","Data":"ff31b58d527d2e51ae0d7c35bedae0f3aa7350abaccf08ac3a71084ebb0f1e00"} Jun 08 22:01:52.767683 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:52.767644 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xkhl7" event={"ID":"173d56f5-dd98-4f76-ae32-fb2963c58134","Type":"ContainerStarted","Data":"231c04f1cd2be187c8f3f84bb1c9c32993eda56af95d134993d253fb1871d40f"} Jun 08 22:01:52.787233 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:52.787187 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xkhl7" podStartSLOduration=1.708354811 podStartE2EDuration="3.787150149s" totalImagesPullingTime="2.078795338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 22:01:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:01:52.78649486 +0000 UTC m=+264.335381677" watchObservedRunningTime="2026-06-08 22:01:52.787150149 +0000 UTC m=+264.336036936" Jun 08 22:01:54.666226 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:54.666188 2549 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" Jun 08 22:01:54.666635 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:54.666245 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" Jun 08 22:01:54.666635 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:54.666533 2549 scope.go:117] "RemoveContainer" containerID="5a8e7d94d0da30357756085720987b3ec32e988238d4f6074dc34e22a2917921" Jun 08 22:01:54.666700 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:54.666683 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-rzp7c_openshift-console-operator(ecc09a2e-0137-45ae-9982-e8f714b875c5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" podUID="ecc09a2e-0137-45ae-9982-e8f714b875c5" Jun 08 22:01:59.111432 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:59.111397 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-n844j"] Jun 08 22:01:59.113391 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:59.113376 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-n844j" Jun 08 22:01:59.116191 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:59.116174 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 08 22:01:59.116748 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:59.116730 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-77rbn\"" Jun 08 22:01:59.123561 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:59.123541 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-n844j"] Jun 08 22:01:59.175056 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:59.175024 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/66f9c945-78fc-4b4d-848e-88ca9b50ae38-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-n844j\" (UID: \"66f9c945-78fc-4b4d-848e-88ca9b50ae38\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-n844j" Jun 08 22:01:59.276272 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:59.276237 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/66f9c945-78fc-4b4d-848e-88ca9b50ae38-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-n844j\" (UID: \"66f9c945-78fc-4b4d-848e-88ca9b50ae38\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-n844j" Jun 08 22:01:59.276435 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:59.276392 2549 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 08 22:01:59.276477 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:01:59.276468 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66f9c945-78fc-4b4d-848e-88ca9b50ae38-tls-certificates podName:66f9c945-78fc-4b4d-848e-88ca9b50ae38 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:59.776451248 +0000 UTC m=+271.325338014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/66f9c945-78fc-4b4d-848e-88ca9b50ae38-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-n844j" (UID: "66f9c945-78fc-4b4d-848e-88ca9b50ae38") : secret "prometheus-operator-admission-webhook-tls" not found Jun 08 22:01:59.779703 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:59.779657 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/66f9c945-78fc-4b4d-848e-88ca9b50ae38-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-n844j\" (UID: \"66f9c945-78fc-4b4d-848e-88ca9b50ae38\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-n844j" Jun 08 22:01:59.782036 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:01:59.781996 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/66f9c945-78fc-4b4d-848e-88ca9b50ae38-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-n844j\" (UID: \"66f9c945-78fc-4b4d-848e-88ca9b50ae38\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-n844j" Jun 08 22:02:00.022415 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:00.022380 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-n844j" Jun 08 22:02:00.144341 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:00.144304 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-n844j"] Jun 08 22:02:00.146859 ip-10-0-138-88 kubenswrapper[2549]: W0608 22:02:00.146835 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f9c945_78fc_4b4d_848e_88ca9b50ae38.slice/crio-cb388a2c764b49a5a6fe0b266c7dbcdbc01204173ce929b80ee990e6536dfe2f WatchSource:0}: Error finding container cb388a2c764b49a5a6fe0b266c7dbcdbc01204173ce929b80ee990e6536dfe2f: Status 404 returned error can't find the container with id cb388a2c764b49a5a6fe0b266c7dbcdbc01204173ce929b80ee990e6536dfe2f Jun 08 22:02:00.792423 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:00.792389 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-n844j" event={"ID":"66f9c945-78fc-4b4d-848e-88ca9b50ae38","Type":"ContainerStarted","Data":"cb388a2c764b49a5a6fe0b266c7dbcdbc01204173ce929b80ee990e6536dfe2f"} Jun 08 22:02:01.797720 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:01.797679 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-n844j" event={"ID":"66f9c945-78fc-4b4d-848e-88ca9b50ae38","Type":"ContainerStarted","Data":"3bd9225c6fb72d9383882d76b8542b9a4d0d2af3aa89d57fe38ca2cf03ed5a9c"} Jun 08 22:02:01.798112 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:01.797849 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-n844j" Jun 08 22:02:01.802357 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:01.802335 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-n844j" Jun 08 22:02:01.812669 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:01.812626 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-n844j" podStartSLOduration=1.939526405 podStartE2EDuration="2.812612933s" totalImagesPullingTime="873.086528ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:01:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:02:01.812204354 +0000 UTC m=+273.361091141" watchObservedRunningTime="2026-06-08 22:02:01.812612933 +0000 UTC m=+273.361499721" Jun 08 22:02:06.512725 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.512693 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj"] Jun 08 22:02:06.514916 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.514901 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" Jun 08 22:02:06.518440 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.518419 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 22:02:06.518559 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.518422 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 08 22:02:06.518559 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.518474 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 22:02:06.518707 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.518690 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 08 22:02:06.518805 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.518793 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gz887\"" Jun 08 22:02:06.518866 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.518832 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 08 22:02:06.519635 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.519621 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 22:02:06.532090 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.532063 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj"] Jun 08 22:02:06.532989 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.532967 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-blqfm"] Jun 08 22:02:06.535427 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.535410 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.537991 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.537972 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 22:02:06.538093 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.538068 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 22:02:06.538432 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.538417 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 22:02:06.538596 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.538583 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j52gz\"" Jun 08 22:02:06.628692 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.628660 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw6g6\" (UniqueName: \"kubernetes.io/projected/1214154d-d56b-44a1-8516-4bc1e6c479e1-kube-api-access-zw6g6\") pod \"kube-state-metrics-57bbf8bfb5-xczlj\" (UID: \"1214154d-d56b-44a1-8516-4bc1e6c479e1\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" Jun 08 22:02:06.628692 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.628696 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7a600274-2930-4a53-a063-6442a3d01484-node-exporter-tls\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.628885 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.628721 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dng28\" (UniqueName: \"kubernetes.io/projected/7a600274-2930-4a53-a063-6442a3d01484-kube-api-access-dng28\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.628885 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.628787 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1214154d-d56b-44a1-8516-4bc1e6c479e1-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-xczlj\" (UID: \"1214154d-d56b-44a1-8516-4bc1e6c479e1\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" Jun 08 22:02:06.628885 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.628821 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a600274-2930-4a53-a063-6442a3d01484-sys\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.628885 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.628839 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a600274-2930-4a53-a063-6442a3d01484-metrics-client-ca\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.628885 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.628854 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7a600274-2930-4a53-a063-6442a3d01484-node-exporter-accelerators-collector-config\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.629041 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.628895 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1214154d-d56b-44a1-8516-4bc1e6c479e1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-xczlj\" (UID: \"1214154d-d56b-44a1-8516-4bc1e6c479e1\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" Jun 08 22:02:06.629041 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.628934 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7a600274-2930-4a53-a063-6442a3d01484-node-exporter-wtmp\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.629041 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.628971 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1214154d-d56b-44a1-8516-4bc1e6c479e1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-xczlj\" (UID: \"1214154d-d56b-44a1-8516-4bc1e6c479e1\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" Jun 08 22:02:06.629041 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.628990 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1214154d-d56b-44a1-8516-4bc1e6c479e1-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-xczlj\" (UID: \"1214154d-d56b-44a1-8516-4bc1e6c479e1\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" Jun 08 22:02:06.629229 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.629045 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7a600274-2930-4a53-a063-6442a3d01484-root\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.629229 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.629062 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1214154d-d56b-44a1-8516-4bc1e6c479e1-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-xczlj\" (UID: \"1214154d-d56b-44a1-8516-4bc1e6c479e1\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" Jun 08 22:02:06.629229 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.629095 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7a600274-2930-4a53-a063-6442a3d01484-node-exporter-textfile\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.629229 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.629114 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a600274-2930-4a53-a063-6442a3d01484-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.729760 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.729727 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1214154d-d56b-44a1-8516-4bc1e6c479e1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-xczlj\" (UID: \"1214154d-d56b-44a1-8516-4bc1e6c479e1\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" Jun 08 22:02:06.729760 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.729763 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1214154d-d56b-44a1-8516-4bc1e6c479e1-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-xczlj\" (UID: \"1214154d-d56b-44a1-8516-4bc1e6c479e1\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" Jun 08 22:02:06.729934 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.729794 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7a600274-2930-4a53-a063-6442a3d01484-root\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.729934 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.729820 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1214154d-d56b-44a1-8516-4bc1e6c479e1-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-xczlj\" (UID: \"1214154d-d56b-44a1-8516-4bc1e6c479e1\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" Jun 08 22:02:06.729934 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.729850 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7a600274-2930-4a53-a063-6442a3d01484-node-exporter-textfile\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.729934 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.729865 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a600274-2930-4a53-a063-6442a3d01484-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.729934 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.729872 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7a600274-2930-4a53-a063-6442a3d01484-root\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.729934 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.729891 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw6g6\" (UniqueName: \"kubernetes.io/projected/1214154d-d56b-44a1-8516-4bc1e6c479e1-kube-api-access-zw6g6\") pod \"kube-state-metrics-57bbf8bfb5-xczlj\" (UID: \"1214154d-d56b-44a1-8516-4bc1e6c479e1\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" Jun 08 22:02:06.729934 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.729932 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7a600274-2930-4a53-a063-6442a3d01484-node-exporter-tls\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.730308 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.729967 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dng28\" (UniqueName: \"kubernetes.io/projected/7a600274-2930-4a53-a063-6442a3d01484-kube-api-access-dng28\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.730308 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.729995 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1214154d-d56b-44a1-8516-4bc1e6c479e1-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-xczlj\" (UID: \"1214154d-d56b-44a1-8516-4bc1e6c479e1\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" Jun 08 22:02:06.730308 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:02:06.730054 2549 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 08 22:02:06.730308 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:02:06.730118 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a600274-2930-4a53-a063-6442a3d01484-node-exporter-tls podName:7a600274-2930-4a53-a063-6442a3d01484 nodeName:}" failed. No retries permitted until 2026-06-08 22:02:07.230097427 +0000 UTC m=+278.778984193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7a600274-2930-4a53-a063-6442a3d01484-node-exporter-tls") pod "node-exporter-blqfm" (UID: "7a600274-2930-4a53-a063-6442a3d01484") : secret "node-exporter-tls" not found Jun 08 22:02:06.730308 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.730246 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a600274-2930-4a53-a063-6442a3d01484-sys\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.730308 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.730270 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7a600274-2930-4a53-a063-6442a3d01484-node-exporter-textfile\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.730308 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.730301 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1214154d-d56b-44a1-8516-4bc1e6c479e1-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-xczlj\" (UID: \"1214154d-d56b-44a1-8516-4bc1e6c479e1\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" Jun 08 22:02:06.730652 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.730273 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a600274-2930-4a53-a063-6442a3d01484-metrics-client-ca\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.730652 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.730331 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a600274-2930-4a53-a063-6442a3d01484-sys\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.730652 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.730355 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7a600274-2930-4a53-a063-6442a3d01484-node-exporter-accelerators-collector-config\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.730652 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.730393 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1214154d-d56b-44a1-8516-4bc1e6c479e1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-xczlj\" (UID: \"1214154d-d56b-44a1-8516-4bc1e6c479e1\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" Jun 08 22:02:06.730652 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.730427 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7a600274-2930-4a53-a063-6442a3d01484-node-exporter-wtmp\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.730652 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.730582 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7a600274-2930-4a53-a063-6442a3d01484-node-exporter-wtmp\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.730933 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.730724 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1214154d-d56b-44a1-8516-4bc1e6c479e1-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-xczlj\" (UID: \"1214154d-d56b-44a1-8516-4bc1e6c479e1\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" Jun 08 22:02:06.730933 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.730855 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a600274-2930-4a53-a063-6442a3d01484-metrics-client-ca\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.731224 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.730944 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7a600274-2930-4a53-a063-6442a3d01484-node-exporter-accelerators-collector-config\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.731224 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.731075 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1214154d-d56b-44a1-8516-4bc1e6c479e1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-xczlj\" (UID: \"1214154d-d56b-44a1-8516-4bc1e6c479e1\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" Jun 08 22:02:06.732445 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.732425 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1214154d-d56b-44a1-8516-4bc1e6c479e1-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-xczlj\" (UID: \"1214154d-d56b-44a1-8516-4bc1e6c479e1\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" Jun 08 22:02:06.732540 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.732493 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1214154d-d56b-44a1-8516-4bc1e6c479e1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-xczlj\" (UID: \"1214154d-d56b-44a1-8516-4bc1e6c479e1\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" Jun 08 22:02:06.732638 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.732624 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a600274-2930-4a53-a063-6442a3d01484-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.738323 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.738302 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dng28\" (UniqueName: \"kubernetes.io/projected/7a600274-2930-4a53-a063-6442a3d01484-kube-api-access-dng28\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:06.738424 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.738321 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw6g6\" (UniqueName: \"kubernetes.io/projected/1214154d-d56b-44a1-8516-4bc1e6c479e1-kube-api-access-zw6g6\") pod \"kube-state-metrics-57bbf8bfb5-xczlj\" (UID: \"1214154d-d56b-44a1-8516-4bc1e6c479e1\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" Jun 08 22:02:06.824055 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.823985 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" Jun 08 22:02:06.950979 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:06.950836 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj"] Jun 08 22:02:06.953533 ip-10-0-138-88 kubenswrapper[2549]: W0608 22:02:06.953510 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1214154d_d56b_44a1_8516_4bc1e6c479e1.slice/crio-25dd321aad8b7e54f56b2427acdc9704930da53c883a9947b186da7aa911e95e WatchSource:0}: Error finding container 25dd321aad8b7e54f56b2427acdc9704930da53c883a9947b186da7aa911e95e: Status 404 returned error can't find the container with id 25dd321aad8b7e54f56b2427acdc9704930da53c883a9947b186da7aa911e95e Jun 08 22:02:07.234847 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.234811 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7a600274-2930-4a53-a063-6442a3d01484-node-exporter-tls\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:07.237052 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.237024 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7a600274-2930-4a53-a063-6442a3d01484-node-exporter-tls\") pod \"node-exporter-blqfm\" (UID: \"7a600274-2930-4a53-a063-6442a3d01484\") " pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:07.444243 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.444207 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-blqfm" Jun 08 22:02:07.454050 ip-10-0-138-88 kubenswrapper[2549]: W0608 22:02:07.454023 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a600274_2930_4a53_a063_6442a3d01484.slice/crio-2c0e6ee6e05435fb35d3fe1f6f23c9f9cbea3c3343007fac0d240be5abba1220 WatchSource:0}: Error finding container 2c0e6ee6e05435fb35d3fe1f6f23c9f9cbea3c3343007fac0d240be5abba1220: Status 404 returned error can't find the container with id 2c0e6ee6e05435fb35d3fe1f6f23c9f9cbea3c3343007fac0d240be5abba1220 Jun 08 22:02:07.588763 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.586840 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 22:02:07.590991 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.590506 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.600182 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.600125 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 22:02:07.600182 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.600145 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 22:02:07.600182 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.600179 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 22:02:07.600556 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.600537 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 22:02:07.600556 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.600550 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 22:02:07.600682 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.600556 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-prjzl\"" Jun 08 22:02:07.600739 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.600705 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 22:02:07.600895 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.600873 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 22:02:07.601346 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.601322 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 22:02:07.605128 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.605107 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 22:02:07.612283 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.612260 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 22:02:07.739238 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.739205 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.739381 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.739250 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxvfz\" (UniqueName: \"kubernetes.io/projected/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-kube-api-access-pxvfz\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.739381 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.739291 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.739381 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.739348 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.739556 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.739410 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.739556 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.739438 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.739556 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.739518 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.739707 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.739580 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-config-out\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.739707 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.739615 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-web-config\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.739707 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.739641 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.739707 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.739668 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.739881 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.739708 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.739881 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.739734 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-config-volume\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.820899 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.820815 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" event={"ID":"1214154d-d56b-44a1-8516-4bc1e6c479e1","Type":"ContainerStarted","Data":"25dd321aad8b7e54f56b2427acdc9704930da53c883a9947b186da7aa911e95e"} Jun 08 22:02:07.822451 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.822419 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-blqfm" event={"ID":"7a600274-2930-4a53-a063-6442a3d01484","Type":"ContainerStarted","Data":"2c0e6ee6e05435fb35d3fe1f6f23c9f9cbea3c3343007fac0d240be5abba1220"} Jun 08 22:02:07.841204 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.841101 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.841370 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.841275 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-config-out\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.841370 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.841330 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-web-config\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.841370 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.841353 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.841530 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.841382 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.841530 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.841417 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.841850 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.841763 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-config-volume\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.841850 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.841815 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.841850 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.841846 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxvfz\" (UniqueName: \"kubernetes.io/projected/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-kube-api-access-pxvfz\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.842061 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.841887 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.842061 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.841934 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.842061 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.841998 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.842061 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.842042 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.842295 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.842110 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.842295 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.842221 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.842744 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.842403 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.844012 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:02:07.843987 2549 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 08 22:02:07.844102 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:02:07.844059 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-main-tls podName:d52a9ae5-b53f-4ec5-bbed-df98d7ffa437 nodeName:}" failed. No retries permitted until 2026-06-08 22:02:08.344040451 +0000 UTC m=+279.892927220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437") : secret "alertmanager-main-tls" not found Jun 08 22:02:07.844996 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.844775 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.845089 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.845020 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-config-out\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.845251 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.845212 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-web-config\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.845652 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.845605 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.845652 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.845641 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.845995 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.845973 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-config-volume\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.846911 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.846886 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.847819 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.847799 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:07.851867 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:07.851846 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxvfz\" (UniqueName: \"kubernetes.io/projected/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-kube-api-access-pxvfz\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:08.346361 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.346314 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:08.346593 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:02:08.346464 2549 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 08 22:02:08.346593 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:02:08.346531 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-main-tls podName:d52a9ae5-b53f-4ec5-bbed-df98d7ffa437 nodeName:}" failed. No retries permitted until 2026-06-08 22:02:09.346515212 +0000 UTC m=+280.895401979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437") : secret "alertmanager-main-tls" not found Jun 08 22:02:08.660073 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.660027 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-795c5b9978-5zpj4"] Jun 08 22:02:08.663113 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.663087 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.666032 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.666010 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 08 22:02:08.666346 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.666322 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 08 22:02:08.666451 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.666346 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2jbtx\"" Jun 08 22:02:08.666451 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.666399 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 08 22:02:08.666451 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.666344 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 08 22:02:08.666717 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.666694 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 08 22:02:08.667122 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.667102 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3k61p7f41p4fe\"" Jun 08 22:02:08.675919 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.675898 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-795c5b9978-5zpj4"] Jun 08 22:02:08.749134 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.749105 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e8c22265-f320-4b35-ab31-eee221f493b9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.749298 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.749173 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e8c22265-f320-4b35-ab31-eee221f493b9-secret-thanos-querier-tls\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.749298 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.749200 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8c22265-f320-4b35-ab31-eee221f493b9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.749298 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.749242 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e8c22265-f320-4b35-ab31-eee221f493b9-secret-grpc-tls\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.749298 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.749258 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8c22265-f320-4b35-ab31-eee221f493b9-metrics-client-ca\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.749464 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.749338 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e8c22265-f320-4b35-ab31-eee221f493b9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.749464 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.749384 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zckc8\" (UniqueName: \"kubernetes.io/projected/e8c22265-f320-4b35-ab31-eee221f493b9-kube-api-access-zckc8\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.749547 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.749464 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8c22265-f320-4b35-ab31-eee221f493b9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.827575 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.827531 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" event={"ID":"1214154d-d56b-44a1-8516-4bc1e6c479e1","Type":"ContainerStarted","Data":"4645a0694057eeaae08185185058c08508d253590c3c2506d0519daddf9e893b"} Jun 08 22:02:08.827764 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.827601 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" event={"ID":"1214154d-d56b-44a1-8516-4bc1e6c479e1","Type":"ContainerStarted","Data":"f381ab8157fa30fbb3ebdde3e9de8bb6737f787a318f5f211a56b9f2a55d664b"} Jun 08 22:02:08.827764 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.827631 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" event={"ID":"1214154d-d56b-44a1-8516-4bc1e6c479e1","Type":"ContainerStarted","Data":"70be4587af2d84ff8316f626360ef69824603bdcc75ef40ef83e298632be5ae6"} Jun 08 22:02:08.829124 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.829097 2549 generic.go:356] "Generic (PLEG): container finished" podID="7a600274-2930-4a53-a063-6442a3d01484" containerID="b3eadf86b4d711e27c9e90d3f462c968761f66d8f52b8935ae7ffaacb546f62e" exitCode=0 Jun 08 22:02:08.829248 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.829140 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-blqfm" event={"ID":"7a600274-2930-4a53-a063-6442a3d01484","Type":"ContainerDied","Data":"b3eadf86b4d711e27c9e90d3f462c968761f66d8f52b8935ae7ffaacb546f62e"} Jun 08 22:02:08.848826 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.848749 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xczlj" podStartSLOduration=1.423138815 podStartE2EDuration="2.848733474s" totalImagesPullingTime="1.425594659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:02:08.847462552 +0000 UTC m=+280.396349341" watchObservedRunningTime="2026-06-08 22:02:08.848733474 +0000 UTC m=+280.397620262" Jun 08 22:02:08.850059 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.850036 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e8c22265-f320-4b35-ab31-eee221f493b9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.850188 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.850082 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zckc8\" (UniqueName: \"kubernetes.io/projected/e8c22265-f320-4b35-ab31-eee221f493b9-kube-api-access-zckc8\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.850188 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.850112 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8c22265-f320-4b35-ab31-eee221f493b9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.850188 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.850146 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e8c22265-f320-4b35-ab31-eee221f493b9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.850346 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.850215 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e8c22265-f320-4b35-ab31-eee221f493b9-secret-thanos-querier-tls\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.850346 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.850238 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8c22265-f320-4b35-ab31-eee221f493b9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.850346 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.850303 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e8c22265-f320-4b35-ab31-eee221f493b9-secret-grpc-tls\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.850346 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.850330 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8c22265-f320-4b35-ab31-eee221f493b9-metrics-client-ca\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.851056 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.851030 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8c22265-f320-4b35-ab31-eee221f493b9-metrics-client-ca\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.853293 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.853234 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e8c22265-f320-4b35-ab31-eee221f493b9-secret-thanos-querier-tls\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.853293 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.853247 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e8c22265-f320-4b35-ab31-eee221f493b9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.853293 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.853237 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e8c22265-f320-4b35-ab31-eee221f493b9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.853523 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.853504 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e8c22265-f320-4b35-ab31-eee221f493b9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.853830 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.853808 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e8c22265-f320-4b35-ab31-eee221f493b9-secret-grpc-tls\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.854534 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.854515 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e8c22265-f320-4b35-ab31-eee221f493b9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.865327 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.865303 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zckc8\" (UniqueName: \"kubernetes.io/projected/e8c22265-f320-4b35-ab31-eee221f493b9-kube-api-access-zckc8\") pod \"thanos-querier-795c5b9978-5zpj4\" (UID: \"e8c22265-f320-4b35-ab31-eee221f493b9\") " pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.973810 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.973782 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:08.995015 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:08.994992 2549 scope.go:117] "RemoveContainer" containerID="5a8e7d94d0da30357756085720987b3ec32e988238d4f6074dc34e22a2917921" Jun 08 22:02:08.995234 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:02:08.995210 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-rzp7c_openshift-console-operator(ecc09a2e-0137-45ae-9982-e8f714b875c5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" podUID="ecc09a2e-0137-45ae-9982-e8f714b875c5" Jun 08 22:02:09.115907 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:09.115884 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-795c5b9978-5zpj4"] Jun 08 22:02:09.117841 ip-10-0-138-88 kubenswrapper[2549]: W0608 22:02:09.117813 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c22265_f320_4b35_ab31_eee221f493b9.slice/crio-bf6430c19748fba8b53973c655bfd1d0f369fd7fff8edef31eafdaa5b08f6a2b WatchSource:0}: Error finding container bf6430c19748fba8b53973c655bfd1d0f369fd7fff8edef31eafdaa5b08f6a2b: Status 404 returned error can't find the container with id bf6430c19748fba8b53973c655bfd1d0f369fd7fff8edef31eafdaa5b08f6a2b Jun 08 22:02:09.355491 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:09.355457 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:09.357802 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:09.357784 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:09.411147 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:09.411120 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:02:09.550286 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:09.550254 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 22:02:09.553324 ip-10-0-138-88 kubenswrapper[2549]: W0608 22:02:09.553302 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd52a9ae5_b53f_4ec5_bbed_df98d7ffa437.slice/crio-58f992d51d1528e9955aeee2e178ec8322d667417b10cb0f43a8dcd7f1e31c67 WatchSource:0}: Error finding container 58f992d51d1528e9955aeee2e178ec8322d667417b10cb0f43a8dcd7f1e31c67: Status 404 returned error can't find the container with id 58f992d51d1528e9955aeee2e178ec8322d667417b10cb0f43a8dcd7f1e31c67 Jun 08 22:02:09.834096 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:09.834000 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437","Type":"ContainerStarted","Data":"58f992d51d1528e9955aeee2e178ec8322d667417b10cb0f43a8dcd7f1e31c67"} Jun 08 22:02:09.836617 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:09.836590 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-blqfm" event={"ID":"7a600274-2930-4a53-a063-6442a3d01484","Type":"ContainerStarted","Data":"18ef2a649858ab73f7cd662a315a2f249ae7be0d84306ab492f6afe410b1acb0"} Jun 08 22:02:09.836742 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:09.836639 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-blqfm" event={"ID":"7a600274-2930-4a53-a063-6442a3d01484","Type":"ContainerStarted","Data":"3070ff76bf43e7c42ff98e732e305b6c13eb5acbc055e7b4226c3e65ba5dc173"} Jun 08 22:02:09.837826 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:09.837801 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" event={"ID":"e8c22265-f320-4b35-ab31-eee221f493b9","Type":"ContainerStarted","Data":"bf6430c19748fba8b53973c655bfd1d0f369fd7fff8edef31eafdaa5b08f6a2b"} Jun 08 22:02:09.892683 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:09.892631 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-blqfm" podStartSLOduration=2.887352647 podStartE2EDuration="3.892613816s" totalImagesPullingTime="926.759949ms" totalInitContainerRuntime="78.50122ms" isStatefulPod=true podCreationTimestamp="2026-06-08 22:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:02:09.891351671 +0000 UTC m=+281.440238461" watchObservedRunningTime="2026-06-08 22:02:09.892613816 +0000 UTC m=+281.441500641" Jun 08 22:02:10.477899 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:02:10.477850 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ckthn" podUID="4d30ffba-5f7b-446b-baef-d8b7b9cd9d50" Jun 08 22:02:10.842884 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:10.842785 2549 generic.go:356] "Generic (PLEG): container finished" podID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerID="3d48b7d3674d925b41e5af6e84da46251dd7762fae1bbcf7424a5ebc2e0c79e2" exitCode=0 Jun 08 22:02:10.843324 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:10.842893 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437","Type":"ContainerDied","Data":"3d48b7d3674d925b41e5af6e84da46251dd7762fae1bbcf7424a5ebc2e0c79e2"} Jun 08 22:02:10.843324 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:10.842978 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ckthn" Jun 08 22:02:11.266348 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:11.266311 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-ps5jl"] Jun 08 22:02:11.269151 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:11.269125 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-ps5jl" Jun 08 22:02:11.272045 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:11.272020 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 08 22:02:11.272397 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:11.272376 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4nkz2\"" Jun 08 22:02:11.278073 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:11.278052 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-ps5jl"] Jun 08 22:02:11.378439 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:11.378330 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9whc5\" (UniqueName: \"kubernetes.io/projected/fe29fe6d-4d4b-4ba0-a1ca-f7393e8f20bb-kube-api-access-9whc5\") pod \"monitoring-plugin-76b68cc874-ps5jl\" (UID: \"fe29fe6d-4d4b-4ba0-a1ca-f7393e8f20bb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-ps5jl" Jun 08 22:02:11.378503 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:11.378484 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe29fe6d-4d4b-4ba0-a1ca-f7393e8f20bb-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-ps5jl\" (UID: \"fe29fe6d-4d4b-4ba0-a1ca-f7393e8f20bb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-ps5jl" Jun 08 22:02:11.478884 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:11.478864 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe29fe6d-4d4b-4ba0-a1ca-f7393e8f20bb-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-ps5jl\" (UID: \"fe29fe6d-4d4b-4ba0-a1ca-f7393e8f20bb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-ps5jl" Jun 08 22:02:11.478950 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:11.478915 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9whc5\" (UniqueName: \"kubernetes.io/projected/fe29fe6d-4d4b-4ba0-a1ca-f7393e8f20bb-kube-api-access-9whc5\") pod \"monitoring-plugin-76b68cc874-ps5jl\" (UID: \"fe29fe6d-4d4b-4ba0-a1ca-f7393e8f20bb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-ps5jl" Jun 08 22:02:11.481046 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:11.481021 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe29fe6d-4d4b-4ba0-a1ca-f7393e8f20bb-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-ps5jl\" (UID: \"fe29fe6d-4d4b-4ba0-a1ca-f7393e8f20bb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-ps5jl" Jun 08 22:02:11.488407 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:11.488381 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9whc5\" (UniqueName: \"kubernetes.io/projected/fe29fe6d-4d4b-4ba0-a1ca-f7393e8f20bb-kube-api-access-9whc5\") pod \"monitoring-plugin-76b68cc874-ps5jl\" (UID: \"fe29fe6d-4d4b-4ba0-a1ca-f7393e8f20bb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-ps5jl" Jun 08 22:02:11.580307 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:11.580281 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-ps5jl" Jun 08 22:02:11.718522 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:11.718487 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-ps5jl"] Jun 08 22:02:11.723295 ip-10-0-138-88 kubenswrapper[2549]: W0608 22:02:11.723268 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe29fe6d_4d4b_4ba0_a1ca_f7393e8f20bb.slice/crio-4a51ea148f58dfb64219263ba93753e5732e3cfc42af5437ff5a928b0511c46a WatchSource:0}: Error finding container 4a51ea148f58dfb64219263ba93753e5732e3cfc42af5437ff5a928b0511c46a: Status 404 returned error can't find the container with id 4a51ea148f58dfb64219263ba93753e5732e3cfc42af5437ff5a928b0511c46a Jun 08 22:02:11.847736 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:11.847642 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-ps5jl" event={"ID":"fe29fe6d-4d4b-4ba0-a1ca-f7393e8f20bb","Type":"ContainerStarted","Data":"4a51ea148f58dfb64219263ba93753e5732e3cfc42af5437ff5a928b0511c46a"} Jun 08 22:02:11.849558 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:11.849536 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" event={"ID":"e8c22265-f320-4b35-ab31-eee221f493b9","Type":"ContainerStarted","Data":"c9cdce5778033dfda7c66e67c451de7b38bb0b030d94926c402622f52cbcb099"} Jun 08 22:02:11.849660 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:11.849588 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" event={"ID":"e8c22265-f320-4b35-ab31-eee221f493b9","Type":"ContainerStarted","Data":"20ea5c692af31c2e8cf17505c6cfd8ae4209657adae2cdad533567b05890c37d"} Jun 08 22:02:11.849660 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:11.849615 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" event={"ID":"e8c22265-f320-4b35-ab31-eee221f493b9","Type":"ContainerStarted","Data":"9017fe08589164ae64e72b85f9b5a85d7b227f32a6c41a0b2359c4473ad303b6"} Jun 08 22:02:12.877239 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.877204 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 22:02:12.881708 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.881686 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:12.884545 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.884498 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fhk5b9c447e4b\"" Jun 08 22:02:12.884545 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.884522 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 22:02:12.884545 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.884538 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 22:02:12.884752 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.884524 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 22:02:12.884752 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.884497 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 22:02:12.884982 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.884965 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 22:02:12.885189 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.885152 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 22:02:12.885407 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.885389 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-nfrrb\"" Jun 08 22:02:12.885712 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.885694 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 22:02:12.885793 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.885771 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 22:02:12.885851 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.885808 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 22:02:12.885905 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.885811 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 22:02:12.886289 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.886099 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 22:02:12.886289 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.886154 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 22:02:12.886424 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.886398 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 22:02:12.895963 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.895698 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 22:02:12.899444 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.899413 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 22:02:12.900149 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.900126 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 22:02:12.995510 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.995371 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:12.995510 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.995437 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:12.995510 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.995468 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:12.995784 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.995516 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:12.995784 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.995543 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:12.995784 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.995566 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:12.995784 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.995588 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnpmg\" (UniqueName: \"kubernetes.io/projected/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-kube-api-access-jnpmg\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:12.995784 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.995626 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:12.995784 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.995655 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-config-out\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:12.995784 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.995681 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:12.995784 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.995756 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:12.996253 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.995804 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:12.996253 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.995833 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:12.996253 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.995858 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:12.996253 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.995908 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-config\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:12.996253 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.995934 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:12.996253 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.995967 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:12.996253 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.996010 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:12.996253 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.996035 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-web-config\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:12.996253 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:12.996059 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.097123 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.097096 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.097267 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.097153 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.097267 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.097197 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.097267 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.097222 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.097267 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.097240 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnpmg\" (UniqueName: \"kubernetes.io/projected/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-kube-api-access-jnpmg\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.097504 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.097292 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.097504 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.097322 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-config-out\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.097504 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.097348 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.097504 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.097376 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.097504 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.097400 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.097504 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.097425 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.097504 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.097447 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.097504 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.097490 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-config\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.097889 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.097513 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.097889 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.097561 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.097889 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.097627 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.097889 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.097653 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-web-config\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.097889 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.097674 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.097889 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.097728 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.097889 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.097764 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.098582 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.098386 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.099877 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.099342 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.099877 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.099396 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.099877 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.099766 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.100146 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.099881 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.100982 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.100950 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.101313 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.101288 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.101458 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.101434 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.101587 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.101561 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.101831 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.101811 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.103119 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.103069 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-config\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.103335 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.103279 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.104611 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.104546 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.104611 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.104560 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-config-out\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.104773 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.104725 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-web-config\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.104830 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.104775 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.105618 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.105591 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.105839 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.105820 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.106514 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.106492 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.108311 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.108278 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnpmg\" (UniqueName: \"kubernetes.io/projected/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-kube-api-access-jnpmg\") pod \"prometheus-k8s-0\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.195839 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.195803 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:13.408962 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.408928 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 22:02:13.413708 ip-10-0-138-88 kubenswrapper[2549]: W0608 22:02:13.413680 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae7eea8e_62c5_4994_8bbd_06a073dbc0bb.slice/crio-9f51bf4bc357e5399a85fa63d2029357f04644d1c3c0ccdaa6d3a64b87432f4d WatchSource:0}: Error finding container 9f51bf4bc357e5399a85fa63d2029357f04644d1c3c0ccdaa6d3a64b87432f4d: Status 404 returned error can't find the container with id 9f51bf4bc357e5399a85fa63d2029357f04644d1c3c0ccdaa6d3a64b87432f4d Jun 08 22:02:13.803990 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.803889 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls\") pod \"dns-default-ckthn\" (UID: \"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50\") " pod="openshift-dns/dns-default-ckthn" Jun 08 22:02:13.806292 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.806268 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d30ffba-5f7b-446b-baef-d8b7b9cd9d50-metrics-tls\") pod \"dns-default-ckthn\" (UID: \"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50\") " pod="openshift-dns/dns-default-ckthn" Jun 08 22:02:13.847190 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.847137 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tq2ww\"" Jun 08 22:02:13.854015 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.853981 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ckthn" Jun 08 22:02:13.862607 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.862584 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437","Type":"ContainerStarted","Data":"66b9fbf59e5f8f6f08e1769de354b6d73e3be7f7597a8c63e0257a205f065d7e"} Jun 08 22:02:13.862700 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.862658 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437","Type":"ContainerStarted","Data":"dbca4565a2c49b14c709e1b9f16c5286fb8ec5cf6db23d96457eb31aed360c36"} Jun 08 22:02:13.862757 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.862705 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437","Type":"ContainerStarted","Data":"2b40b031838c92443691a599ce471dc5478d8bb6e61ddff23a2cede3d01add76"} Jun 08 22:02:13.862757 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.862747 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437","Type":"ContainerStarted","Data":"c6337089b2776254773c6a41007fdc913d83a246cac89f3bae6e1b54ad4384a4"} Jun 08 22:02:13.862883 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.862787 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437","Type":"ContainerStarted","Data":"efae2588c9a5ba05163de96a676fafc24b8e39cf68c7803d3defb2d222dd97ff"} Jun 08 22:02:13.862883 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.862827 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437","Type":"ContainerStarted","Data":"f0c5770bb491cb99b727a65a60315b9bfc2f2d5636b10c1b2297aec24a2f0250"} Jun 08 22:02:13.866338 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.866302 2549 generic.go:356] "Generic (PLEG): container finished" podID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerID="f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7" exitCode=0 Jun 08 22:02:13.866447 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.866382 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb","Type":"ContainerDied","Data":"f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7"} Jun 08 22:02:13.866503 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.866454 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb","Type":"ContainerStarted","Data":"9f51bf4bc357e5399a85fa63d2029357f04644d1c3c0ccdaa6d3a64b87432f4d"} Jun 08 22:02:13.867944 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.867909 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-ps5jl" event={"ID":"fe29fe6d-4d4b-4ba0-a1ca-f7393e8f20bb","Type":"ContainerStarted","Data":"3e0df05e67cf6fcdb75c55dab43ea759aaf089e0a973c7b747e60fde3d402dbf"} Jun 08 22:02:13.868107 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.868089 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-ps5jl" Jun 08 22:02:13.871572 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.871552 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" event={"ID":"e8c22265-f320-4b35-ab31-eee221f493b9","Type":"ContainerStarted","Data":"cbe779202cbb815397260a06a3f5a82b11808ba2fc9a2e1c05db82a05d92aee9"} Jun 08 22:02:13.871670 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.871611 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" event={"ID":"e8c22265-f320-4b35-ab31-eee221f493b9","Type":"ContainerStarted","Data":"b2e80ecdfb3c69e8a175ed4a6b61cf04972af36c66a2efce6e651ad977c94404"} Jun 08 22:02:13.871670 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.871655 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" event={"ID":"e8c22265-f320-4b35-ab31-eee221f493b9","Type":"ContainerStarted","Data":"5b5a8d1b850478b2b49461b63015180d29a548c2637eeb12b7511f514ec13f1a"} Jun 08 22:02:13.871781 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.871717 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:13.873792 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.873774 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-ps5jl" Jun 08 22:02:13.899615 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.899527 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.023690472 podStartE2EDuration="6.899503537s" totalImagesPullingTime="2.856412163s" totalInitContainerRuntime="19.400902ms" isStatefulPod=false podCreationTimestamp="2026-06-08 22:02:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:02:13.894579264 +0000 UTC m=+285.443466065" watchObservedRunningTime="2026-06-08 22:02:13.899503537 +0000 UTC m=+285.448390349" Jun 08 22:02:13.960420 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.960358 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" podStartSLOduration=2.016376776 podStartE2EDuration="5.960337254s" totalImagesPullingTime="3.943960478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:02:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:02:13.95913362 +0000 UTC m=+285.508020419" watchObservedRunningTime="2026-06-08 22:02:13.960337254 +0000 UTC m=+285.509224043" Jun 08 22:02:13.979033 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:13.978979 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-ps5jl" podStartSLOduration=1.451226754 podStartE2EDuration="2.97896325s" totalImagesPullingTime="1.527736496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:02:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:02:13.977540536 +0000 UTC m=+285.526427327" watchObservedRunningTime="2026-06-08 22:02:13.97896325 +0000 UTC m=+285.527850078" Jun 08 22:02:14.004982 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:14.004931 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ckthn"] Jun 08 22:02:14.007635 ip-10-0-138-88 kubenswrapper[2549]: W0608 22:02:14.007604 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d30ffba_5f7b_446b_baef_d8b7b9cd9d50.slice/crio-b10fa9ebdcf36b426a0d79151b14bf82817ee63340144898411a3bca5d62d0a1 WatchSource:0}: Error finding container b10fa9ebdcf36b426a0d79151b14bf82817ee63340144898411a3bca5d62d0a1: Status 404 returned error can't find the container with id b10fa9ebdcf36b426a0d79151b14bf82817ee63340144898411a3bca5d62d0a1 Jun 08 22:02:14.878232 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:14.878197 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ckthn" event={"ID":"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50","Type":"ContainerStarted","Data":"b10fa9ebdcf36b426a0d79151b14bf82817ee63340144898411a3bca5d62d0a1"} Jun 08 22:02:15.884719 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:15.884621 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ckthn" event={"ID":"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50","Type":"ContainerStarted","Data":"d6dd24cf05df3010c705a448408e84725daf90c698468ec8551f2de17c888398"} Jun 08 22:02:15.884719 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:15.884679 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ckthn" event={"ID":"4d30ffba-5f7b-446b-baef-d8b7b9cd9d50","Type":"ContainerStarted","Data":"7bdb000c68c5b83004743f3cc23e9513d6ce43d69bebbbeab6e607753ea911c7"} Jun 08 22:02:15.885183 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:15.884928 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ckthn" Jun 08 22:02:17.898609 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:17.898514 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb","Type":"ContainerStarted","Data":"3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e"} Jun 08 22:02:17.898961 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:17.898631 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb","Type":"ContainerStarted","Data":"828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656"} Jun 08 22:02:17.898961 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:17.898678 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb","Type":"ContainerStarted","Data":"b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f"} Jun 08 22:02:17.898961 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:17.898714 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb","Type":"ContainerStarted","Data":"f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c"} Jun 08 22:02:17.898961 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:17.898749 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb","Type":"ContainerStarted","Data":"fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776"} Jun 08 22:02:17.898961 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:17.898790 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb","Type":"ContainerStarted","Data":"1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd"} Jun 08 22:02:17.946904 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:17.946332 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ckthn" podStartSLOduration=253.431684899 podStartE2EDuration="4m14.946311632s" totalImagesPullingTime="1.514626733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:02:15.90691585 +0000 UTC m=+287.455802639" watchObservedRunningTime="2026-06-08 22:02:17.946311632 +0000 UTC m=+289.495198424" Jun 08 22:02:17.948294 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:17.947400 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.592820781 podStartE2EDuration="5.947383614s" totalImagesPullingTime="3.332148673s" totalInitContainerRuntime="22.41416ms" isStatefulPod=false podCreationTimestamp="2026-06-08 22:02:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:02:17.944874176 +0000 UTC m=+289.493760966" watchObservedRunningTime="2026-06-08 22:02:17.947383614 +0000 UTC m=+289.496270454" Jun 08 22:02:18.196246 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:18.196212 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:19.884429 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:19.884401 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-795c5b9978-5zpj4" Jun 08 22:02:19.993024 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:19.992997 2549 scope.go:117] "RemoveContainer" containerID="5a8e7d94d0da30357756085720987b3ec32e988238d4f6074dc34e22a2917921" Jun 08 22:02:20.915572 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:20.915547 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rzp7c_ecc09a2e-0137-45ae-9982-e8f714b875c5/console-operator/2.log" Jun 08 22:02:20.916041 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:20.915629 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" event={"ID":"ecc09a2e-0137-45ae-9982-e8f714b875c5","Type":"ContainerStarted","Data":"920c7031f2746513ddc92482a199f989a45c2bf10499eb00a32403178bd0dbc3"} Jun 08 22:02:20.916109 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:20.916078 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" Jun 08 22:02:20.921231 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:20.921208 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" Jun 08 22:02:20.997215 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:20.997151 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-rzp7c" podStartSLOduration=55.132044826 podStartE2EDuration="56.997129771s" totalImagesPullingTime="1.865084945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:01:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:02:20.95682751 +0000 UTC m=+292.505714319" watchObservedRunningTime="2026-06-08 22:02:20.997129771 +0000 UTC m=+292.546016560" Jun 08 22:02:21.994700 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:02:21.994667 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4pmzz" podUID="12b6a387-cd80-4157-8c91-00fdb3ee3676" Jun 08 22:02:25.891380 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:25.891348 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ckthn" Jun 08 22:02:28.927257 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:28.927224 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rzp7c_ecc09a2e-0137-45ae-9982-e8f714b875c5/console-operator/2.log" Jun 08 22:02:28.927713 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:28.927275 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rzp7c_ecc09a2e-0137-45ae-9982-e8f714b875c5/console-operator/2.log" Jun 08 22:02:28.937728 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:28.937703 2549 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 22:02:35.993537 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:35.993501 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 22:02:53.468295 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:53.468250 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76bc7cf865-5m4b9_be1775e2-0996-430c-bc0f-0ad7f5faeedb/router/0.log" Jun 08 22:02:53.481062 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:02:53.481036 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mn57q_fdd228a4-64ed-47a7-95c8-2144b2afafcd/serve-healthcheck-canary/0.log" Jun 08 22:03:13.196868 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:13.196831 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:13.212662 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:13.212635 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:14.141120 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:14.141090 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:26.920972 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:26.920885 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 22:03:26.921400 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:26.921154 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="alertmanager" containerID="cri-o://f0c5770bb491cb99b727a65a60315b9bfc2f2d5636b10c1b2297aec24a2f0250" gracePeriod=120 Jun 08 22:03:26.921400 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:26.921244 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="kube-rbac-proxy-metric" containerID="cri-o://dbca4565a2c49b14c709e1b9f16c5286fb8ec5cf6db23d96457eb31aed360c36" gracePeriod=120 Jun 08 22:03:26.921400 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:26.921305 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="prom-label-proxy" containerID="cri-o://66b9fbf59e5f8f6f08e1769de354b6d73e3be7f7597a8c63e0257a205f065d7e" gracePeriod=120 Jun 08 22:03:26.921400 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:26.921327 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="config-reloader" containerID="cri-o://efae2588c9a5ba05163de96a676fafc24b8e39cf68c7803d3defb2d222dd97ff" gracePeriod=120 Jun 08 22:03:26.921400 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:26.921274 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="kube-rbac-proxy-web" containerID="cri-o://c6337089b2776254773c6a41007fdc913d83a246cac89f3bae6e1b54ad4384a4" gracePeriod=120 Jun 08 22:03:26.921400 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:26.921260 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="kube-rbac-proxy" containerID="cri-o://2b40b031838c92443691a599ce471dc5478d8bb6e61ddff23a2cede3d01add76" gracePeriod=120 Jun 08 22:03:27.182051 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:27.181960 2549 generic.go:356] "Generic (PLEG): container finished" podID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerID="66b9fbf59e5f8f6f08e1769de354b6d73e3be7f7597a8c63e0257a205f065d7e" exitCode=0 Jun 08 22:03:27.182051 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:27.181985 2549 generic.go:356] "Generic (PLEG): container finished" podID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerID="dbca4565a2c49b14c709e1b9f16c5286fb8ec5cf6db23d96457eb31aed360c36" exitCode=0 Jun 08 22:03:27.182051 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:27.181993 2549 generic.go:356] "Generic (PLEG): container finished" podID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerID="2b40b031838c92443691a599ce471dc5478d8bb6e61ddff23a2cede3d01add76" exitCode=0 Jun 08 22:03:27.182051 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:27.181999 2549 generic.go:356] "Generic (PLEG): container finished" podID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerID="efae2588c9a5ba05163de96a676fafc24b8e39cf68c7803d3defb2d222dd97ff" exitCode=0 Jun 08 22:03:27.182051 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:27.182015 2549 generic.go:356] "Generic (PLEG): container finished" podID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerID="f0c5770bb491cb99b727a65a60315b9bfc2f2d5636b10c1b2297aec24a2f0250" exitCode=0 Jun 08 22:03:27.182051 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:27.182040 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437","Type":"ContainerDied","Data":"66b9fbf59e5f8f6f08e1769de354b6d73e3be7f7597a8c63e0257a205f065d7e"} Jun 08 22:03:27.182370 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:27.182112 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437","Type":"ContainerDied","Data":"dbca4565a2c49b14c709e1b9f16c5286fb8ec5cf6db23d96457eb31aed360c36"} Jun 08 22:03:27.182370 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:27.182144 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437","Type":"ContainerDied","Data":"2b40b031838c92443691a599ce471dc5478d8bb6e61ddff23a2cede3d01add76"} Jun 08 22:03:27.182370 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:27.182183 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437","Type":"ContainerDied","Data":"efae2588c9a5ba05163de96a676fafc24b8e39cf68c7803d3defb2d222dd97ff"} Jun 08 22:03:27.182370 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:27.182208 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437","Type":"ContainerDied","Data":"f0c5770bb491cb99b727a65a60315b9bfc2f2d5636b10c1b2297aec24a2f0250"} Jun 08 22:03:28.174940 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.174916 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.195820 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.195780 2549 generic.go:356] "Generic (PLEG): container finished" podID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerID="c6337089b2776254773c6a41007fdc913d83a246cac89f3bae6e1b54ad4384a4" exitCode=0 Jun 08 22:03:28.195820 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.195825 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437","Type":"ContainerDied","Data":"c6337089b2776254773c6a41007fdc913d83a246cac89f3bae6e1b54ad4384a4"} Jun 08 22:03:28.196089 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.195886 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.196089 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.195948 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437","Type":"ContainerDied","Data":"58f992d51d1528e9955aeee2e178ec8322d667417b10cb0f43a8dcd7f1e31c67"} Jun 08 22:03:28.196089 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.195998 2549 scope.go:117] "RemoveContainer" containerID="66b9fbf59e5f8f6f08e1769de354b6d73e3be7f7597a8c63e0257a205f065d7e" Jun 08 22:03:28.206445 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.205925 2549 scope.go:117] "RemoveContainer" containerID="dbca4565a2c49b14c709e1b9f16c5286fb8ec5cf6db23d96457eb31aed360c36" Jun 08 22:03:28.218494 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.218463 2549 scope.go:117] "RemoveContainer" containerID="2b40b031838c92443691a599ce471dc5478d8bb6e61ddff23a2cede3d01add76" Jun 08 22:03:28.227342 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.227318 2549 scope.go:117] "RemoveContainer" containerID="c6337089b2776254773c6a41007fdc913d83a246cac89f3bae6e1b54ad4384a4" Jun 08 22:03:28.235410 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.235385 2549 scope.go:117] "RemoveContainer" containerID="efae2588c9a5ba05163de96a676fafc24b8e39cf68c7803d3defb2d222dd97ff" Jun 08 22:03:28.243036 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.243017 2549 scope.go:117] "RemoveContainer" containerID="f0c5770bb491cb99b727a65a60315b9bfc2f2d5636b10c1b2297aec24a2f0250" Jun 08 22:03:28.250582 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.250564 2549 scope.go:117] "RemoveContainer" containerID="3d48b7d3674d925b41e5af6e84da46251dd7762fae1bbcf7424a5ebc2e0c79e2" Jun 08 22:03:28.257776 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.257756 2549 scope.go:117] "RemoveContainer" containerID="66b9fbf59e5f8f6f08e1769de354b6d73e3be7f7597a8c63e0257a205f065d7e" Jun 08 22:03:28.258071 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:03:28.258049 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66b9fbf59e5f8f6f08e1769de354b6d73e3be7f7597a8c63e0257a205f065d7e\": container with ID starting with 66b9fbf59e5f8f6f08e1769de354b6d73e3be7f7597a8c63e0257a205f065d7e not found: ID does not exist" containerID="66b9fbf59e5f8f6f08e1769de354b6d73e3be7f7597a8c63e0257a205f065d7e" Jun 08 22:03:28.258120 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.258082 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66b9fbf59e5f8f6f08e1769de354b6d73e3be7f7597a8c63e0257a205f065d7e"} err="failed to get container status \"66b9fbf59e5f8f6f08e1769de354b6d73e3be7f7597a8c63e0257a205f065d7e\": rpc error: code = NotFound desc = could not find container \"66b9fbf59e5f8f6f08e1769de354b6d73e3be7f7597a8c63e0257a205f065d7e\": container with ID starting with 66b9fbf59e5f8f6f08e1769de354b6d73e3be7f7597a8c63e0257a205f065d7e not found: ID does not exist" Jun 08 22:03:28.258181 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.258119 2549 scope.go:117] "RemoveContainer" containerID="dbca4565a2c49b14c709e1b9f16c5286fb8ec5cf6db23d96457eb31aed360c36" Jun 08 22:03:28.258381 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:03:28.258363 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbca4565a2c49b14c709e1b9f16c5286fb8ec5cf6db23d96457eb31aed360c36\": container with ID starting with dbca4565a2c49b14c709e1b9f16c5286fb8ec5cf6db23d96457eb31aed360c36 not found: ID does not exist" containerID="dbca4565a2c49b14c709e1b9f16c5286fb8ec5cf6db23d96457eb31aed360c36" Jun 08 22:03:28.258451 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.258391 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbca4565a2c49b14c709e1b9f16c5286fb8ec5cf6db23d96457eb31aed360c36"} err="failed to get container status \"dbca4565a2c49b14c709e1b9f16c5286fb8ec5cf6db23d96457eb31aed360c36\": rpc error: code = NotFound desc = could not find container \"dbca4565a2c49b14c709e1b9f16c5286fb8ec5cf6db23d96457eb31aed360c36\": container with ID starting with dbca4565a2c49b14c709e1b9f16c5286fb8ec5cf6db23d96457eb31aed360c36 not found: ID does not exist" Jun 08 22:03:28.258451 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.258414 2549 scope.go:117] "RemoveContainer" containerID="2b40b031838c92443691a599ce471dc5478d8bb6e61ddff23a2cede3d01add76" Jun 08 22:03:28.258640 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:03:28.258624 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b40b031838c92443691a599ce471dc5478d8bb6e61ddff23a2cede3d01add76\": container with ID starting with 2b40b031838c92443691a599ce471dc5478d8bb6e61ddff23a2cede3d01add76 not found: ID does not exist" containerID="2b40b031838c92443691a599ce471dc5478d8bb6e61ddff23a2cede3d01add76" Jun 08 22:03:28.258682 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.258647 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b40b031838c92443691a599ce471dc5478d8bb6e61ddff23a2cede3d01add76"} err="failed to get container status \"2b40b031838c92443691a599ce471dc5478d8bb6e61ddff23a2cede3d01add76\": rpc error: code = NotFound desc = could not find container \"2b40b031838c92443691a599ce471dc5478d8bb6e61ddff23a2cede3d01add76\": container with ID starting with 2b40b031838c92443691a599ce471dc5478d8bb6e61ddff23a2cede3d01add76 not found: ID does not exist" Jun 08 22:03:28.258682 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.258661 2549 scope.go:117] "RemoveContainer" containerID="c6337089b2776254773c6a41007fdc913d83a246cac89f3bae6e1b54ad4384a4" Jun 08 22:03:28.258846 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:03:28.258831 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6337089b2776254773c6a41007fdc913d83a246cac89f3bae6e1b54ad4384a4\": container with ID starting with c6337089b2776254773c6a41007fdc913d83a246cac89f3bae6e1b54ad4384a4 not found: ID does not exist" containerID="c6337089b2776254773c6a41007fdc913d83a246cac89f3bae6e1b54ad4384a4" Jun 08 22:03:28.258884 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.258850 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6337089b2776254773c6a41007fdc913d83a246cac89f3bae6e1b54ad4384a4"} err="failed to get container status \"c6337089b2776254773c6a41007fdc913d83a246cac89f3bae6e1b54ad4384a4\": rpc error: code = NotFound desc = could not find container \"c6337089b2776254773c6a41007fdc913d83a246cac89f3bae6e1b54ad4384a4\": container with ID starting with c6337089b2776254773c6a41007fdc913d83a246cac89f3bae6e1b54ad4384a4 not found: ID does not exist" Jun 08 22:03:28.258884 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.258863 2549 scope.go:117] "RemoveContainer" containerID="efae2588c9a5ba05163de96a676fafc24b8e39cf68c7803d3defb2d222dd97ff" Jun 08 22:03:28.259091 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:03:28.259075 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efae2588c9a5ba05163de96a676fafc24b8e39cf68c7803d3defb2d222dd97ff\": container with ID starting with efae2588c9a5ba05163de96a676fafc24b8e39cf68c7803d3defb2d222dd97ff not found: ID does not exist" containerID="efae2588c9a5ba05163de96a676fafc24b8e39cf68c7803d3defb2d222dd97ff" Jun 08 22:03:28.259154 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.259098 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efae2588c9a5ba05163de96a676fafc24b8e39cf68c7803d3defb2d222dd97ff"} err="failed to get container status \"efae2588c9a5ba05163de96a676fafc24b8e39cf68c7803d3defb2d222dd97ff\": rpc error: code = NotFound desc = could not find container \"efae2588c9a5ba05163de96a676fafc24b8e39cf68c7803d3defb2d222dd97ff\": container with ID starting with efae2588c9a5ba05163de96a676fafc24b8e39cf68c7803d3defb2d222dd97ff not found: ID does not exist" Jun 08 22:03:28.259154 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.259117 2549 scope.go:117] "RemoveContainer" containerID="f0c5770bb491cb99b727a65a60315b9bfc2f2d5636b10c1b2297aec24a2f0250" Jun 08 22:03:28.259388 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:03:28.259373 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0c5770bb491cb99b727a65a60315b9bfc2f2d5636b10c1b2297aec24a2f0250\": container with ID starting with f0c5770bb491cb99b727a65a60315b9bfc2f2d5636b10c1b2297aec24a2f0250 not found: ID does not exist" containerID="f0c5770bb491cb99b727a65a60315b9bfc2f2d5636b10c1b2297aec24a2f0250" Jun 08 22:03:28.259426 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.259392 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0c5770bb491cb99b727a65a60315b9bfc2f2d5636b10c1b2297aec24a2f0250"} err="failed to get container status \"f0c5770bb491cb99b727a65a60315b9bfc2f2d5636b10c1b2297aec24a2f0250\": rpc error: code = NotFound desc = could not find container \"f0c5770bb491cb99b727a65a60315b9bfc2f2d5636b10c1b2297aec24a2f0250\": container with ID starting with f0c5770bb491cb99b727a65a60315b9bfc2f2d5636b10c1b2297aec24a2f0250 not found: ID does not exist" Jun 08 22:03:28.259426 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.259405 2549 scope.go:117] "RemoveContainer" containerID="3d48b7d3674d925b41e5af6e84da46251dd7762fae1bbcf7424a5ebc2e0c79e2" Jun 08 22:03:28.259595 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:03:28.259578 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d48b7d3674d925b41e5af6e84da46251dd7762fae1bbcf7424a5ebc2e0c79e2\": container with ID starting with 3d48b7d3674d925b41e5af6e84da46251dd7762fae1bbcf7424a5ebc2e0c79e2 not found: ID does not exist" containerID="3d48b7d3674d925b41e5af6e84da46251dd7762fae1bbcf7424a5ebc2e0c79e2" Jun 08 22:03:28.259643 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.259601 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d48b7d3674d925b41e5af6e84da46251dd7762fae1bbcf7424a5ebc2e0c79e2"} err="failed to get container status \"3d48b7d3674d925b41e5af6e84da46251dd7762fae1bbcf7424a5ebc2e0c79e2\": rpc error: code = NotFound desc = could not find container \"3d48b7d3674d925b41e5af6e84da46251dd7762fae1bbcf7424a5ebc2e0c79e2\": container with ID starting with 3d48b7d3674d925b41e5af6e84da46251dd7762fae1bbcf7424a5ebc2e0c79e2 not found: ID does not exist" Jun 08 22:03:28.285094 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.285003 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-kube-rbac-proxy-web\") pod \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " Jun 08 22:03:28.285094 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.285048 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-config-volume\") pod \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " Jun 08 22:03:28.285094 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.285089 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-tls-assets\") pod \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " Jun 08 22:03:28.285365 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.285135 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-main-tls\") pod \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " Jun 08 22:03:28.285365 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.285183 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-web-config\") pod \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " Jun 08 22:03:28.285365 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.285208 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-metrics-client-ca\") pod \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " Jun 08 22:03:28.285365 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.285238 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxvfz\" (UniqueName: \"kubernetes.io/projected/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-kube-api-access-pxvfz\") pod \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " Jun 08 22:03:28.285365 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.285270 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " Jun 08 22:03:28.285365 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.285306 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-kube-rbac-proxy\") pod \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " Jun 08 22:03:28.285365 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.285346 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-alertmanager-trusted-ca-bundle\") pod \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " Jun 08 22:03:28.285683 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.285386 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-alertmanager-main-db\") pod \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " Jun 08 22:03:28.285683 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.285412 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-config-out\") pod \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " Jun 08 22:03:28.285683 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.285443 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-cluster-tls-config\") pod \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\" (UID: \"d52a9ae5-b53f-4ec5-bbed-df98d7ffa437\") " Jun 08 22:03:28.285915 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.285882 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" (UID: "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:03:28.286065 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.286042 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" (UID: "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:03:28.286285 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.286257 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" (UID: "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 22:03:28.288367 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.288315 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" (UID: "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:03:28.288671 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.288644 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-config-volume" (OuterVolumeSpecName: "config-volume") pod "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" (UID: "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:03:28.288882 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.288856 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" (UID: "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:03:28.289126 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.289091 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" (UID: "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:03:28.289126 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.289100 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" (UID: "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 22:03:28.289303 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.289186 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-kube-api-access-pxvfz" (OuterVolumeSpecName: "kube-api-access-pxvfz") pod "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" (UID: "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437"). InnerVolumeSpecName "kube-api-access-pxvfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 22:03:28.289381 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.289363 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" (UID: "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:03:28.289821 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.289807 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-config-out" (OuterVolumeSpecName: "config-out") pod "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" (UID: "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 22:03:28.293299 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.293149 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" (UID: "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:03:28.299176 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.299133 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-web-config" (OuterVolumeSpecName: "web-config") pod "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" (UID: "d52a9ae5-b53f-4ec5-bbed-df98d7ffa437"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:03:28.387188 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.387125 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:28.387188 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.387186 2549 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-config-volume\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:28.387421 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.387202 2549 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-tls-assets\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:28.387421 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.387215 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-main-tls\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:28.387421 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.387227 2549 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-web-config\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:28.387421 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.387240 2549 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-metrics-client-ca\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:28.387421 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.387250 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxvfz\" (UniqueName: \"kubernetes.io/projected/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-kube-api-access-pxvfz\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:28.387421 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.387262 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:28.387421 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.387276 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:28.387421 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.387289 2549 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:28.387421 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.387302 2549 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-alertmanager-main-db\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:28.387421 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.387312 2549 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-config-out\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:28.387421 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.387327 2549 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437-cluster-tls-config\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:28.522848 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.522812 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 22:03:28.527353 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.527322 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 22:03:28.554170 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.554070 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 22:03:28.554483 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.554465 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="prom-label-proxy" Jun 08 22:03:28.554559 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.554486 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="prom-label-proxy" Jun 08 22:03:28.554559 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.554510 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="kube-rbac-proxy" Jun 08 22:03:28.554559 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.554519 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="kube-rbac-proxy" Jun 08 22:03:28.554559 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.554537 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="kube-rbac-proxy-web" Jun 08 22:03:28.554559 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.554545 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="kube-rbac-proxy-web" Jun 08 22:03:28.554798 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.554559 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="alertmanager" Jun 08 22:03:28.554798 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.554568 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="alertmanager" Jun 08 22:03:28.554798 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.554578 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="kube-rbac-proxy-metric" Jun 08 22:03:28.554798 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.554587 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="kube-rbac-proxy-metric" Jun 08 22:03:28.554798 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.554596 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="config-reloader" Jun 08 22:03:28.554798 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.554604 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="config-reloader" Jun 08 22:03:28.554798 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.554618 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="init-config-reloader" Jun 08 22:03:28.554798 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.554626 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="init-config-reloader" Jun 08 22:03:28.554798 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.554702 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="kube-rbac-proxy" Jun 08 22:03:28.554798 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.554716 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="kube-rbac-proxy-web" Jun 08 22:03:28.554798 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.554724 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="alertmanager" Jun 08 22:03:28.554798 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.554733 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="kube-rbac-proxy-metric" Jun 08 22:03:28.554798 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.554744 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="config-reloader" Jun 08 22:03:28.554798 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.554751 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" containerName="prom-label-proxy" Jun 08 22:03:28.558574 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.558553 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.563083 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.563053 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 22:03:28.563200 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.563100 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 22:03:28.563200 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.563181 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 22:03:28.563332 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.563224 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 22:03:28.563332 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.563314 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 22:03:28.563432 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.563408 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-prjzl\"" Jun 08 22:03:28.563488 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.563419 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 22:03:28.563689 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.563666 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 22:03:28.563772 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.563759 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 22:03:28.568499 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.568480 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 22:03:28.573623 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.573601 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 22:03:28.689841 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.689804 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5cc03a8f-ecc8-41b2-9742-73a0baed7124-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.689841 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.689854 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5cc03a8f-ecc8-41b2-9742-73a0baed7124-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.690131 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.689918 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5cc03a8f-ecc8-41b2-9742-73a0baed7124-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.690131 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.689939 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5cc03a8f-ecc8-41b2-9742-73a0baed7124-config-volume\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.690131 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.689963 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5cc03a8f-ecc8-41b2-9742-73a0baed7124-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.690131 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.690033 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5cc03a8f-ecc8-41b2-9742-73a0baed7124-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.690131 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.690067 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5cc03a8f-ecc8-41b2-9742-73a0baed7124-config-out\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.690131 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.690119 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpq8b\" (UniqueName: \"kubernetes.io/projected/5cc03a8f-ecc8-41b2-9742-73a0baed7124-kube-api-access-dpq8b\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.690408 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.690191 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5cc03a8f-ecc8-41b2-9742-73a0baed7124-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.690408 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.690218 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5cc03a8f-ecc8-41b2-9742-73a0baed7124-web-config\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.690408 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.690242 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cc03a8f-ecc8-41b2-9742-73a0baed7124-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.690408 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.690304 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5cc03a8f-ecc8-41b2-9742-73a0baed7124-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.690408 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.690338 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5cc03a8f-ecc8-41b2-9742-73a0baed7124-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.791143 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.791106 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpq8b\" (UniqueName: \"kubernetes.io/projected/5cc03a8f-ecc8-41b2-9742-73a0baed7124-kube-api-access-dpq8b\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.791256 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.791153 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5cc03a8f-ecc8-41b2-9742-73a0baed7124-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.791256 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.791206 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5cc03a8f-ecc8-41b2-9742-73a0baed7124-web-config\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.791256 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.791231 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cc03a8f-ecc8-41b2-9742-73a0baed7124-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.791482 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.791263 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5cc03a8f-ecc8-41b2-9742-73a0baed7124-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.791482 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.791285 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5cc03a8f-ecc8-41b2-9742-73a0baed7124-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.791482 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.791326 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5cc03a8f-ecc8-41b2-9742-73a0baed7124-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.791482 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.791358 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5cc03a8f-ecc8-41b2-9742-73a0baed7124-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.791482 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.791408 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5cc03a8f-ecc8-41b2-9742-73a0baed7124-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.791482 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.791434 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5cc03a8f-ecc8-41b2-9742-73a0baed7124-config-volume\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.791482 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.791462 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5cc03a8f-ecc8-41b2-9742-73a0baed7124-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.791888 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.791506 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5cc03a8f-ecc8-41b2-9742-73a0baed7124-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.791888 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.791549 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5cc03a8f-ecc8-41b2-9742-73a0baed7124-config-out\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.791888 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.791756 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5cc03a8f-ecc8-41b2-9742-73a0baed7124-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.792130 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.792108 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5cc03a8f-ecc8-41b2-9742-73a0baed7124-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.792834 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.792812 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cc03a8f-ecc8-41b2-9742-73a0baed7124-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.794218 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.794192 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5cc03a8f-ecc8-41b2-9742-73a0baed7124-config-out\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.794510 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.794449 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5cc03a8f-ecc8-41b2-9742-73a0baed7124-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.794629 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.794538 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5cc03a8f-ecc8-41b2-9742-73a0baed7124-web-config\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.794629 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.794622 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5cc03a8f-ecc8-41b2-9742-73a0baed7124-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.794740 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.794630 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5cc03a8f-ecc8-41b2-9742-73a0baed7124-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.794740 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.794655 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5cc03a8f-ecc8-41b2-9742-73a0baed7124-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.795031 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.795011 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5cc03a8f-ecc8-41b2-9742-73a0baed7124-config-volume\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.795382 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.795358 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5cc03a8f-ecc8-41b2-9742-73a0baed7124-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.796089 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.796073 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5cc03a8f-ecc8-41b2-9742-73a0baed7124-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.800546 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.800527 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpq8b\" (UniqueName: \"kubernetes.io/projected/5cc03a8f-ecc8-41b2-9742-73a0baed7124-kube-api-access-dpq8b\") pod \"alertmanager-main-0\" (UID: \"5cc03a8f-ecc8-41b2-9742-73a0baed7124\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.868565 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.868480 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 22:03:28.998730 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:28.998698 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d52a9ae5-b53f-4ec5-bbed-df98d7ffa437" path="/var/lib/kubelet/pods/d52a9ae5-b53f-4ec5-bbed-df98d7ffa437/volumes" Jun 08 22:03:29.008383 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:29.008365 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 22:03:29.010476 ip-10-0-138-88 kubenswrapper[2549]: W0608 22:03:29.010451 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cc03a8f_ecc8_41b2_9742_73a0baed7124.slice/crio-e3697cfdbd992b6ee4ca7bdd51e8e30f615fbba9a633a1430f001b4c8e488ec9 WatchSource:0}: Error finding container e3697cfdbd992b6ee4ca7bdd51e8e30f615fbba9a633a1430f001b4c8e488ec9: Status 404 returned error can't find the container with id e3697cfdbd992b6ee4ca7bdd51e8e30f615fbba9a633a1430f001b4c8e488ec9 Jun 08 22:03:29.204630 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:29.204594 2549 generic.go:356] "Generic (PLEG): container finished" podID="5cc03a8f-ecc8-41b2-9742-73a0baed7124" containerID="81c25271910654bf99a1ed8ef0e763926dc0fe1ff66c404cfcbe055d92ea7689" exitCode=0 Jun 08 22:03:29.205021 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:29.204679 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5cc03a8f-ecc8-41b2-9742-73a0baed7124","Type":"ContainerDied","Data":"81c25271910654bf99a1ed8ef0e763926dc0fe1ff66c404cfcbe055d92ea7689"} Jun 08 22:03:29.205021 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:29.204746 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5cc03a8f-ecc8-41b2-9742-73a0baed7124","Type":"ContainerStarted","Data":"e3697cfdbd992b6ee4ca7bdd51e8e30f615fbba9a633a1430f001b4c8e488ec9"} Jun 08 22:03:30.211975 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:30.211940 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5cc03a8f-ecc8-41b2-9742-73a0baed7124","Type":"ContainerStarted","Data":"f42292b04dd97849df11c156e3335cae47d80dda82f4d1286038edd7ada93547"} Jun 08 22:03:30.212351 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:30.212049 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5cc03a8f-ecc8-41b2-9742-73a0baed7124","Type":"ContainerStarted","Data":"2bce861bf88a4af6fd1ddeecce76b50eaea843b8b28975bef42c1e37521152a8"} Jun 08 22:03:30.212351 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:30.212084 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5cc03a8f-ecc8-41b2-9742-73a0baed7124","Type":"ContainerStarted","Data":"f5a88807283fb1e905cfe70292e855255a25512a9d2f038db9ae0e58a6a32582"} Jun 08 22:03:30.212351 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:30.212111 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5cc03a8f-ecc8-41b2-9742-73a0baed7124","Type":"ContainerStarted","Data":"ce3cd80c6d487a7daa78f840038bc1db7474424d5bbd9fca39ead2be2aedaac2"} Jun 08 22:03:30.212351 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:30.212147 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5cc03a8f-ecc8-41b2-9742-73a0baed7124","Type":"ContainerStarted","Data":"934c5311f0944d488583dad446f3af83231bf5f7023e8880dbb3c1a8b7a129af"} Jun 08 22:03:30.212351 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:30.212195 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5cc03a8f-ecc8-41b2-9742-73a0baed7124","Type":"ContainerStarted","Data":"855fe0c04dc08ac566d6c7694ae82eedd61b97662f2788e2473fa17906241a98"} Jun 08 22:03:30.239772 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:30.239696 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.224754059 podStartE2EDuration="2.239679487s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.925428ms" isStatefulPod=false podCreationTimestamp="2026-06-08 22:03:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:03:30.237726989 +0000 UTC m=+361.786613788" watchObservedRunningTime="2026-06-08 22:03:30.239679487 +0000 UTC m=+361.788566276" Jun 08 22:03:31.284890 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.284855 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 22:03:31.285347 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.285141 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="kube-rbac-proxy" containerID="cri-o://828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656" gracePeriod=600 Jun 08 22:03:31.285347 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.285212 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="thanos-sidecar" containerID="cri-o://f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c" gracePeriod=600 Jun 08 22:03:31.285347 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.285242 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="kube-rbac-proxy-thanos" containerID="cri-o://3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e" gracePeriod=600 Jun 08 22:03:31.285347 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.285141 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="prometheus" containerID="cri-o://1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd" gracePeriod=600 Jun 08 22:03:31.285347 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.285212 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="config-reloader" containerID="cri-o://fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776" gracePeriod=600 Jun 08 22:03:31.285347 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.285217 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="kube-rbac-proxy-web" containerID="cri-o://b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f" gracePeriod=600 Jun 08 22:03:31.527716 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.527693 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:31.618053 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.617953 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-rulefiles-1\") pod \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " Jun 08 22:03:31.618053 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.617993 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " Jun 08 22:03:31.618053 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.618031 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-configmap-metrics-client-ca\") pod \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " Jun 08 22:03:31.618053 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.618051 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-db\") pod \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " Jun 08 22:03:31.618391 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.618071 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnpmg\" (UniqueName: \"kubernetes.io/projected/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-kube-api-access-jnpmg\") pod \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " Jun 08 22:03:31.618391 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.618134 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-config\") pod \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " Jun 08 22:03:31.618391 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.618180 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-trusted-ca-bundle\") pod \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " Jun 08 22:03:31.618391 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.618210 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-rulefiles-2\") pod \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " Jun 08 22:03:31.618391 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.618245 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-grpc-tls\") pod \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " Jun 08 22:03:31.618391 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.618287 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-metrics-client-certs\") pod \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " Jun 08 22:03:31.618391 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.618316 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-tls-assets\") pod \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " Jun 08 22:03:31.618391 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.618358 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-prometheus-k8s-tls\") pod \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " Jun 08 22:03:31.618767 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.618401 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " Jun 08 22:03:31.618767 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.618429 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-kube-rbac-proxy\") pod \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " Jun 08 22:03:31.618767 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.618453 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-config-out\") pod \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " Jun 08 22:03:31.618767 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.618484 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-web-config\") pod \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " Jun 08 22:03:31.618767 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.618478 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" (UID: "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:03:31.618767 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.618489 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" (UID: "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:03:31.618767 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.618518 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-configmap-kubelet-serving-ca-bundle\") pod \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " Jun 08 22:03:31.618767 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.618564 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-configmap-serving-certs-ca-bundle\") pod \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " Jun 08 22:03:31.618767 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.618587 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-rulefiles-0\") pod \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " Jun 08 22:03:31.618767 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.618617 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-thanos-prometheus-http-client-file\") pod \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\" (UID: \"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb\") " Jun 08 22:03:31.619290 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.618866 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" (UID: "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:03:31.619290 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.618881 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" (UID: "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:03:31.619681 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.619620 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" (UID: "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 22:03:31.620206 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.620178 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" (UID: "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:03:31.621028 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.621002 2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:31.621131 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.621034 2549 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-configmap-metrics-client-ca\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:31.621462 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.621411 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" (UID: "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:03:31.621577 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.621504 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" (UID: "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:03:31.621815 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.621658 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-kube-api-access-jnpmg" (OuterVolumeSpecName: "kube-api-access-jnpmg") pod "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" (UID: "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb"). InnerVolumeSpecName "kube-api-access-jnpmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 22:03:31.621815 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.621678 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" (UID: "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 22:03:31.621815 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.621713 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" (UID: "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:03:31.621815 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.621783 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" (UID: "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:03:31.622443 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.622415 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" (UID: "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:03:31.622566 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.622460 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" (UID: "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:03:31.622883 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.622858 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" (UID: "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:03:31.623097 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.623077 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" (UID: "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:03:31.623323 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.623303 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-config-out" (OuterVolumeSpecName: "config-out") pod "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" (UID: "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 22:03:31.623473 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.623456 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-config" (OuterVolumeSpecName: "config") pod "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" (UID: "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:03:31.623754 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.623733 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" (UID: "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:03:31.633024 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.633004 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-web-config" (OuterVolumeSpecName: "web-config") pod "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" (UID: "ae7eea8e-62c5-4994-8bbd-06a073dbc0bb"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:03:31.722117 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.722078 2549 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:31.722117 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.722112 2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-db\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:31.722117 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.722124 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnpmg\" (UniqueName: \"kubernetes.io/projected/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-kube-api-access-jnpmg\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:31.722381 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.722134 2549 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-config\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:31.722381 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.722144 2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:31.722381 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.722153 2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:31.722381 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.722195 2549 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-grpc-tls\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:31.722381 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.722204 2549 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-metrics-client-certs\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:31.722381 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.722214 2549 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-tls-assets\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:31.722381 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.722222 2549 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:31.722381 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.722231 2549 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:31.722381 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.722240 2549 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-secret-kube-rbac-proxy\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:31.722381 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.722248 2549 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-config-out\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:31.722381 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.722256 2549 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-web-config\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:31.722381 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.722264 2549 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:31.722381 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.722273 2549 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:31.722381 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.722284 2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:31.722381 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:31.722292 2549 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:03:32.224139 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.224104 2549 generic.go:356] "Generic (PLEG): container finished" podID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerID="3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e" exitCode=0 Jun 08 22:03:32.224139 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.224130 2549 generic.go:356] "Generic (PLEG): container finished" podID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerID="828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656" exitCode=0 Jun 08 22:03:32.224139 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.224139 2549 generic.go:356] "Generic (PLEG): container finished" podID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerID="b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f" exitCode=0 Jun 08 22:03:32.224139 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.224147 2549 generic.go:356] "Generic (PLEG): container finished" podID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerID="f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c" exitCode=0 Jun 08 22:03:32.224139 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.224171 2549 generic.go:356] "Generic (PLEG): container finished" podID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerID="fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776" exitCode=0 Jun 08 22:03:32.224537 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.224179 2549 generic.go:356] "Generic (PLEG): container finished" podID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerID="1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd" exitCode=0 Jun 08 22:03:32.224537 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.224180 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb","Type":"ContainerDied","Data":"3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e"} Jun 08 22:03:32.224537 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.224203 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.224537 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.224247 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb","Type":"ContainerDied","Data":"828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656"} Jun 08 22:03:32.224537 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.224276 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb","Type":"ContainerDied","Data":"b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f"} Jun 08 22:03:32.224537 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.224300 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb","Type":"ContainerDied","Data":"f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c"} Jun 08 22:03:32.224537 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.224311 2549 scope.go:117] "RemoveContainer" containerID="3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e" Jun 08 22:03:32.224537 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.224323 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb","Type":"ContainerDied","Data":"fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776"} Jun 08 22:03:32.224537 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.224349 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb","Type":"ContainerDied","Data":"1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd"} Jun 08 22:03:32.224537 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.224373 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae7eea8e-62c5-4994-8bbd-06a073dbc0bb","Type":"ContainerDied","Data":"9f51bf4bc357e5399a85fa63d2029357f04644d1c3c0ccdaa6d3a64b87432f4d"} Jun 08 22:03:32.232531 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.232511 2549 scope.go:117] "RemoveContainer" containerID="828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656" Jun 08 22:03:32.244912 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.244894 2549 scope.go:117] "RemoveContainer" containerID="b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f" Jun 08 22:03:32.252638 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.252595 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 22:03:32.252694 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.252669 2549 scope.go:117] "RemoveContainer" containerID="f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c" Jun 08 22:03:32.257923 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.257897 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 22:03:32.259973 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.259956 2549 scope.go:117] "RemoveContainer" containerID="fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776" Jun 08 22:03:32.266878 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.266860 2549 scope.go:117] "RemoveContainer" containerID="1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd" Jun 08 22:03:32.274329 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.274301 2549 scope.go:117] "RemoveContainer" containerID="f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7" Jun 08 22:03:32.281078 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.281061 2549 scope.go:117] "RemoveContainer" containerID="3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e" Jun 08 22:03:32.281355 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:03:32.281336 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e\": container with ID starting with 3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e not found: ID does not exist" containerID="3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e" Jun 08 22:03:32.281405 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.281365 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e"} err="failed to get container status \"3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e\": rpc error: code = NotFound desc = could not find container \"3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e\": container with ID starting with 3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e not found: ID does not exist" Jun 08 22:03:32.281405 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.281390 2549 scope.go:117] "RemoveContainer" containerID="828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656" Jun 08 22:03:32.281625 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:03:32.281609 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656\": container with ID starting with 828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656 not found: ID does not exist" containerID="828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656" Jun 08 22:03:32.281668 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.281628 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656"} err="failed to get container status \"828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656\": rpc error: code = NotFound desc = could not find container \"828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656\": container with ID starting with 828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656 not found: ID does not exist" Jun 08 22:03:32.281668 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.281640 2549 scope.go:117] "RemoveContainer" containerID="b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f" Jun 08 22:03:32.281851 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:03:32.281834 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f\": container with ID starting with b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f not found: ID does not exist" containerID="b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f" Jun 08 22:03:32.281896 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.281857 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f"} err="failed to get container status \"b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f\": rpc error: code = NotFound desc = could not find container \"b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f\": container with ID starting with b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f not found: ID does not exist" Jun 08 22:03:32.281896 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.281873 2549 scope.go:117] "RemoveContainer" containerID="f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c" Jun 08 22:03:32.282107 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:03:32.282089 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c\": container with ID starting with f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c not found: ID does not exist" containerID="f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c" Jun 08 22:03:32.282144 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.282112 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c"} err="failed to get container status \"f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c\": rpc error: code = NotFound desc = could not find container \"f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c\": container with ID starting with f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c not found: ID does not exist" Jun 08 22:03:32.282144 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.282125 2549 scope.go:117] "RemoveContainer" containerID="fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776" Jun 08 22:03:32.282339 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:03:32.282321 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776\": container with ID starting with fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776 not found: ID does not exist" containerID="fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776" Jun 08 22:03:32.282379 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.282345 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776"} err="failed to get container status \"fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776\": rpc error: code = NotFound desc = could not find container \"fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776\": container with ID starting with fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776 not found: ID does not exist" Jun 08 22:03:32.282379 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.282359 2549 scope.go:117] "RemoveContainer" containerID="1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd" Jun 08 22:03:32.282587 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:03:32.282574 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd\": container with ID starting with 1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd not found: ID does not exist" containerID="1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd" Jun 08 22:03:32.282622 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.282591 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd"} err="failed to get container status \"1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd\": rpc error: code = NotFound desc = could not find container \"1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd\": container with ID starting with 1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd not found: ID does not exist" Jun 08 22:03:32.282622 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.282602 2549 scope.go:117] "RemoveContainer" containerID="f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7" Jun 08 22:03:32.282793 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:03:32.282780 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7\": container with ID starting with f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7 not found: ID does not exist" containerID="f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7" Jun 08 22:03:32.282830 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.282797 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7"} err="failed to get container status \"f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7\": rpc error: code = NotFound desc = could not find container \"f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7\": container with ID starting with f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7 not found: ID does not exist" Jun 08 22:03:32.282830 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.282808 2549 scope.go:117] "RemoveContainer" containerID="3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e" Jun 08 22:03:32.283013 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.282997 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e"} err="failed to get container status \"3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e\": rpc error: code = NotFound desc = could not find container \"3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e\": container with ID starting with 3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e not found: ID does not exist" Jun 08 22:03:32.283013 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.283013 2549 scope.go:117] "RemoveContainer" containerID="828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656" Jun 08 22:03:32.283225 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.283208 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656"} err="failed to get container status \"828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656\": rpc error: code = NotFound desc = could not find container \"828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656\": container with ID starting with 828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656 not found: ID does not exist" Jun 08 22:03:32.283297 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.283224 2549 scope.go:117] "RemoveContainer" containerID="b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f" Jun 08 22:03:32.283408 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.283391 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f"} err="failed to get container status \"b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f\": rpc error: code = NotFound desc = could not find container \"b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f\": container with ID starting with b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f not found: ID does not exist" Jun 08 22:03:32.283464 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.283407 2549 scope.go:117] "RemoveContainer" containerID="f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c" Jun 08 22:03:32.283582 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.283567 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c"} err="failed to get container status \"f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c\": rpc error: code = NotFound desc = could not find container \"f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c\": container with ID starting with f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c not found: ID does not exist" Jun 08 22:03:32.283582 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.283581 2549 scope.go:117] "RemoveContainer" containerID="fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776" Jun 08 22:03:32.283823 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.283803 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776"} err="failed to get container status \"fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776\": rpc error: code = NotFound desc = could not find container \"fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776\": container with ID starting with fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776 not found: ID does not exist" Jun 08 22:03:32.283899 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.283823 2549 scope.go:117] "RemoveContainer" containerID="1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd" Jun 08 22:03:32.284154 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.284128 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd"} err="failed to get container status \"1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd\": rpc error: code = NotFound desc = could not find container \"1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd\": container with ID starting with 1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd not found: ID does not exist" Jun 08 22:03:32.284259 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.284191 2549 scope.go:117] "RemoveContainer" containerID="f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7" Jun 08 22:03:32.284547 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.284525 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7"} err="failed to get container status \"f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7\": rpc error: code = NotFound desc = could not find container \"f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7\": container with ID starting with f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7 not found: ID does not exist" Jun 08 22:03:32.284547 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.284546 2549 scope.go:117] "RemoveContainer" containerID="3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e" Jun 08 22:03:32.284837 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.284814 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e"} err="failed to get container status \"3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e\": rpc error: code = NotFound desc = could not find container \"3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e\": container with ID starting with 3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e not found: ID does not exist" Jun 08 22:03:32.284891 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.284839 2549 scope.go:117] "RemoveContainer" containerID="828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656" Jun 08 22:03:32.285131 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.285109 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656"} err="failed to get container status \"828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656\": rpc error: code = NotFound desc = could not find container \"828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656\": container with ID starting with 828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656 not found: ID does not exist" Jun 08 22:03:32.285461 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.285132 2549 scope.go:117] "RemoveContainer" containerID="b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f" Jun 08 22:03:32.285461 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.285396 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f"} err="failed to get container status \"b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f\": rpc error: code = NotFound desc = could not find container \"b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f\": container with ID starting with b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f not found: ID does not exist" Jun 08 22:03:32.285461 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.285417 2549 scope.go:117] "RemoveContainer" containerID="f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c" Jun 08 22:03:32.285693 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.285673 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c"} err="failed to get container status \"f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c\": rpc error: code = NotFound desc = could not find container \"f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c\": container with ID starting with f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c not found: ID does not exist" Jun 08 22:03:32.285740 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.285692 2549 scope.go:117] "RemoveContainer" containerID="fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776" Jun 08 22:03:32.285940 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.285924 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776"} err="failed to get container status \"fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776\": rpc error: code = NotFound desc = could not find container \"fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776\": container with ID starting with fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776 not found: ID does not exist" Jun 08 22:03:32.285984 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.285941 2549 scope.go:117] "RemoveContainer" containerID="1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd" Jun 08 22:03:32.286048 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286034 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 22:03:32.286194 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286143 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd"} err="failed to get container status \"1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd\": rpc error: code = NotFound desc = could not find container \"1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd\": container with ID starting with 1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd not found: ID does not exist" Jun 08 22:03:32.286248 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286194 2549 scope.go:117] "RemoveContainer" containerID="f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7" Jun 08 22:03:32.286458 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286438 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7"} err="failed to get container status \"f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7\": rpc error: code = NotFound desc = could not find container \"f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7\": container with ID starting with f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7 not found: ID does not exist" Jun 08 22:03:32.286505 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286460 2549 scope.go:117] "RemoveContainer" containerID="3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e" Jun 08 22:03:32.286505 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286481 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="init-config-reloader" Jun 08 22:03:32.286505 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286496 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="init-config-reloader" Jun 08 22:03:32.286635 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286506 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="prometheus" Jun 08 22:03:32.286635 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286512 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="prometheus" Jun 08 22:03:32.286635 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286522 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="thanos-sidecar" Jun 08 22:03:32.286635 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286528 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="thanos-sidecar" Jun 08 22:03:32.286635 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286533 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="kube-rbac-proxy-thanos" Jun 08 22:03:32.286635 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286539 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="kube-rbac-proxy-thanos" Jun 08 22:03:32.286635 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286548 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="config-reloader" Jun 08 22:03:32.286635 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286555 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="config-reloader" Jun 08 22:03:32.286635 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286567 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="kube-rbac-proxy-web" Jun 08 22:03:32.286635 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286576 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="kube-rbac-proxy-web" Jun 08 22:03:32.286635 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286585 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="kube-rbac-proxy" Jun 08 22:03:32.286635 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286591 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="kube-rbac-proxy" Jun 08 22:03:32.286635 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286640 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="kube-rbac-proxy" Jun 08 22:03:32.287072 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286654 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="config-reloader" Jun 08 22:03:32.287072 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286663 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="thanos-sidecar" Jun 08 22:03:32.287072 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286673 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="kube-rbac-proxy-web" Jun 08 22:03:32.287072 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286680 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="prometheus" Jun 08 22:03:32.287072 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286685 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" containerName="kube-rbac-proxy-thanos" Jun 08 22:03:32.287072 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286685 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e"} err="failed to get container status \"3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e\": rpc error: code = NotFound desc = could not find container \"3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e\": container with ID starting with 3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e not found: ID does not exist" Jun 08 22:03:32.287072 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286710 2549 scope.go:117] "RemoveContainer" containerID="828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656" Jun 08 22:03:32.287072 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286944 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656"} err="failed to get container status \"828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656\": rpc error: code = NotFound desc = could not find container \"828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656\": container with ID starting with 828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656 not found: ID does not exist" Jun 08 22:03:32.287072 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.286958 2549 scope.go:117] "RemoveContainer" containerID="b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f" Jun 08 22:03:32.287463 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.287206 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f"} err="failed to get container status \"b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f\": rpc error: code = NotFound desc = could not find container \"b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f\": container with ID starting with b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f not found: ID does not exist" Jun 08 22:03:32.287463 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.287222 2549 scope.go:117] "RemoveContainer" containerID="f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c" Jun 08 22:03:32.287463 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.287436 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c"} err="failed to get container status \"f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c\": rpc error: code = NotFound desc = could not find container \"f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c\": container with ID starting with f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c not found: ID does not exist" Jun 08 22:03:32.287463 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.287451 2549 scope.go:117] "RemoveContainer" containerID="fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776" Jun 08 22:03:32.287673 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.287653 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776"} err="failed to get container status \"fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776\": rpc error: code = NotFound desc = could not find container \"fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776\": container with ID starting with fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776 not found: ID does not exist" Jun 08 22:03:32.287711 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.287674 2549 scope.go:117] "RemoveContainer" containerID="1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd" Jun 08 22:03:32.287879 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.287861 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd"} err="failed to get container status \"1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd\": rpc error: code = NotFound desc = could not find container \"1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd\": container with ID starting with 1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd not found: ID does not exist" Jun 08 22:03:32.287922 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.287879 2549 scope.go:117] "RemoveContainer" containerID="f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7" Jun 08 22:03:32.288090 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.288071 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7"} err="failed to get container status \"f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7\": rpc error: code = NotFound desc = could not find container \"f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7\": container with ID starting with f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7 not found: ID does not exist" Jun 08 22:03:32.288150 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.288091 2549 scope.go:117] "RemoveContainer" containerID="3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e" Jun 08 22:03:32.288310 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.288293 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e"} err="failed to get container status \"3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e\": rpc error: code = NotFound desc = could not find container \"3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e\": container with ID starting with 3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e not found: ID does not exist" Jun 08 22:03:32.288368 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.288311 2549 scope.go:117] "RemoveContainer" containerID="828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656" Jun 08 22:03:32.288528 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.288509 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656"} err="failed to get container status \"828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656\": rpc error: code = NotFound desc = could not find container \"828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656\": container with ID starting with 828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656 not found: ID does not exist" Jun 08 22:03:32.288571 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.288529 2549 scope.go:117] "RemoveContainer" containerID="b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f" Jun 08 22:03:32.288719 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.288703 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f"} err="failed to get container status \"b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f\": rpc error: code = NotFound desc = could not find container \"b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f\": container with ID starting with b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f not found: ID does not exist" Jun 08 22:03:32.288778 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.288721 2549 scope.go:117] "RemoveContainer" containerID="f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c" Jun 08 22:03:32.288924 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.288907 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c"} err="failed to get container status \"f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c\": rpc error: code = NotFound desc = could not find container \"f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c\": container with ID starting with f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c not found: ID does not exist" Jun 08 22:03:32.288970 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.288924 2549 scope.go:117] "RemoveContainer" containerID="fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776" Jun 08 22:03:32.289115 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.289098 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776"} err="failed to get container status \"fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776\": rpc error: code = NotFound desc = could not find container \"fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776\": container with ID starting with fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776 not found: ID does not exist" Jun 08 22:03:32.289195 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.289116 2549 scope.go:117] "RemoveContainer" containerID="1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd" Jun 08 22:03:32.289321 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.289303 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd"} err="failed to get container status \"1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd\": rpc error: code = NotFound desc = could not find container \"1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd\": container with ID starting with 1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd not found: ID does not exist" Jun 08 22:03:32.289371 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.289322 2549 scope.go:117] "RemoveContainer" containerID="f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7" Jun 08 22:03:32.289570 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.289551 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7"} err="failed to get container status \"f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7\": rpc error: code = NotFound desc = could not find container \"f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7\": container with ID starting with f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7 not found: ID does not exist" Jun 08 22:03:32.289660 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.289572 2549 scope.go:117] "RemoveContainer" containerID="3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e" Jun 08 22:03:32.289765 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.289749 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e"} err="failed to get container status \"3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e\": rpc error: code = NotFound desc = could not find container \"3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e\": container with ID starting with 3b36c35a1f4a81142a7f4428bb4fa50d280594ef5e96bf80afd23254335ad07e not found: ID does not exist" Jun 08 22:03:32.289808 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.289765 2549 scope.go:117] "RemoveContainer" containerID="828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656" Jun 08 22:03:32.290002 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.289959 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656"} err="failed to get container status \"828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656\": rpc error: code = NotFound desc = could not find container \"828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656\": container with ID starting with 828f388a8d37ede81f08c05c3fefba11437cb7952842b02c2fe1d2c329a83656 not found: ID does not exist" Jun 08 22:03:32.290002 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.289976 2549 scope.go:117] "RemoveContainer" containerID="b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f" Jun 08 22:03:32.290242 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.290217 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f"} err="failed to get container status \"b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f\": rpc error: code = NotFound desc = could not find container \"b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f\": container with ID starting with b82226384cf5d0dfbddd0d74ef08f730e7f04af0a366f235f197d286faaab61f not found: ID does not exist" Jun 08 22:03:32.290316 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.290245 2549 scope.go:117] "RemoveContainer" containerID="f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c" Jun 08 22:03:32.290498 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.290475 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c"} err="failed to get container status \"f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c\": rpc error: code = NotFound desc = could not find container \"f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c\": container with ID starting with f9d0827a37a9e4ed710ae73c6de918fee9351d2e676e4c6ed6bc4e309fca257c not found: ID does not exist" Jun 08 22:03:32.290572 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.290500 2549 scope.go:117] "RemoveContainer" containerID="fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776" Jun 08 22:03:32.290636 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.290621 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.290731 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.290714 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776"} err="failed to get container status \"fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776\": rpc error: code = NotFound desc = could not find container \"fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776\": container with ID starting with fd6c0d851f8e66147461d9b161062e0d058ebde662bc3daf8f340c17e101e776 not found: ID does not exist" Jun 08 22:03:32.290787 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.290732 2549 scope.go:117] "RemoveContainer" containerID="1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd" Jun 08 22:03:32.290957 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.290934 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd"} err="failed to get container status \"1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd\": rpc error: code = NotFound desc = could not find container \"1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd\": container with ID starting with 1c963900c754cf6d5bdcb78c0c041e40bb0517430238820eabba93b054065dbd not found: ID does not exist" Jun 08 22:03:32.291034 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.290959 2549 scope.go:117] "RemoveContainer" containerID="f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7" Jun 08 22:03:32.291323 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.291298 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7"} err="failed to get container status \"f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7\": rpc error: code = NotFound desc = could not find container \"f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7\": container with ID starting with f6e266074b92cd61085316caf37d75519c1cbab3603b34ad23afa05b520760a7 not found: ID does not exist" Jun 08 22:03:32.293303 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.293282 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 22:03:32.293404 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.293384 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 22:03:32.293548 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.293531 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 22:03:32.293658 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.293630 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-nfrrb\"" Jun 08 22:03:32.293759 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.293746 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 22:03:32.294611 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.294595 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 22:03:32.294728 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.294640 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 22:03:32.294728 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.294650 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 22:03:32.294834 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.294788 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 22:03:32.294834 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.294795 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 22:03:32.294960 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.294908 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 22:03:32.295081 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.295065 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 22:03:32.295081 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.295076 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 22:03:32.295682 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.295660 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 22:03:32.297880 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.297867 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fhk5b9c447e4b\"" Jun 08 22:03:32.297963 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.297898 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 22:03:32.301519 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.301502 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 22:03:32.307516 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.307493 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 22:03:32.428460 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.428419 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/91842703-d517-401a-8b4b-54679e40bae7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.428460 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.428454 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/91842703-d517-401a-8b4b-54679e40bae7-config-out\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.428671 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.428482 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.428671 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.428525 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91842703-d517-401a-8b4b-54679e40bae7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.428671 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.428569 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-web-config\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.428671 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.428599 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.428671 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.428636 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91842703-d517-401a-8b4b-54679e40bae7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.428861 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.428681 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/91842703-d517-401a-8b4b-54679e40bae7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.428861 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.428698 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.428861 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.428715 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.428861 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.428788 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.428861 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.428827 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/91842703-d517-401a-8b4b-54679e40bae7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.428861 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.428845 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/91842703-d517-401a-8b4b-54679e40bae7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.429070 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.428880 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.429070 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.428897 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91842703-d517-401a-8b4b-54679e40bae7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.429070 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.428912 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/91842703-d517-401a-8b4b-54679e40bae7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.429070 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.428927 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91842703-d517-401a-8b4b-54679e40bae7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.429070 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.428969 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.429070 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.429004 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-config\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.429070 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.429022 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrdvc\" (UniqueName: \"kubernetes.io/projected/91842703-d517-401a-8b4b-54679e40bae7-kube-api-access-mrdvc\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.529566 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.529479 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91842703-d517-401a-8b4b-54679e40bae7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.529566 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.529526 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/91842703-d517-401a-8b4b-54679e40bae7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.529566 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.529543 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.529566 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.529558 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.529850 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.529578 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.529850 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.529606 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/91842703-d517-401a-8b4b-54679e40bae7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.529850 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.529629 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/91842703-d517-401a-8b4b-54679e40bae7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.529850 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.529653 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.529850 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.529674 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91842703-d517-401a-8b4b-54679e40bae7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.529850 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.529695 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/91842703-d517-401a-8b4b-54679e40bae7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.529850 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.529723 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91842703-d517-401a-8b4b-54679e40bae7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.529850 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.529758 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.529850 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.529790 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-config\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.529850 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.529816 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrdvc\" (UniqueName: \"kubernetes.io/projected/91842703-d517-401a-8b4b-54679e40bae7-kube-api-access-mrdvc\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.530362 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.529855 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/91842703-d517-401a-8b4b-54679e40bae7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.530362 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.529877 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/91842703-d517-401a-8b4b-54679e40bae7-config-out\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.530362 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.529901 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.530362 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.529927 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91842703-d517-401a-8b4b-54679e40bae7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.530362 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.529978 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-web-config\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.530362 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.530017 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.530362 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.530270 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/91842703-d517-401a-8b4b-54679e40bae7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.530713 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.530388 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91842703-d517-401a-8b4b-54679e40bae7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.530713 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.530490 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/91842703-d517-401a-8b4b-54679e40bae7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.531251 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.531227 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/91842703-d517-401a-8b4b-54679e40bae7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.532940 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.532909 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.533043 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.532960 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.533855 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.533186 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/91842703-d517-401a-8b4b-54679e40bae7-config-out\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.533855 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.533238 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91842703-d517-401a-8b4b-54679e40bae7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.533855 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.533285 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91842703-d517-401a-8b4b-54679e40bae7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.533855 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.533448 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-config\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.533855 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.533825 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/91842703-d517-401a-8b4b-54679e40bae7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.533855 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.533826 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91842703-d517-401a-8b4b-54679e40bae7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.534253 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.533899 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.534253 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.533924 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.535073 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.535048 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.535209 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.535187 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.535518 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.535489 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-web-config\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.535719 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.535702 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/91842703-d517-401a-8b4b-54679e40bae7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.535833 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.535814 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/91842703-d517-401a-8b4b-54679e40bae7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.540704 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.540685 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrdvc\" (UniqueName: \"kubernetes.io/projected/91842703-d517-401a-8b4b-54679e40bae7-kube-api-access-mrdvc\") pod \"prometheus-k8s-0\" (UID: \"91842703-d517-401a-8b4b-54679e40bae7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.615775 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.615736 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:32.760307 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.760283 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 22:03:32.762773 ip-10-0-138-88 kubenswrapper[2549]: W0608 22:03:32.762742 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91842703_d517_401a_8b4b_54679e40bae7.slice/crio-d04924be22b3f3fc9bc29dda5b27d9e2508904bf5fd034a30a383ba5be9f093c WatchSource:0}: Error finding container d04924be22b3f3fc9bc29dda5b27d9e2508904bf5fd034a30a383ba5be9f093c: Status 404 returned error can't find the container with id d04924be22b3f3fc9bc29dda5b27d9e2508904bf5fd034a30a383ba5be9f093c Jun 08 22:03:32.997762 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:32.997731 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae7eea8e-62c5-4994-8bbd-06a073dbc0bb" path="/var/lib/kubelet/pods/ae7eea8e-62c5-4994-8bbd-06a073dbc0bb/volumes" Jun 08 22:03:33.232050 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:33.232019 2549 generic.go:356] "Generic (PLEG): container finished" podID="91842703-d517-401a-8b4b-54679e40bae7" containerID="21d57c086d6d81c6cd943715e4b3eb31156b210a9e45be7f405959c4715a0825" exitCode=0 Jun 08 22:03:33.232256 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:33.232102 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91842703-d517-401a-8b4b-54679e40bae7","Type":"ContainerDied","Data":"21d57c086d6d81c6cd943715e4b3eb31156b210a9e45be7f405959c4715a0825"} Jun 08 22:03:33.232256 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:33.232190 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91842703-d517-401a-8b4b-54679e40bae7","Type":"ContainerStarted","Data":"d04924be22b3f3fc9bc29dda5b27d9e2508904bf5fd034a30a383ba5be9f093c"} Jun 08 22:03:34.240115 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:34.240078 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91842703-d517-401a-8b4b-54679e40bae7","Type":"ContainerStarted","Data":"8bd51a2c037e8c09bf50e4a263cb760aeabfd7787f2917b4a498cb776420f791"} Jun 08 22:03:34.240483 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:34.240216 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91842703-d517-401a-8b4b-54679e40bae7","Type":"ContainerStarted","Data":"69f9712d48ac4c22166b581d7ee99f2f4c759640a2e8d5afe290ffd491755ce1"} Jun 08 22:03:34.240483 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:34.240259 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91842703-d517-401a-8b4b-54679e40bae7","Type":"ContainerStarted","Data":"ae652b59d7f798163f40203811018855e6cfc6a93c0aaf647575c2f3851dfe47"} Jun 08 22:03:34.240483 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:34.240295 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91842703-d517-401a-8b4b-54679e40bae7","Type":"ContainerStarted","Data":"b5e9255ebfe4c458c98ece62cd751c84cf3a6f8f14db935603fae780cb92c0ad"} Jun 08 22:03:34.240483 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:34.240329 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91842703-d517-401a-8b4b-54679e40bae7","Type":"ContainerStarted","Data":"5d7fb18b9ad35764f78e6e2cb4c2f86ce0af7867646c34454797e9f45ad3f627"} Jun 08 22:03:34.240483 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:34.240364 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91842703-d517-401a-8b4b-54679e40bae7","Type":"ContainerStarted","Data":"df2da9d6c56874d938a78fe7daa82616314a8f2472a526a4d4cadec440f59a2d"} Jun 08 22:03:34.272517 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:34.272461 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.2533117320000002 podStartE2EDuration="2.272445034s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.133302ms" isStatefulPod=false podCreationTimestamp="2026-06-08 22:03:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:03:34.270538989 +0000 UTC m=+365.819425810" watchObservedRunningTime="2026-06-08 22:03:34.272445034 +0000 UTC m=+365.821331821" Jun 08 22:03:37.616022 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:37.615978 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:42.918689 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:42.918634 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs\") pod \"network-metrics-daemon-4pmzz\" (UID: \"12b6a387-cd80-4157-8c91-00fdb3ee3676\") " pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 22:03:42.921004 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:42.920974 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b6a387-cd80-4157-8c91-00fdb3ee3676-metrics-certs\") pod \"network-metrics-daemon-4pmzz\" (UID: \"12b6a387-cd80-4157-8c91-00fdb3ee3676\") " pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 22:03:43.197801 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:43.197716 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6cpnn\"" Jun 08 22:03:43.205977 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:43.205945 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4pmzz" Jun 08 22:03:43.336506 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:43.336481 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4pmzz"] Jun 08 22:03:43.339101 ip-10-0-138-88 kubenswrapper[2549]: W0608 22:03:43.339072 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12b6a387_cd80_4157_8c91_00fdb3ee3676.slice/crio-6d73fbcd20552a7174a7a5ca946bea968d18711ac386072c0ce7463013a14e8a WatchSource:0}: Error finding container 6d73fbcd20552a7174a7a5ca946bea968d18711ac386072c0ce7463013a14e8a: Status 404 returned error can't find the container with id 6d73fbcd20552a7174a7a5ca946bea968d18711ac386072c0ce7463013a14e8a Jun 08 22:03:43.341188 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:43.341145 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 22:03:44.284766 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:44.284692 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4pmzz" event={"ID":"12b6a387-cd80-4157-8c91-00fdb3ee3676","Type":"ContainerStarted","Data":"6d73fbcd20552a7174a7a5ca946bea968d18711ac386072c0ce7463013a14e8a"} Jun 08 22:03:45.291034 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:45.290989 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4pmzz" event={"ID":"12b6a387-cd80-4157-8c91-00fdb3ee3676","Type":"ContainerStarted","Data":"52882fb1d0e6aa3888b79a9669e33982f9026f010727e710cba7c2d37b959b87"} Jun 08 22:03:45.291443 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:45.291056 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4pmzz" event={"ID":"12b6a387-cd80-4157-8c91-00fdb3ee3676","Type":"ContainerStarted","Data":"2714045217fb335a11d208f0cb15907a696498d42c5e07aed33bfb81d8144bc6"} Jun 08 22:03:45.308125 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:03:45.308072 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4pmzz" podStartSLOduration=375.36976564 podStartE2EDuration="6m16.308055613s" totalImagesPullingTime="938.289973ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:03:45.307583319 +0000 UTC m=+376.856470108" watchObservedRunningTime="2026-06-08 22:03:45.308055613 +0000 UTC m=+376.856942400" Jun 08 22:04:32.616314 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:04:32.616279 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:04:32.631933 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:04:32.631906 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:04:33.496028 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:04:33.495999 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:07:28.953391 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:07:28.953362 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rzp7c_ecc09a2e-0137-45ae-9982-e8f714b875c5/console-operator/2.log" Jun 08 22:07:28.954739 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:07:28.954712 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rzp7c_ecc09a2e-0137-45ae-9982-e8f714b875c5/console-operator/2.log" Jun 08 22:12:28.978571 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:12:28.978392 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rzp7c_ecc09a2e-0137-45ae-9982-e8f714b875c5/console-operator/2.log" Jun 08 22:12:28.980844 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:12:28.980821 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rzp7c_ecc09a2e-0137-45ae-9982-e8f714b875c5/console-operator/2.log" Jun 08 22:13:41.123175 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:13:41.123139 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-t54kh"] Jun 08 22:13:41.126503 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:13:41.126485 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-t54kh" Jun 08 22:13:41.129635 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:13:41.129611 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 08 22:13:41.129738 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:13:41.129644 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 08 22:13:41.131638 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:13:41.131622 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-q7smm\"" Jun 08 22:13:41.135619 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:13:41.135600 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-t54kh"] Jun 08 22:13:41.270040 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:13:41.270002 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8xjd\" (UniqueName: \"kubernetes.io/projected/70be8363-eefb-49f9-ade0-8351a8d38705-kube-api-access-g8xjd\") pod \"cert-manager-59c77684cc-t54kh\" (UID: \"70be8363-eefb-49f9-ade0-8351a8d38705\") " pod="cert-manager/cert-manager-59c77684cc-t54kh" Jun 08 22:13:41.270197 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:13:41.270046 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/70be8363-eefb-49f9-ade0-8351a8d38705-bound-sa-token\") pod \"cert-manager-59c77684cc-t54kh\" (UID: \"70be8363-eefb-49f9-ade0-8351a8d38705\") " pod="cert-manager/cert-manager-59c77684cc-t54kh" Jun 08 22:13:41.370427 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:13:41.370400 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8xjd\" (UniqueName: \"kubernetes.io/projected/70be8363-eefb-49f9-ade0-8351a8d38705-kube-api-access-g8xjd\") pod \"cert-manager-59c77684cc-t54kh\" (UID: \"70be8363-eefb-49f9-ade0-8351a8d38705\") " pod="cert-manager/cert-manager-59c77684cc-t54kh" Jun 08 22:13:41.370545 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:13:41.370439 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/70be8363-eefb-49f9-ade0-8351a8d38705-bound-sa-token\") pod \"cert-manager-59c77684cc-t54kh\" (UID: \"70be8363-eefb-49f9-ade0-8351a8d38705\") " pod="cert-manager/cert-manager-59c77684cc-t54kh" Jun 08 22:13:41.392754 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:13:41.392698 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8xjd\" (UniqueName: \"kubernetes.io/projected/70be8363-eefb-49f9-ade0-8351a8d38705-kube-api-access-g8xjd\") pod \"cert-manager-59c77684cc-t54kh\" (UID: \"70be8363-eefb-49f9-ade0-8351a8d38705\") " pod="cert-manager/cert-manager-59c77684cc-t54kh" Jun 08 22:13:41.394408 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:13:41.394387 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/70be8363-eefb-49f9-ade0-8351a8d38705-bound-sa-token\") pod \"cert-manager-59c77684cc-t54kh\" (UID: \"70be8363-eefb-49f9-ade0-8351a8d38705\") " pod="cert-manager/cert-manager-59c77684cc-t54kh" Jun 08 22:13:41.442308 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:13:41.442287 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-t54kh" Jun 08 22:13:41.564294 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:13:41.564264 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-t54kh"] Jun 08 22:13:41.567513 ip-10-0-138-88 kubenswrapper[2549]: W0608 22:13:41.567487 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70be8363_eefb_49f9_ade0_8351a8d38705.slice/crio-e299f40a0793d774d10d20fbf6714931e4d833b85e1df2228f7718a0135393be WatchSource:0}: Error finding container e299f40a0793d774d10d20fbf6714931e4d833b85e1df2228f7718a0135393be: Status 404 returned error can't find the container with id e299f40a0793d774d10d20fbf6714931e4d833b85e1df2228f7718a0135393be Jun 08 22:13:41.569549 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:13:41.569534 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 22:13:41.589635 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:13:41.589607 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-t54kh" event={"ID":"70be8363-eefb-49f9-ade0-8351a8d38705","Type":"ContainerStarted","Data":"e299f40a0793d774d10d20fbf6714931e4d833b85e1df2228f7718a0135393be"} Jun 08 22:13:45.607622 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:13:45.607589 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-t54kh" event={"ID":"70be8363-eefb-49f9-ade0-8351a8d38705","Type":"ContainerStarted","Data":"77ba67f159ca06d65470d4fe97c294ce5282903eb1edaea2fbab7fcd9940b954"} Jun 08 22:13:45.625459 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:13:45.625417 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-t54kh" podStartSLOduration=1.6046031790000002 podStartE2EDuration="4.625401933s" totalImagesPullingTime="3.020798754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:13:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:13:45.624303485 +0000 UTC m=+977.173190285" watchObservedRunningTime="2026-06-08 22:13:45.625401933 +0000 UTC m=+977.174288720" Jun 08 22:16:21.508578 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:16:21.508545 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8ndl8/must-gather-g869r"] Jun 08 22:16:21.510689 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:16:21.510673 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8ndl8/must-gather-g869r" Jun 08 22:16:21.513552 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:16:21.513532 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8ndl8\"/\"default-dockercfg-wtgmm\"" Jun 08 22:16:21.514727 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:16:21.514704 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8ndl8\"/\"kube-root-ca.crt\"" Jun 08 22:16:21.514843 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:16:21.514777 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8ndl8\"/\"openshift-service-ca.crt\"" Jun 08 22:16:21.527713 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:16:21.527685 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8ndl8/must-gather-g869r"] Jun 08 22:16:21.593113 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:16:21.593083 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d7e5dd8d-4cc4-4295-9a64-04031409cd76-must-gather-output\") pod \"must-gather-g869r\" (UID: \"d7e5dd8d-4cc4-4295-9a64-04031409cd76\") " pod="openshift-must-gather-8ndl8/must-gather-g869r" Jun 08 22:16:21.593261 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:16:21.593124 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5lw6\" (UniqueName: \"kubernetes.io/projected/d7e5dd8d-4cc4-4295-9a64-04031409cd76-kube-api-access-g5lw6\") pod \"must-gather-g869r\" (UID: \"d7e5dd8d-4cc4-4295-9a64-04031409cd76\") " pod="openshift-must-gather-8ndl8/must-gather-g869r" Jun 08 22:16:21.694057 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:16:21.694031 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d7e5dd8d-4cc4-4295-9a64-04031409cd76-must-gather-output\") pod \"must-gather-g869r\" (UID: \"d7e5dd8d-4cc4-4295-9a64-04031409cd76\") " pod="openshift-must-gather-8ndl8/must-gather-g869r" Jun 08 22:16:21.694205 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:16:21.694068 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5lw6\" (UniqueName: \"kubernetes.io/projected/d7e5dd8d-4cc4-4295-9a64-04031409cd76-kube-api-access-g5lw6\") pod \"must-gather-g869r\" (UID: \"d7e5dd8d-4cc4-4295-9a64-04031409cd76\") " pod="openshift-must-gather-8ndl8/must-gather-g869r" Jun 08 22:16:21.694453 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:16:21.694433 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d7e5dd8d-4cc4-4295-9a64-04031409cd76-must-gather-output\") pod \"must-gather-g869r\" (UID: \"d7e5dd8d-4cc4-4295-9a64-04031409cd76\") " pod="openshift-must-gather-8ndl8/must-gather-g869r" Jun 08 22:16:21.702280 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:16:21.702255 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5lw6\" (UniqueName: \"kubernetes.io/projected/d7e5dd8d-4cc4-4295-9a64-04031409cd76-kube-api-access-g5lw6\") pod \"must-gather-g869r\" (UID: \"d7e5dd8d-4cc4-4295-9a64-04031409cd76\") " pod="openshift-must-gather-8ndl8/must-gather-g869r" Jun 08 22:16:21.819838 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:16:21.819763 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8ndl8/must-gather-g869r" Jun 08 22:16:21.954280 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:16:21.954248 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8ndl8/must-gather-g869r"] Jun 08 22:16:21.957493 ip-10-0-138-88 kubenswrapper[2549]: W0608 22:16:21.957466 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7e5dd8d_4cc4_4295_9a64_04031409cd76.slice/crio-33f0d5c1c14aeda5b3872d6a562bab389ad20738179a83880da958cc13766189 WatchSource:0}: Error finding container 33f0d5c1c14aeda5b3872d6a562bab389ad20738179a83880da958cc13766189: Status 404 returned error can't find the container with id 33f0d5c1c14aeda5b3872d6a562bab389ad20738179a83880da958cc13766189 Jun 08 22:16:22.218615 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:16:22.218582 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8ndl8/must-gather-g869r" event={"ID":"d7e5dd8d-4cc4-4295-9a64-04031409cd76","Type":"ContainerStarted","Data":"33f0d5c1c14aeda5b3872d6a562bab389ad20738179a83880da958cc13766189"} Jun 08 22:16:28.250036 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:16:28.250011 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8ndl8/must-gather-g869r" event={"ID":"d7e5dd8d-4cc4-4295-9a64-04031409cd76","Type":"ContainerStarted","Data":"12bc35bd11543d98d72acd6ff73b45f79110783877670468d47868b4bd0ab0b4"} Jun 08 22:16:28.250365 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:16:28.250049 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8ndl8/must-gather-g869r" event={"ID":"d7e5dd8d-4cc4-4295-9a64-04031409cd76","Type":"ContainerStarted","Data":"5aaa8bda978bc4af778513b4ce239b2c1d3422254a4ccca09d1da6e3c2719fc2"} Jun 08 22:16:28.267142 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:16:28.267073 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8ndl8/must-gather-g869r" podStartSLOduration=1.23803645 podStartE2EDuration="7.267057361s" totalImagesPullingTime="6.029020911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:16:28.266214951 +0000 UTC m=+1139.815101743" watchObservedRunningTime="2026-06-08 22:16:28.267057361 +0000 UTC m=+1139.815944148" Jun 08 22:17:13.458632 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:13.458601 2549 generic.go:356] "Generic (PLEG): container finished" podID="d7e5dd8d-4cc4-4295-9a64-04031409cd76" containerID="5aaa8bda978bc4af778513b4ce239b2c1d3422254a4ccca09d1da6e3c2719fc2" exitCode=0 Jun 08 22:17:13.459044 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:13.458638 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8ndl8/must-gather-g869r" event={"ID":"d7e5dd8d-4cc4-4295-9a64-04031409cd76","Type":"ContainerDied","Data":"5aaa8bda978bc4af778513b4ce239b2c1d3422254a4ccca09d1da6e3c2719fc2"} Jun 08 22:17:13.459044 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:13.458924 2549 scope.go:117] "RemoveContainer" containerID="5aaa8bda978bc4af778513b4ce239b2c1d3422254a4ccca09d1da6e3c2719fc2" Jun 08 22:17:13.726970 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:13.726897 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-8ndl8_must-gather-g869r_d7e5dd8d-4cc4-4295-9a64-04031409cd76/gather/0.log" Jun 08 22:17:17.275014 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:17.274984 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vv87w_80169240-476c-4146-8a59-63cf33decac4/global-pull-secret-syncer/0.log" Jun 08 22:17:17.457607 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:17.457568 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nnkbc_59f23391-dc4a-4dec-b7bf-6263e375f0d0/konnectivity-agent/0.log" Jun 08 22:17:17.526555 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:17.526486 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-88.ec2.internal_e25ad584d13e34d4cb3733b3bdccab49/haproxy/0.log" Jun 08 22:17:19.078130 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:19.078100 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-8ndl8/must-gather-g869r"] Jun 08 22:17:19.078526 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:19.078268 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-8ndl8/must-gather-g869r" podUID="d7e5dd8d-4cc4-4295-9a64-04031409cd76" containerName="copy" containerID="cri-o://12bc35bd11543d98d72acd6ff73b45f79110783877670468d47868b4bd0ab0b4" gracePeriod=2 Jun 08 22:17:19.083243 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:19.083215 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-8ndl8/must-gather-g869r"] Jun 08 22:17:19.317663 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:19.317644 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-8ndl8_must-gather-g869r_d7e5dd8d-4cc4-4295-9a64-04031409cd76/copy/0.log" Jun 08 22:17:19.319983 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:19.319966 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8ndl8/must-gather-g869r" Jun 08 22:17:19.322092 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:17:19.322071 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-g869r\" is forbidden: User \"system:node:ip-10-0-138-88.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-8ndl8\": no relationship found between node 'ip-10-0-138-88.ec2.internal' and this object" podUID="d7e5dd8d-4cc4-4295-9a64-04031409cd76" pod="openshift-must-gather-8ndl8/must-gather-g869r" Jun 08 22:17:19.387526 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:19.387472 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d7e5dd8d-4cc4-4295-9a64-04031409cd76-must-gather-output\") pod \"d7e5dd8d-4cc4-4295-9a64-04031409cd76\" (UID: \"d7e5dd8d-4cc4-4295-9a64-04031409cd76\") " Jun 08 22:17:19.387526 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:19.387509 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5lw6\" (UniqueName: \"kubernetes.io/projected/d7e5dd8d-4cc4-4295-9a64-04031409cd76-kube-api-access-g5lw6\") pod \"d7e5dd8d-4cc4-4295-9a64-04031409cd76\" (UID: \"d7e5dd8d-4cc4-4295-9a64-04031409cd76\") " Jun 08 22:17:19.389639 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:19.389611 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7e5dd8d-4cc4-4295-9a64-04031409cd76-kube-api-access-g5lw6" (OuterVolumeSpecName: "kube-api-access-g5lw6") pod "d7e5dd8d-4cc4-4295-9a64-04031409cd76" (UID: "d7e5dd8d-4cc4-4295-9a64-04031409cd76"). InnerVolumeSpecName "kube-api-access-g5lw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 22:17:19.389639 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:19.389621 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7e5dd8d-4cc4-4295-9a64-04031409cd76-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "d7e5dd8d-4cc4-4295-9a64-04031409cd76" (UID: "d7e5dd8d-4cc4-4295-9a64-04031409cd76"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 22:17:19.483765 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:19.483746 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-8ndl8_must-gather-g869r_d7e5dd8d-4cc4-4295-9a64-04031409cd76/copy/0.log" Jun 08 22:17:19.484178 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:19.484134 2549 generic.go:356] "Generic (PLEG): container finished" podID="d7e5dd8d-4cc4-4295-9a64-04031409cd76" containerID="12bc35bd11543d98d72acd6ff73b45f79110783877670468d47868b4bd0ab0b4" exitCode=143 Jun 08 22:17:19.484271 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:19.484225 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8ndl8/must-gather-g869r" Jun 08 22:17:19.484271 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:19.484239 2549 scope.go:117] "RemoveContainer" containerID="12bc35bd11543d98d72acd6ff73b45f79110783877670468d47868b4bd0ab0b4" Jun 08 22:17:19.487831 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:17:19.487807 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-g869r\" is forbidden: User \"system:node:ip-10-0-138-88.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-8ndl8\": no relationship found between node 'ip-10-0-138-88.ec2.internal' and this object" podUID="d7e5dd8d-4cc4-4295-9a64-04031409cd76" pod="openshift-must-gather-8ndl8/must-gather-g869r" Jun 08 22:17:19.488184 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:19.488141 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5lw6\" (UniqueName: \"kubernetes.io/projected/d7e5dd8d-4cc4-4295-9a64-04031409cd76-kube-api-access-g5lw6\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:17:19.488311 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:19.488188 2549 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d7e5dd8d-4cc4-4295-9a64-04031409cd76-must-gather-output\") on node \"ip-10-0-138-88.ec2.internal\" DevicePath \"\"" Jun 08 22:17:19.492147 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:19.492126 2549 scope.go:117] "RemoveContainer" containerID="5aaa8bda978bc4af778513b4ce239b2c1d3422254a4ccca09d1da6e3c2719fc2" Jun 08 22:17:19.494727 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:17:19.494704 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-g869r\" is forbidden: User \"system:node:ip-10-0-138-88.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-8ndl8\": no relationship found between node 'ip-10-0-138-88.ec2.internal' and this object" podUID="d7e5dd8d-4cc4-4295-9a64-04031409cd76" pod="openshift-must-gather-8ndl8/must-gather-g869r" Jun 08 22:17:19.503968 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:19.503950 2549 scope.go:117] "RemoveContainer" containerID="12bc35bd11543d98d72acd6ff73b45f79110783877670468d47868b4bd0ab0b4" Jun 08 22:17:19.504202 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:17:19.504182 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12bc35bd11543d98d72acd6ff73b45f79110783877670468d47868b4bd0ab0b4\": container with ID starting with 12bc35bd11543d98d72acd6ff73b45f79110783877670468d47868b4bd0ab0b4 not found: ID does not exist" containerID="12bc35bd11543d98d72acd6ff73b45f79110783877670468d47868b4bd0ab0b4" Jun 08 22:17:19.504252 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:19.504209 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12bc35bd11543d98d72acd6ff73b45f79110783877670468d47868b4bd0ab0b4"} err="failed to get container status \"12bc35bd11543d98d72acd6ff73b45f79110783877670468d47868b4bd0ab0b4\": rpc error: code = NotFound desc = could not find container \"12bc35bd11543d98d72acd6ff73b45f79110783877670468d47868b4bd0ab0b4\": container with ID starting with 12bc35bd11543d98d72acd6ff73b45f79110783877670468d47868b4bd0ab0b4 not found: ID does not exist" Jun 08 22:17:19.504252 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:19.504226 2549 scope.go:117] "RemoveContainer" containerID="5aaa8bda978bc4af778513b4ce239b2c1d3422254a4ccca09d1da6e3c2719fc2" Jun 08 22:17:19.504484 ip-10-0-138-88 kubenswrapper[2549]: E0608 22:17:19.504466 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5aaa8bda978bc4af778513b4ce239b2c1d3422254a4ccca09d1da6e3c2719fc2\": container with ID starting with 5aaa8bda978bc4af778513b4ce239b2c1d3422254a4ccca09d1da6e3c2719fc2 not found: ID does not exist" containerID="5aaa8bda978bc4af778513b4ce239b2c1d3422254a4ccca09d1da6e3c2719fc2" Jun 08 22:17:19.504540 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:19.504495 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5aaa8bda978bc4af778513b4ce239b2c1d3422254a4ccca09d1da6e3c2719fc2"} err="failed to get container status \"5aaa8bda978bc4af778513b4ce239b2c1d3422254a4ccca09d1da6e3c2719fc2\": rpc error: code = NotFound desc = could not find container \"5aaa8bda978bc4af778513b4ce239b2c1d3422254a4ccca09d1da6e3c2719fc2\": container with ID starting with 5aaa8bda978bc4af778513b4ce239b2c1d3422254a4ccca09d1da6e3c2719fc2 not found: ID does not exist" Jun 08 22:17:20.800764 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:20.800738 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5cc03a8f-ecc8-41b2-9742-73a0baed7124/alertmanager/0.log" Jun 08 22:17:20.832757 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:20.832733 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5cc03a8f-ecc8-41b2-9742-73a0baed7124/config-reloader/0.log" Jun 08 22:17:20.862922 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:20.862904 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5cc03a8f-ecc8-41b2-9742-73a0baed7124/kube-rbac-proxy-web/0.log" Jun 08 22:17:20.902049 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:20.902030 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5cc03a8f-ecc8-41b2-9742-73a0baed7124/kube-rbac-proxy/0.log" Jun 08 22:17:20.933730 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:20.933708 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5cc03a8f-ecc8-41b2-9742-73a0baed7124/kube-rbac-proxy-metric/0.log" Jun 08 22:17:20.966267 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:20.966243 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5cc03a8f-ecc8-41b2-9742-73a0baed7124/prom-label-proxy/0.log" Jun 08 22:17:20.998141 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:20.998121 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7e5dd8d-4cc4-4295-9a64-04031409cd76" path="/var/lib/kubelet/pods/d7e5dd8d-4cc4-4295-9a64-04031409cd76/volumes" Jun 08 22:17:20.999474 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:20.999457 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5cc03a8f-ecc8-41b2-9742-73a0baed7124/init-config-reloader/0.log" Jun 08 22:17:21.087991 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:21.087938 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-xczlj_1214154d-d56b-44a1-8516-4bc1e6c479e1/kube-state-metrics/0.log" Jun 08 22:17:21.116268 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:21.116248 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-xczlj_1214154d-d56b-44a1-8516-4bc1e6c479e1/kube-rbac-proxy-main/0.log" Jun 08 22:17:21.143959 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:21.143920 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-xczlj_1214154d-d56b-44a1-8516-4bc1e6c479e1/kube-rbac-proxy-self/0.log" Jun 08 22:17:21.244213 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:21.244194 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-ps5jl_fe29fe6d-4d4b-4ba0-a1ca-f7393e8f20bb/monitoring-plugin/0.log" Jun 08 22:17:21.279863 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:21.279847 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-blqfm_7a600274-2930-4a53-a063-6442a3d01484/node-exporter/0.log" Jun 08 22:17:21.307361 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:21.307347 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-blqfm_7a600274-2930-4a53-a063-6442a3d01484/kube-rbac-proxy/0.log" Jun 08 22:17:21.349886 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:21.349826 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-blqfm_7a600274-2930-4a53-a063-6442a3d01484/init-textfile/0.log" Jun 08 22:17:21.605497 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:21.605429 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91842703-d517-401a-8b4b-54679e40bae7/prometheus/0.log" Jun 08 22:17:21.659008 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:21.658981 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91842703-d517-401a-8b4b-54679e40bae7/config-reloader/0.log" Jun 08 22:17:21.713726 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:21.713708 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91842703-d517-401a-8b4b-54679e40bae7/thanos-sidecar/0.log" Jun 08 22:17:21.765542 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:21.765524 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91842703-d517-401a-8b4b-54679e40bae7/kube-rbac-proxy-web/0.log" Jun 08 22:17:21.819372 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:21.819353 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91842703-d517-401a-8b4b-54679e40bae7/kube-rbac-proxy/0.log" Jun 08 22:17:21.844734 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:21.844717 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91842703-d517-401a-8b4b-54679e40bae7/kube-rbac-proxy-thanos/0.log" Jun 08 22:17:21.867071 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:21.867020 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91842703-d517-401a-8b4b-54679e40bae7/init-config-reloader/0.log" Jun 08 22:17:21.944000 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:21.943978 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-n844j_66f9c945-78fc-4b4d-848e-88ca9b50ae38/prometheus-operator-admission-webhook/0.log" Jun 08 22:17:22.059876 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:22.059847 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-795c5b9978-5zpj4_e8c22265-f320-4b35-ab31-eee221f493b9/thanos-query/0.log" Jun 08 22:17:22.080798 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:22.080774 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-795c5b9978-5zpj4_e8c22265-f320-4b35-ab31-eee221f493b9/kube-rbac-proxy-web/0.log" Jun 08 22:17:22.103281 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:22.103257 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-795c5b9978-5zpj4_e8c22265-f320-4b35-ab31-eee221f493b9/kube-rbac-proxy/0.log" Jun 08 22:17:22.124927 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:22.124877 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-795c5b9978-5zpj4_e8c22265-f320-4b35-ab31-eee221f493b9/prom-label-proxy/0.log" Jun 08 22:17:22.146200 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:22.146179 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-795c5b9978-5zpj4_e8c22265-f320-4b35-ab31-eee221f493b9/kube-rbac-proxy-rules/0.log" Jun 08 22:17:22.169398 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:22.169379 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-795c5b9978-5zpj4_e8c22265-f320-4b35-ab31-eee221f493b9/kube-rbac-proxy-metrics/0.log" Jun 08 22:17:23.855607 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:23.855532 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rzp7c_ecc09a2e-0137-45ae-9982-e8f714b875c5/console-operator/2.log" Jun 08 22:17:23.859723 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:23.859697 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rzp7c_ecc09a2e-0137-45ae-9982-e8f714b875c5/console-operator/3.log" Jun 08 22:17:24.589182 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.589121 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp"] Jun 08 22:17:24.589882 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.589857 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7e5dd8d-4cc4-4295-9a64-04031409cd76" containerName="copy" Jun 08 22:17:24.589882 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.589884 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7e5dd8d-4cc4-4295-9a64-04031409cd76" containerName="copy" Jun 08 22:17:24.590050 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.589899 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7e5dd8d-4cc4-4295-9a64-04031409cd76" containerName="gather" Jun 08 22:17:24.590050 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.589908 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7e5dd8d-4cc4-4295-9a64-04031409cd76" containerName="gather" Jun 08 22:17:24.590147 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.590102 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7e5dd8d-4cc4-4295-9a64-04031409cd76" containerName="copy" Jun 08 22:17:24.590147 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.590124 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7e5dd8d-4cc4-4295-9a64-04031409cd76" containerName="gather" Jun 08 22:17:24.594114 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.594092 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp" Jun 08 22:17:24.597321 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.597301 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jh4bb\"/\"kube-root-ca.crt\"" Jun 08 22:17:24.597715 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.597699 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jh4bb\"/\"openshift-service-ca.crt\"" Jun 08 22:17:24.599226 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.599200 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jh4bb\"/\"default-dockercfg-jc5cw\"" Jun 08 22:17:24.600360 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.600339 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp"] Jun 08 22:17:24.627009 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.626987 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e76ad30-c009-463b-ba1d-f35c2e6c0e54-lib-modules\") pod \"perf-node-gather-daemonset-cf6fp\" (UID: \"2e76ad30-c009-463b-ba1d-f35c2e6c0e54\") " pod="openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp" Jun 08 22:17:24.627114 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.627015 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e76ad30-c009-463b-ba1d-f35c2e6c0e54-sys\") pod \"perf-node-gather-daemonset-cf6fp\" (UID: \"2e76ad30-c009-463b-ba1d-f35c2e6c0e54\") " pod="openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp" Jun 08 22:17:24.627114 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.627033 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2e76ad30-c009-463b-ba1d-f35c2e6c0e54-podres\") pod \"perf-node-gather-daemonset-cf6fp\" (UID: \"2e76ad30-c009-463b-ba1d-f35c2e6c0e54\") " pod="openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp" Jun 08 22:17:24.627114 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.627078 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppwrw\" (UniqueName: \"kubernetes.io/projected/2e76ad30-c009-463b-ba1d-f35c2e6c0e54-kube-api-access-ppwrw\") pod \"perf-node-gather-daemonset-cf6fp\" (UID: \"2e76ad30-c009-463b-ba1d-f35c2e6c0e54\") " pod="openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp" Jun 08 22:17:24.627239 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.627127 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2e76ad30-c009-463b-ba1d-f35c2e6c0e54-proc\") pod \"perf-node-gather-daemonset-cf6fp\" (UID: \"2e76ad30-c009-463b-ba1d-f35c2e6c0e54\") " pod="openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp" Jun 08 22:17:24.727701 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.727675 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppwrw\" (UniqueName: \"kubernetes.io/projected/2e76ad30-c009-463b-ba1d-f35c2e6c0e54-kube-api-access-ppwrw\") pod \"perf-node-gather-daemonset-cf6fp\" (UID: \"2e76ad30-c009-463b-ba1d-f35c2e6c0e54\") " pod="openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp" Jun 08 22:17:24.727845 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.727727 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2e76ad30-c009-463b-ba1d-f35c2e6c0e54-proc\") pod \"perf-node-gather-daemonset-cf6fp\" (UID: \"2e76ad30-c009-463b-ba1d-f35c2e6c0e54\") " pod="openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp" Jun 08 22:17:24.727845 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.727751 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e76ad30-c009-463b-ba1d-f35c2e6c0e54-lib-modules\") pod \"perf-node-gather-daemonset-cf6fp\" (UID: \"2e76ad30-c009-463b-ba1d-f35c2e6c0e54\") " pod="openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp" Jun 08 22:17:24.727845 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.727811 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2e76ad30-c009-463b-ba1d-f35c2e6c0e54-proc\") pod \"perf-node-gather-daemonset-cf6fp\" (UID: \"2e76ad30-c009-463b-ba1d-f35c2e6c0e54\") " pod="openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp" Jun 08 22:17:24.727949 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.727849 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e76ad30-c009-463b-ba1d-f35c2e6c0e54-sys\") pod \"perf-node-gather-daemonset-cf6fp\" (UID: \"2e76ad30-c009-463b-ba1d-f35c2e6c0e54\") " pod="openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp" Jun 08 22:17:24.727949 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.727857 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e76ad30-c009-463b-ba1d-f35c2e6c0e54-lib-modules\") pod \"perf-node-gather-daemonset-cf6fp\" (UID: \"2e76ad30-c009-463b-ba1d-f35c2e6c0e54\") " pod="openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp" Jun 08 22:17:24.727949 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.727873 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2e76ad30-c009-463b-ba1d-f35c2e6c0e54-podres\") pod \"perf-node-gather-daemonset-cf6fp\" (UID: \"2e76ad30-c009-463b-ba1d-f35c2e6c0e54\") " pod="openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp" Jun 08 22:17:24.727949 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.727899 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e76ad30-c009-463b-ba1d-f35c2e6c0e54-sys\") pod \"perf-node-gather-daemonset-cf6fp\" (UID: \"2e76ad30-c009-463b-ba1d-f35c2e6c0e54\") " pod="openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp" Jun 08 22:17:24.728094 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.727968 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2e76ad30-c009-463b-ba1d-f35c2e6c0e54-podres\") pod \"perf-node-gather-daemonset-cf6fp\" (UID: \"2e76ad30-c009-463b-ba1d-f35c2e6c0e54\") " pod="openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp" Jun 08 22:17:24.736019 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.736000 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppwrw\" (UniqueName: \"kubernetes.io/projected/2e76ad30-c009-463b-ba1d-f35c2e6c0e54-kube-api-access-ppwrw\") pod \"perf-node-gather-daemonset-cf6fp\" (UID: \"2e76ad30-c009-463b-ba1d-f35c2e6c0e54\") " pod="openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp" Jun 08 22:17:24.784775 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.784755 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-zn4gt_a3d06fd7-338d-40ab-8562-beca27147b46/volume-data-source-validator/0.log" Jun 08 22:17:24.904407 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:24.904350 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp" Jun 08 22:17:25.029815 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:25.029788 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp"] Jun 08 22:17:25.032480 ip-10-0-138-88 kubenswrapper[2549]: W0608 22:17:25.032457 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2e76ad30_c009_463b_ba1d_f35c2e6c0e54.slice/crio-d25cbb886955d775e5ae2805655014c84849fddf0958f62c04420b0d44f2f2b7 WatchSource:0}: Error finding container d25cbb886955d775e5ae2805655014c84849fddf0958f62c04420b0d44f2f2b7: Status 404 returned error can't find the container with id d25cbb886955d775e5ae2805655014c84849fddf0958f62c04420b0d44f2f2b7 Jun 08 22:17:25.514999 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:25.514968 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp" event={"ID":"2e76ad30-c009-463b-ba1d-f35c2e6c0e54","Type":"ContainerStarted","Data":"2ea60a27cc40a0bb4c3080e152a8a84eaa7ea1c084027f2dda2a3f8d4bd23372"} Jun 08 22:17:25.515231 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:25.515026 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp" event={"ID":"2e76ad30-c009-463b-ba1d-f35c2e6c0e54","Type":"ContainerStarted","Data":"d25cbb886955d775e5ae2805655014c84849fddf0958f62c04420b0d44f2f2b7"} Jun 08 22:17:25.515231 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:25.515068 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp" Jun 08 22:17:25.533053 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:25.533001 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp" podStartSLOduration=1.53298476 podStartE2EDuration="1.53298476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 22:17:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:17:25.531775621 +0000 UTC m=+1197.080662409" watchObservedRunningTime="2026-06-08 22:17:25.53298476 +0000 UTC m=+1197.081871548" Jun 08 22:17:25.631231 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:25.631202 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ckthn_4d30ffba-5f7b-446b-baef-d8b7b9cd9d50/dns/0.log" Jun 08 22:17:25.652734 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:25.652711 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ckthn_4d30ffba-5f7b-446b-baef-d8b7b9cd9d50/kube-rbac-proxy/0.log" Jun 08 22:17:25.730728 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:25.730708 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j7qkw_88a8a02d-821d-4ef8-b073-8901d5505dd2/dns-node-resolver/0.log" Jun 08 22:17:26.273545 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:26.273501 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-psfzx_a28deb3e-bbc1-4ce0-a5b0-717125c9d872/node-ca/0.log" Jun 08 22:17:27.016712 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:27.016683 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76bc7cf865-5m4b9_be1775e2-0996-430c-bc0f-0ad7f5faeedb/router/0.log" Jun 08 22:17:27.349935 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:27.349868 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mn57q_fdd228a4-64ed-47a7-95c8-2144b2afafcd/serve-healthcheck-canary/0.log" Jun 08 22:17:27.846531 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:27.846503 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xkhl7_173d56f5-dd98-4f76-ae32-fb2963c58134/kube-rbac-proxy/0.log" Jun 08 22:17:27.866033 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:27.866011 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xkhl7_173d56f5-dd98-4f76-ae32-fb2963c58134/exporter/0.log" Jun 08 22:17:27.884383 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:27.884363 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xkhl7_173d56f5-dd98-4f76-ae32-fb2963c58134/extractor/0.log" Jun 08 22:17:29.004077 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:29.004048 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rzp7c_ecc09a2e-0137-45ae-9982-e8f714b875c5/console-operator/2.log" Jun 08 22:17:29.008666 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:29.008644 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rzp7c_ecc09a2e-0137-45ae-9982-e8f714b875c5/console-operator/2.log" Jun 08 22:17:31.527952 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:31.527924 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jh4bb/perf-node-gather-daemonset-cf6fp" Jun 08 22:17:34.290918 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:34.290895 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pp9j6_7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6/kube-multus-additional-cni-plugins/0.log" Jun 08 22:17:34.312652 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:34.312626 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pp9j6_7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6/egress-router-binary-copy/0.log" Jun 08 22:17:34.333399 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:34.333376 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pp9j6_7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6/cni-plugins/0.log" Jun 08 22:17:34.358628 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:34.358604 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pp9j6_7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6/bond-cni-plugin/0.log" Jun 08 22:17:34.378850 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:34.378830 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pp9j6_7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6/routeoverride-cni/0.log" Jun 08 22:17:34.404515 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:34.404498 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pp9j6_7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6/whereabouts-cni-bincopy/0.log" Jun 08 22:17:34.428302 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:34.428277 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pp9j6_7e2d3d71-aa21-4d3b-8b72-f27cd1cb5fc6/whereabouts-cni/0.log" Jun 08 22:17:34.626220 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:34.626112 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dddlj_5dda922b-0f2f-4727-9730-6988a0b48044/kube-multus/0.log" Jun 08 22:17:34.702568 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:34.702513 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4pmzz_12b6a387-cd80-4157-8c91-00fdb3ee3676/network-metrics-daemon/0.log" Jun 08 22:17:34.721932 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:34.721908 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4pmzz_12b6a387-cd80-4157-8c91-00fdb3ee3676/kube-rbac-proxy/0.log" Jun 08 22:17:35.841356 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:35.841331 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_45dc9f10-d2cc-4e5c-8871-09027d251cb4/ovn-controller/0.log" Jun 08 22:17:35.865559 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:35.865537 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_45dc9f10-d2cc-4e5c-8871-09027d251cb4/ovn-acl-logging/0.log" Jun 08 22:17:35.890561 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:35.890541 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_45dc9f10-d2cc-4e5c-8871-09027d251cb4/kube-rbac-proxy-node/0.log" Jun 08 22:17:35.914689 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:35.914669 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_45dc9f10-d2cc-4e5c-8871-09027d251cb4/kube-rbac-proxy-ovn-metrics/0.log" Jun 08 22:17:35.932595 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:35.932573 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_45dc9f10-d2cc-4e5c-8871-09027d251cb4/northd/0.log" Jun 08 22:17:35.955496 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:35.955478 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_45dc9f10-d2cc-4e5c-8871-09027d251cb4/nbdb/0.log" Jun 08 22:17:35.976226 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:35.976210 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_45dc9f10-d2cc-4e5c-8871-09027d251cb4/sbdb/0.log" Jun 08 22:17:36.015835 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:36.015820 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qqzs7_45dc9f10-d2cc-4e5c-8871-09027d251cb4/ovnkube-controller/0.log" Jun 08 22:17:37.112175 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:37.112118 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-dbd9cf844-ztclm_f108f1d1-011a-483f-a7f6-a8e0ec0fcc9a/check-endpoints/0.log" Jun 08 22:17:37.181792 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:37.181764 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-vs6km_38f827a0-8c60-4ca9-8a81-98e05477d762/network-check-target-container/0.log" Jun 08 22:17:38.055774 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:38.055747 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-4wv7c_96e292e7-6c56-4a6c-82cb-8a963bb54608/iptables-alerter/0.log" Jun 08 22:17:38.762019 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:38.761994 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-z6j2x_863504e7-abe7-4100-8f40-55c12bb6a39b/tuned/0.log" Jun 08 22:17:40.434520 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:40.434492 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-276ck_198f4f07-ca89-4683-8bfd-2bc9abb51f22/cluster-samples-operator/0.log" Jun 08 22:17:40.449691 ip-10-0-138-88 kubenswrapper[2549]: I0608 22:17:40.449659 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-276ck_198f4f07-ca89-4683-8bfd-2bc9abb51f22/cluster-samples-operator-watch/0.log"