Sep 07 16:19:59.494741 ip-10-0-141-30 systemd[1]: Starting Kubernetes Kubelet... Sep 07 16:19:59.931659 ip-10-0-141-30 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 16:19:59.931659 ip-10-0-141-30 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 07 16:19:59.931659 ip-10-0-141-30 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 16:19:59.931659 ip-10-0-141-30 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 07 16:19:59.931659 ip-10-0-141-30 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 16:19:59.934143 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.934032 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 07 16:19:59.937069 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937043 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 16:19:59.937069 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937066 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 16:19:59.937069 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937071 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 16:19:59.937175 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937074 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 16:19:59.937175 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937078 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 16:19:59.937175 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937081 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 16:19:59.937175 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937084 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 16:19:59.937175 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937087 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 16:19:59.937175 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937090 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 16:19:59.937175 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937093 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 16:19:59.937175 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937096 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 16:19:59.937175 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937099 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 16:19:59.937175 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937102 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 07 16:19:59.937175 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937106 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 16:19:59.937175 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937111 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 16:19:59.937175 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937113 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 16:19:59.937175 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937116 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 16:19:59.937175 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937119 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 16:19:59.937175 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937121 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 16:19:59.937175 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937124 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 16:19:59.937175 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937127 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 16:19:59.937175 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937129 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 16:19:59.937175 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937132 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 16:19:59.937678 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937134 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 16:19:59.937678 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937137 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 16:19:59.937678 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937140 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 16:19:59.937678 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937142 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 16:19:59.937678 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937145 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 16:19:59.937678 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937148 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 16:19:59.937678 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937152 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 16:19:59.937678 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937156 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 16:19:59.937678 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937159 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 16:19:59.937678 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937162 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 16:19:59.937678 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937165 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 16:19:59.937678 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937168 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 16:19:59.937678 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937171 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 16:19:59.937678 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937176 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 16:19:59.937678 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937181 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 16:19:59.937678 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937184 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 16:19:59.937678 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937187 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 16:19:59.937678 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937190 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 16:19:59.937678 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937193 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 16:19:59.938162 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937195 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 16:19:59.938162 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937198 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 16:19:59.938162 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937201 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 16:19:59.938162 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937204 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 16:19:59.938162 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937206 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 16:19:59.938162 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937209 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 16:19:59.938162 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937212 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 16:19:59.938162 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937215 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 16:19:59.938162 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937217 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 16:19:59.938162 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937220 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 16:19:59.938162 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937223 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 16:19:59.938162 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937225 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 16:19:59.938162 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937228 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 16:19:59.938162 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937230 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 16:19:59.938162 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937233 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 16:19:59.938162 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937236 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 16:19:59.938162 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937238 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 16:19:59.938162 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937241 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 16:19:59.938162 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937243 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 16:19:59.938162 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937246 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 16:19:59.938671 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937249 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 16:19:59.938671 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937251 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 16:19:59.938671 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937254 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 16:19:59.938671 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937257 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 16:19:59.938671 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937259 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 16:19:59.938671 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937261 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 16:19:59.938671 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937265 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 16:19:59.938671 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937268 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 16:19:59.938671 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937271 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 16:19:59.938671 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937274 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 16:19:59.938671 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937276 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 16:19:59.938671 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937279 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 16:19:59.938671 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937281 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 16:19:59.938671 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937284 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 16:19:59.938671 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937286 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 16:19:59.938671 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937289 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 16:19:59.938671 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937292 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 16:19:59.938671 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937297 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 16:19:59.938671 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937300 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 16:19:59.938671 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937303 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 16:19:59.939163 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937306 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 16:19:59.939163 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937309 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 16:19:59.939163 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937312 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 16:19:59.939163 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937315 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 16:19:59.939163 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937318 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 16:19:59.939163 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937321 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 16:19:59.939163 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937324 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 16:19:59.939163 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937327 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 16:19:59.939163 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937330 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 16:19:59.939163 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937332 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 16:19:59.939163 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937335 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 16:19:59.939163 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937338 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 16:19:59.939163 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937340 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 16:19:59.939163 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937342 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 16:19:59.939163 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937345 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 16:19:59.939163 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937347 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 16:19:59.939163 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.937350 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 16:19:59.939163 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938116 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 16:19:59.939163 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938124 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 16:19:59.939163 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938127 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 16:19:59.939726 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938134 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 16:19:59.939726 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938138 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 16:19:59.939726 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938141 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 16:19:59.939726 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938143 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 16:19:59.939726 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938146 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 16:19:59.939726 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938149 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 16:19:59.939726 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938152 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 16:19:59.939726 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938155 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 16:19:59.939726 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938157 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 16:19:59.939726 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938161 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 16:19:59.939726 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938164 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 16:19:59.939726 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938167 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 16:19:59.939726 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938169 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 16:19:59.939726 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938172 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 16:19:59.939726 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938175 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 16:19:59.939726 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938178 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 16:19:59.939726 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938181 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 16:19:59.939726 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938184 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 16:19:59.939726 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938186 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 16:19:59.939726 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938189 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 16:19:59.940227 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938192 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 16:19:59.940227 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938194 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 16:19:59.940227 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938197 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 16:19:59.940227 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938200 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 16:19:59.940227 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938202 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 16:19:59.940227 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938205 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 16:19:59.940227 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938207 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 16:19:59.940227 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938210 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 16:19:59.940227 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938212 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 16:19:59.940227 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938215 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 16:19:59.940227 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938219 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 16:19:59.940227 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938222 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 16:19:59.940227 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938225 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 16:19:59.940227 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938228 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 16:19:59.940227 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938230 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 16:19:59.940227 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938233 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 16:19:59.940227 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938236 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 16:19:59.940227 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938238 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 16:19:59.940227 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938241 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 16:19:59.940227 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938243 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 16:19:59.940742 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938246 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 16:19:59.940742 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938249 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 16:19:59.940742 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938252 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 16:19:59.940742 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938255 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 16:19:59.940742 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938257 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 16:19:59.940742 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938260 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 16:19:59.940742 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938262 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 16:19:59.940742 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938266 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 16:19:59.940742 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938269 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 16:19:59.940742 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938272 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 16:19:59.940742 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938275 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 16:19:59.940742 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938277 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 16:19:59.940742 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938280 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 16:19:59.940742 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938282 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 16:19:59.940742 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938285 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 16:19:59.940742 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938288 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 16:19:59.940742 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938290 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 16:19:59.940742 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938293 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 16:19:59.940742 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938295 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 16:19:59.940742 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938298 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 16:19:59.941239 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938301 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 16:19:59.941239 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938303 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 16:19:59.941239 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938306 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 16:19:59.941239 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938309 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 16:19:59.941239 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938312 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 16:19:59.941239 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938315 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 16:19:59.941239 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938318 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 16:19:59.941239 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938320 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 16:19:59.941239 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938323 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 16:19:59.941239 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938325 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 16:19:59.941239 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938328 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 16:19:59.941239 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938330 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 16:19:59.941239 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938333 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 16:19:59.941239 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938335 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 16:19:59.941239 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938338 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 16:19:59.941239 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938340 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 16:19:59.941239 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938343 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 16:19:59.941239 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938345 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 07 16:19:59.941239 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938348 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 16:19:59.941239 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938351 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 16:19:59.941764 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938354 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 16:19:59.941764 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938357 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 16:19:59.941764 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938359 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 16:19:59.941764 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938363 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 16:19:59.941764 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938383 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 16:19:59.941764 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938387 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 16:19:59.941764 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938391 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 16:19:59.941764 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938394 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 16:19:59.941764 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938396 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 16:19:59.941764 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938400 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 16:19:59.941764 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938403 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 16:19:59.941764 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938407 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 16:19:59.941764 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938410 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 16:19:59.941764 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938414 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 16:19:59.941764 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938418 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 16:19:59.941764 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938421 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 16:19:59.941764 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938837 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 16:19:59.941764 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938842 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 16:19:59.941764 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938846 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 16:19:59.942360 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938849 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 16:19:59.942360 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938853 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 16:19:59.942360 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938856 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 16:19:59.942360 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938859 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 16:19:59.942360 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938862 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 16:19:59.942360 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938865 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 16:19:59.942360 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938868 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 16:19:59.942360 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938871 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 16:19:59.942360 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938873 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 16:19:59.942360 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938876 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 16:19:59.942360 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938879 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 16:19:59.942360 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938881 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 16:19:59.942360 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938884 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 16:19:59.942360 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938888 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 16:19:59.942360 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938891 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 16:19:59.942360 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938894 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 16:19:59.942360 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938897 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 16:19:59.942360 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938899 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 16:19:59.942360 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938902 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 16:19:59.942360 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938904 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 16:19:59.942875 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938907 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 16:19:59.942875 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938910 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 16:19:59.942875 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938912 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 16:19:59.942875 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938915 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 16:19:59.942875 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938918 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 16:19:59.942875 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938921 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 16:19:59.942875 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938925 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 16:19:59.942875 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938928 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 16:19:59.942875 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938933 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 16:19:59.942875 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938936 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 16:19:59.942875 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938939 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 16:19:59.942875 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938942 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 16:19:59.942875 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938946 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 16:19:59.942875 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938950 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 16:19:59.942875 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938952 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 16:19:59.942875 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938955 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 16:19:59.942875 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938958 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 16:19:59.942875 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938961 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 16:19:59.942875 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938964 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 16:19:59.943341 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938967 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 16:19:59.943341 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938969 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 16:19:59.943341 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938972 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 16:19:59.943341 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938975 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 16:19:59.943341 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938979 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 16:19:59.943341 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938982 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 16:19:59.943341 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938985 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 16:19:59.943341 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938988 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 16:19:59.943341 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938990 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 16:19:59.943341 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938993 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 16:19:59.943341 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938996 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 16:19:59.943341 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.938999 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 16:19:59.943341 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939002 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 16:19:59.943341 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939004 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 16:19:59.943341 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939007 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 16:19:59.943341 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939010 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 16:19:59.943341 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939012 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 16:19:59.943341 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939015 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 16:19:59.943341 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939017 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 16:19:59.943341 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939020 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 16:19:59.943855 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939026 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 16:19:59.943855 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939028 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 16:19:59.943855 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939031 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 16:19:59.943855 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939033 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 16:19:59.943855 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939036 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 07 16:19:59.943855 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939039 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 16:19:59.943855 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939042 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 16:19:59.943855 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939047 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 16:19:59.943855 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939050 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 16:19:59.943855 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939053 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 16:19:59.943855 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939056 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 16:19:59.943855 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939059 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 16:19:59.943855 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939061 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 16:19:59.943855 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939064 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 16:19:59.943855 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939066 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 16:19:59.943855 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939069 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 16:19:59.943855 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939072 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 16:19:59.943855 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939075 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 16:19:59.943855 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939078 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 16:19:59.944325 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939081 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 16:19:59.944325 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939083 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 16:19:59.944325 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939087 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 16:19:59.944325 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939089 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 16:19:59.944325 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939092 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 16:19:59.944325 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939095 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 16:19:59.944325 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939098 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 16:19:59.944325 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939100 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 16:19:59.944325 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939103 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 16:19:59.944325 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939106 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 16:19:59.944325 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939108 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 16:19:59.944325 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939111 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 16:19:59.944325 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939113 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 16:19:59.944325 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939118 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 16:19:59.944325 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939121 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 16:19:59.944325 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939124 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 16:19:59.944325 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939126 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 16:19:59.944325 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939129 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 16:19:59.944325 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939234 2561 flags.go:64] FLAG: --address="0.0.0.0" Sep 07 16:19:59.944325 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939283 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939293 2561 flags.go:64] FLAG: --anonymous-auth="true" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939298 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939304 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939307 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939311 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939317 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939320 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939323 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939327 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939331 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939334 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939338 2561 flags.go:64] FLAG: --cgroup-root="" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939341 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939344 2561 flags.go:64] FLAG: --client-ca-file="" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939347 2561 flags.go:64] FLAG: --cloud-provider="external" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939350 2561 flags.go:64] FLAG: --cluster-dns="[]" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939354 2561 flags.go:64] FLAG: --cluster-domain="" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939357 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939361 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939364 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939380 2561 flags.go:64] FLAG: --container-log-max-files="5" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939384 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 07 16:19:59.944873 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939387 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939391 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939394 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939401 2561 flags.go:64] FLAG: --contention-profiling="false" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939404 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939407 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939411 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939414 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939419 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939422 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939425 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939429 2561 flags.go:64] FLAG: --enable-load-reader="false" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939432 2561 flags.go:64] FLAG: --enable-server="true" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939435 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939440 2561 flags.go:64] FLAG: --event-burst="100" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939444 2561 flags.go:64] FLAG: --event-qps="50" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939447 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939450 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939453 2561 flags.go:64] FLAG: --eviction-hard="" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939457 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939460 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939463 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939466 2561 flags.go:64] FLAG: --eviction-soft="" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939470 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939472 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 07 16:19:59.945456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939475 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939479 2561 flags.go:64] FLAG: --experimental-mounter-path="" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939482 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939485 2561 flags.go:64] FLAG: --fail-swap-on="true" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939488 2561 flags.go:64] FLAG: --feature-gates="" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939492 2561 flags.go:64] FLAG: --file-check-frequency="20s" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939496 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939499 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939503 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939506 2561 flags.go:64] FLAG: --healthz-port="10248" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939511 2561 flags.go:64] FLAG: --help="false" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939514 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-141-30.ec2.internal" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939517 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939520 2561 flags.go:64] FLAG: --http-check-frequency="20s" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939524 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939527 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939531 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939534 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939537 2561 flags.go:64] FLAG: --image-service-endpoint="" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939541 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939544 2561 flags.go:64] FLAG: --kube-api-burst="100" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939547 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939550 2561 flags.go:64] FLAG: --kube-api-qps="50" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939553 2561 flags.go:64] FLAG: --kube-reserved="" Sep 07 16:19:59.946093 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939556 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939559 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939562 2561 flags.go:64] FLAG: --kubelet-cgroups="" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939566 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939569 2561 flags.go:64] FLAG: --lock-file="" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939572 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939575 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939578 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939584 2561 flags.go:64] FLAG: --log-json-split-stream="false" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939587 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939590 2561 flags.go:64] FLAG: --log-text-split-stream="false" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939593 2561 flags.go:64] FLAG: --logging-format="text" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939596 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939599 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939603 2561 flags.go:64] FLAG: --manifest-url="" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939606 2561 flags.go:64] FLAG: --manifest-url-header="" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939610 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939613 2561 flags.go:64] FLAG: --max-open-files="1000000" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939621 2561 flags.go:64] FLAG: --max-pods="110" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939624 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939627 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939630 2561 flags.go:64] FLAG: --memory-manager-policy="None" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939634 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939637 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939639 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 07 16:19:59.946719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939643 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939651 2561 flags.go:64] FLAG: --node-status-max-images="50" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939654 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939658 2561 flags.go:64] FLAG: --oom-score-adj="-999" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939661 2561 flags.go:64] FLAG: --pod-cidr="" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939664 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939671 2561 flags.go:64] FLAG: --pod-manifest-path="" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939674 2561 flags.go:64] FLAG: --pod-max-pids="-1" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939677 2561 flags.go:64] FLAG: --pods-per-core="0" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939681 2561 flags.go:64] FLAG: --port="10250" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939686 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939689 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c75bc30ce7b3c625" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939692 2561 flags.go:64] FLAG: --qos-reserved="" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939695 2561 flags.go:64] FLAG: --read-only-port="10255" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939698 2561 flags.go:64] FLAG: --register-node="true" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939701 2561 flags.go:64] FLAG: --register-with-taints="" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939706 2561 flags.go:64] FLAG: --registry-burst="10" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939709 2561 flags.go:64] FLAG: --registry-qps="5" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939712 2561 flags.go:64] FLAG: --reserved-cpus="" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939715 2561 flags.go:64] FLAG: --reserved-memory="" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939719 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939722 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939725 2561 flags.go:64] FLAG: --rotate-certificates="false" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939728 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939731 2561 flags.go:64] FLAG: --runonce="false" Sep 07 16:19:59.947347 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939734 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939740 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939743 2561 flags.go:64] FLAG: --seccomp-default="false" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939746 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939749 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939752 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939756 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939759 2561 flags.go:64] FLAG: --storage-driver-password="root" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939762 2561 flags.go:64] FLAG: --storage-driver-secure="false" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939765 2561 flags.go:64] FLAG: --storage-driver-table="stats" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939768 2561 flags.go:64] FLAG: --storage-driver-user="root" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939772 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939775 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939778 2561 flags.go:64] FLAG: --system-cgroups="" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939781 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939786 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939790 2561 flags.go:64] FLAG: --tls-cert-file="" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939794 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939798 2561 flags.go:64] FLAG: --tls-min-version="" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939801 2561 flags.go:64] FLAG: --tls-private-key-file="" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939804 2561 flags.go:64] FLAG: --topology-manager-policy="none" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939807 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939810 2561 flags.go:64] FLAG: --topology-manager-scope="container" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939813 2561 flags.go:64] FLAG: --v="2" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939818 2561 flags.go:64] FLAG: --version="false" Sep 07 16:19:59.947989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939822 2561 flags.go:64] FLAG: --vmodule="" Sep 07 16:19:59.948899 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939826 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 07 16:19:59.948899 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.939829 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 07 16:19:59.948899 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939952 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 16:19:59.948899 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939956 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 16:19:59.948899 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939959 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 16:19:59.948899 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939962 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 16:19:59.948899 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939964 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 16:19:59.948899 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939969 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 16:19:59.948899 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939973 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 16:19:59.948899 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939975 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 16:19:59.948899 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939978 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 16:19:59.948899 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939981 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 16:19:59.948899 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939984 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 16:19:59.948899 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939987 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 16:19:59.948899 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939989 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 16:19:59.948899 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939992 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 16:19:59.948899 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939995 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 16:19:59.948899 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.939998 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 16:19:59.948899 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940001 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 16:19:59.949631 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940004 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 16:19:59.949631 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940008 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 16:19:59.949631 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940012 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 16:19:59.949631 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940016 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 16:19:59.949631 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940020 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 16:19:59.949631 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940023 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 16:19:59.949631 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940026 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 16:19:59.949631 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940028 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 16:19:59.949631 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940031 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 16:19:59.949631 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940034 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 16:19:59.949631 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940037 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 16:19:59.949631 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940039 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 16:19:59.949631 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940042 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 16:19:59.949631 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940045 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 16:19:59.949631 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940048 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 16:19:59.949631 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940050 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 16:19:59.949631 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940053 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 16:19:59.949631 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940055 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 16:19:59.949631 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940058 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 16:19:59.950119 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940060 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 16:19:59.950119 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940065 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 16:19:59.950119 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940068 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 16:19:59.950119 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940071 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 16:19:59.950119 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940073 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 16:19:59.950119 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940076 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 16:19:59.950119 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940079 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 16:19:59.950119 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940081 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 16:19:59.950119 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940084 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 16:19:59.950119 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940087 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 16:19:59.950119 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940090 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 16:19:59.950119 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940093 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 16:19:59.950119 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940096 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 16:19:59.950119 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940111 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 16:19:59.950119 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940115 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 16:19:59.950119 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940117 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 16:19:59.950119 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940120 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 16:19:59.950119 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940124 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 16:19:59.950119 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940129 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 16:19:59.950718 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940132 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 16:19:59.950718 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940135 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 16:19:59.950718 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940138 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 07 16:19:59.950718 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940142 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 16:19:59.950718 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940146 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 16:19:59.950718 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940149 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 16:19:59.950718 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940152 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 16:19:59.950718 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940155 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 16:19:59.950718 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940158 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 16:19:59.950718 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940161 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 16:19:59.950718 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940163 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 16:19:59.950718 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940166 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 16:19:59.950718 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940169 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 16:19:59.950718 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940171 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 16:19:59.950718 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940176 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 16:19:59.950718 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940179 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 16:19:59.950718 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940182 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 16:19:59.950718 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940185 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 16:19:59.950718 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940188 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 16:19:59.950718 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940191 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 16:19:59.951220 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940193 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 16:19:59.951220 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940196 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 16:19:59.951220 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940199 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 16:19:59.951220 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940201 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 16:19:59.951220 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940204 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 16:19:59.951220 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940207 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 16:19:59.951220 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940210 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 16:19:59.951220 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940220 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 16:19:59.951220 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940223 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 16:19:59.951220 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940226 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 16:19:59.951220 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940231 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 16:19:59.951220 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940234 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 16:19:59.951220 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940237 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 16:19:59.951220 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940240 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 16:19:59.951220 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940243 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 16:19:59.951220 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940245 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 16:19:59.951220 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940248 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 16:19:59.951220 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940251 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 16:19:59.951220 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940253 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 16:19:59.951220 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940256 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 16:19:59.951743 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940259 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 16:19:59.951743 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940261 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 16:19:59.951743 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940264 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 16:19:59.951743 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.940267 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 16:19:59.951743 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.940943 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 16:19:59.951743 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.948900 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 07 16:19:59.951743 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.948932 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 07 16:19:59.951743 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.948962 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 07 16:19:59.951743 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.948976 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 07 16:19:59.951743 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949151 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 16:19:59.951743 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949158 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 16:19:59.951743 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949164 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 16:19:59.951743 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949169 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 16:19:59.951743 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949176 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 16:19:59.951743 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949180 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 16:19:59.952125 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949185 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 16:19:59.952125 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949189 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 16:19:59.952125 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949194 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 16:19:59.952125 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949204 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 16:19:59.952125 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949208 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 16:19:59.952125 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949212 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 16:19:59.952125 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949217 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 16:19:59.952125 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949223 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 16:19:59.952125 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949228 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 16:19:59.952125 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949232 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 16:19:59.952125 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949237 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 16:19:59.952125 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949244 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 16:19:59.952125 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949251 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 16:19:59.952125 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949256 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 16:19:59.952125 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949262 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 16:19:59.952125 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949272 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 16:19:59.952125 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949277 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 16:19:59.952125 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949282 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 16:19:59.952125 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949288 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 16:19:59.952655 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949293 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 16:19:59.952655 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949298 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 16:19:59.952655 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949302 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 16:19:59.952655 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949307 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 16:19:59.952655 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949314 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 16:19:59.952655 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949319 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 16:19:59.952655 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949327 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 16:19:59.952655 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949332 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 16:19:59.952655 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949336 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 16:19:59.952655 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949340 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 16:19:59.952655 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949345 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 16:19:59.952655 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949349 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 16:19:59.952655 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949354 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 16:19:59.952655 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949359 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 16:19:59.952655 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949363 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 16:19:59.952655 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949381 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 16:19:59.952655 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949387 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 16:19:59.952655 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949391 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 16:19:59.952655 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949401 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 16:19:59.952655 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949405 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 16:19:59.953158 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949410 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 16:19:59.953158 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949415 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 16:19:59.953158 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949419 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 16:19:59.953158 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949428 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 16:19:59.953158 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949435 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 16:19:59.953158 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949442 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 16:19:59.953158 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949447 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 16:19:59.953158 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949452 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 16:19:59.953158 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949457 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 16:19:59.953158 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949461 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 16:19:59.953158 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949466 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 16:19:59.953158 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949475 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 16:19:59.953158 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949479 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 16:19:59.953158 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949532 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 16:19:59.953158 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949540 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 16:19:59.953158 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949544 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 16:19:59.953158 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949549 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 16:19:59.953158 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949556 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 16:19:59.953158 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949566 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 16:19:59.953670 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949712 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 16:19:59.953670 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949717 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 16:19:59.953670 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949722 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 16:19:59.953670 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949726 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 16:19:59.953670 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949731 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 16:19:59.953670 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949735 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 16:19:59.953670 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949739 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 16:19:59.953670 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949744 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 16:19:59.953670 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949748 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 16:19:59.953670 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949752 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 16:19:59.953670 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949757 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 16:19:59.953670 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949761 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 16:19:59.953670 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949765 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 16:19:59.953670 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949769 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 16:19:59.953670 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949774 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 16:19:59.953670 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949778 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 16:19:59.953670 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949783 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 16:19:59.953670 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949787 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 16:19:59.953670 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949791 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 16:19:59.953670 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949796 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 16:19:59.954172 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949800 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 16:19:59.954172 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949804 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 16:19:59.954172 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949808 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 16:19:59.954172 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949812 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 16:19:59.954172 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949817 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 16:19:59.954172 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949821 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 16:19:59.954172 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949826 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 16:19:59.954172 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949831 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 16:19:59.954172 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949835 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 16:19:59.954172 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949839 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 16:19:59.954172 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949844 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 16:19:59.954172 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949849 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 16:19:59.954172 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949853 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 07 16:19:59.954172 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949857 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 16:19:59.954172 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.949862 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 16:19:59.954572 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.949871 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 16:19:59.954572 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950058 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 16:19:59.954572 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950065 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 16:19:59.954572 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950069 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 16:19:59.954572 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950073 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 16:19:59.954572 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950077 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 16:19:59.954572 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950080 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 16:19:59.954572 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950083 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 16:19:59.954572 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950087 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 16:19:59.954572 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950090 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 16:19:59.954572 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950093 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 16:19:59.954572 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950096 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 16:19:59.954572 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950099 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 16:19:59.954572 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950102 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 16:19:59.954930 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950104 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 16:19:59.954930 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950107 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 16:19:59.954930 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950110 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 16:19:59.954930 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950113 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 16:19:59.954930 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950115 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 16:19:59.954930 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950118 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 16:19:59.954930 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950121 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 07 16:19:59.954930 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950124 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 16:19:59.954930 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950127 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 16:19:59.954930 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950130 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 16:19:59.954930 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950134 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 16:19:59.954930 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950137 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 16:19:59.954930 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950140 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 16:19:59.954930 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950143 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 16:19:59.954930 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950145 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 16:19:59.954930 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950148 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 16:19:59.954930 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950150 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 16:19:59.954930 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950153 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 16:19:59.954930 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950156 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 16:19:59.954930 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950159 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 16:19:59.955528 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950161 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 16:19:59.955528 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950164 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 16:19:59.955528 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950166 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 16:19:59.955528 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950169 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 16:19:59.955528 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950172 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 16:19:59.955528 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950174 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 16:19:59.955528 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950177 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 16:19:59.955528 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950180 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 16:19:59.955528 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950183 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 16:19:59.955528 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950187 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 16:19:59.955528 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950190 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 16:19:59.955528 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950193 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 16:19:59.955528 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950196 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 16:19:59.955528 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950199 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 16:19:59.955528 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950202 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 16:19:59.955528 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950204 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 16:19:59.955528 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950207 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 16:19:59.955528 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950210 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 16:19:59.955528 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950213 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 16:19:59.955528 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950215 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 16:19:59.956010 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950218 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 16:19:59.956010 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950221 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 16:19:59.956010 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950226 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 16:19:59.956010 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950229 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 16:19:59.956010 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950232 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 16:19:59.956010 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950235 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 16:19:59.956010 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950239 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 16:19:59.956010 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950242 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 16:19:59.956010 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950245 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 16:19:59.956010 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950247 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 16:19:59.956010 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950250 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 16:19:59.956010 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950252 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 16:19:59.956010 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950255 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 16:19:59.956010 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950257 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 16:19:59.956010 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950260 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 16:19:59.956010 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950263 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 16:19:59.956010 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950265 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 16:19:59.956010 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950268 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 16:19:59.956010 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950271 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 16:19:59.956496 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950273 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 16:19:59.956496 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950276 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 16:19:59.956496 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950279 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 16:19:59.956496 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950281 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 16:19:59.956496 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950284 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 16:19:59.956496 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950286 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 16:19:59.956496 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950298 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 16:19:59.956496 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950301 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 16:19:59.956496 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950304 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 16:19:59.956496 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950306 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 16:19:59.956496 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950309 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 16:19:59.956496 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950311 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 16:19:59.956496 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950315 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 16:19:59.956496 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950317 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 16:19:59.956496 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950320 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 16:19:59.956496 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950324 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 16:19:59.956496 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950332 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 16:19:59.956496 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950334 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 16:19:59.956496 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950337 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 16:19:59.956496 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950340 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 16:19:59.956987 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950343 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 16:19:59.956987 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950346 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 16:19:59.956987 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950349 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 16:19:59.956987 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950352 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 16:19:59.956987 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950354 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 16:19:59.956987 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950357 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 16:19:59.956987 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:19:59.950360 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 16:19:59.956987 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.950364 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 16:19:59.956987 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.950556 2561 server.go:962] "Client rotation is on, will bootstrap in background" Sep 07 16:19:59.956987 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.953562 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 07 16:19:59.956987 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.954503 2561 server.go:1019] "Starting client certificate rotation" Sep 07 16:19:59.956987 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.954606 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 16:19:59.956987 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.954637 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 16:19:59.957314 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.957299 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 16:19:59.959548 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.959519 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 16:19:59.972064 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.972039 2561 log.go:25] "Validated CRI v1 runtime API" Sep 07 16:19:59.985672 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:19:59.985636 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 16:20:00.003729 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.003696 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tsttk" Sep 07 16:20:00.011605 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.011573 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tsttk" Sep 07 16:20:00.033034 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.033007 2561 log.go:25] "Validated CRI v1 image API" Sep 07 16:20:00.034108 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.034091 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 07 16:20:00.037465 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.037436 2561 fs.go:135] Filesystem UUIDs: map[07fe4b9c-d2c4-44dc-9e05-b12e65caaad1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 dfb939f4-6e94-4fa9-ad07-93158954ee5f:/dev/nvme0n1p4] Sep 07 16:20:00.037465 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.037460 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 07 16:20:00.044037 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.043890 2561 manager.go:216] Machine: {Timestamp:2026-09-07 16:20:00.042617205 +0000 UTC m=+0.415212574 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102504 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec248c42fa97afaa25fd072a9d752e00 SystemUUID:ec248c42-fa97-afaa-25fd-072a9d752e00 BootID:3fba07e0-065a-4709-8a97-9b31249bb902 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f7:09:17:5f:b3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f7:09:17:5f:b3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:ab:7b:02:1a:f6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 07 16:20:00.044037 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.044025 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 07 16:20:00.044188 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.044168 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 07 16:20:00.047125 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.047077 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 07 16:20:00.047537 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.047125 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-30.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 07 16:20:00.048864 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.048827 2561 topology_manager.go:138] "Creating topology manager with none policy" Sep 07 16:20:00.048968 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.048875 2561 container_manager_linux.go:309] "Creating device plugin manager" Sep 07 16:20:00.049011 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.048888 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 16:20:00.049193 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.049174 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 16:20:00.050075 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.050061 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 07 16:20:00.053551 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.053531 2561 state_mem.go:36] "Initialized new in-memory state store" Sep 07 16:20:00.053694 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.053683 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 07 16:20:00.053749 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.053721 2561 kubelet.go:486] "Attempting to sync node with API server" Sep 07 16:20:00.053749 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.053732 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 07 16:20:00.053749 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.053749 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 07 16:20:00.053904 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.053759 2561 kubelet.go:398] "Adding apiserver pod source" Sep 07 16:20:00.053904 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.053778 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 07 16:20:00.054211 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.054199 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 16:20:00.054270 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.054218 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 16:20:00.057603 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.057574 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 07 16:20:00.060076 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.060055 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 07 16:20:00.060145 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.060102 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 07 16:20:00.060324 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.060312 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 07 16:20:00.060364 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.060332 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 07 16:20:00.060364 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.060342 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 07 16:20:00.060364 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.060351 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 07 16:20:00.060364 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.060363 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 07 16:20:00.060505 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.060387 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 07 16:20:00.060755 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.060742 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 07 16:20:00.060794 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.060758 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 07 16:20:00.060794 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.060769 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 07 16:20:00.060794 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.060778 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 07 16:20:00.060794 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.060791 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 07 16:20:00.060928 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.060803 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 07 16:20:00.061640 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.061627 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 07 16:20:00.061640 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.061641 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 07 16:20:00.064472 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.064448 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 16:20:00.066029 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.066007 2561 server.go:1268] "Started kubelet" Sep 07 16:20:00.066116 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.066055 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 07 16:20:00.066167 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.066121 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 07 16:20:00.066239 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.066193 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 07 16:20:00.067062 ip-10-0-141-30 systemd[1]: Started Kubernetes Kubelet. Sep 07 16:20:00.067657 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.067636 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 07 16:20:00.067906 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.067796 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 16:20:00.068493 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.068474 2561 server.go:310] "Adding debug handlers to kubelet server" Sep 07 16:20:00.071472 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:00.071436 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 07 16:20:00.071628 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.071611 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 07 16:20:00.072242 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.072224 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 07 16:20:00.072575 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:00.072521 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-30.ec2.internal\" not found" Sep 07 16:20:00.073404 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.073070 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 07 16:20:00.073487 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.073082 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 07 16:20:00.073487 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.073476 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 07 16:20:00.073689 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.073674 2561 reconstruct.go:97] "Volume reconstruction finished" Sep 07 16:20:00.073689 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.073690 2561 reconciler.go:29] "Reconciler: start to sync state" Sep 07 16:20:00.074386 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.074345 2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-30.ec2.internal" not found Sep 07 16:20:00.074483 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.074472 2561 factory.go:153] Registering CRI-O factory Sep 07 16:20:00.074532 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.074486 2561 factory.go:223] Registration of the crio container factory successfully Sep 07 16:20:00.074574 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.074558 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 07 16:20:00.074574 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.074569 2561 factory.go:55] Registering systemd factory Sep 07 16:20:00.074657 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.074580 2561 factory.go:223] Registration of the systemd container factory successfully Sep 07 16:20:00.074657 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.074602 2561 factory.go:103] Registering Raw factory Sep 07 16:20:00.074657 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.074628 2561 manager.go:1196] Started watching for new ooms in manager Sep 07 16:20:00.075041 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.075024 2561 manager.go:349] Starting recovery of all containers Sep 07 16:20:00.076488 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.075711 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 16:20:00.080767 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:00.080727 2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-30.ec2.internal\" not found" node="ip-10-0-141-30.ec2.internal" Sep 07 16:20:00.088632 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.088597 2561 manager.go:354] Recovery completed Sep 07 16:20:00.090642 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:00.090611 2561 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 07 16:20:00.091085 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.091068 2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-30.ec2.internal" not found Sep 07 16:20:00.093876 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.093858 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 16:20:00.096821 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.096799 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasSufficientMemory" Sep 07 16:20:00.096924 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.096840 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 16:20:00.096924 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.096859 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasSufficientPID" Sep 07 16:20:00.097619 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.097601 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 07 16:20:00.097696 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.097618 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 07 16:20:00.097696 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.097642 2561 state_mem.go:36] "Initialized new in-memory state store" Sep 07 16:20:00.097696 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.097644 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 16:20:00.098938 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.098918 2561 policy_none.go:49] "None policy: Start" Sep 07 16:20:00.099030 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.098943 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 07 16:20:00.099030 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.098958 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 07 16:20:00.100078 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.100061 2561 policy_none.go:47] "Start" Sep 07 16:20:00.100598 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.100576 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasSufficientMemory" Sep 07 16:20:00.100681 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.100623 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 16:20:00.100681 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.100637 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasSufficientPID" Sep 07 16:20:00.144619 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.144595 2561 manager.go:337] "Starting Device Plugin manager" Sep 07 16:20:00.151892 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:00.144648 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 07 16:20:00.151892 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.144662 2561 server.go:87] "Starting device plugin registration server" Sep 07 16:20:00.151892 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.144982 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 07 16:20:00.151892 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.144995 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 07 16:20:00.151892 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.145086 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 07 16:20:00.151892 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.145179 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 07 16:20:00.151892 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.145191 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 07 16:20:00.151892 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:00.145673 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 07 16:20:00.151892 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:00.145719 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-30.ec2.internal\" not found" Sep 07 16:20:00.151892 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.148197 2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-30.ec2.internal" not found Sep 07 16:20:00.188499 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.188365 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 07 16:20:00.189665 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.189650 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 07 16:20:00.189754 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.189700 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 07 16:20:00.189754 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.189730 2561 kubelet.go:2448] "Starting kubelet main sync loop" Sep 07 16:20:00.189864 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:00.189780 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 07 16:20:00.191847 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.191825 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 16:20:00.245769 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.245739 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 16:20:00.246770 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.246747 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasSufficientMemory" Sep 07 16:20:00.246886 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.246780 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 16:20:00.246886 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.246792 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeHasSufficientPID" Sep 07 16:20:00.246886 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.246814 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-30.ec2.internal" Sep 07 16:20:00.255627 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.255602 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-30.ec2.internal" Sep 07 16:20:00.255627 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:00.255632 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-30.ec2.internal\": node \"ip-10-0-141-30.ec2.internal\" not found" Sep 07 16:20:00.290103 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.290062 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-30.ec2.internal"] Sep 07 16:20:00.292875 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.292853 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" Sep 07 16:20:00.294223 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.294206 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-30.ec2.internal" Sep 07 16:20:00.310158 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.310131 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" Sep 07 16:20:00.314225 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.314207 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-30.ec2.internal" Sep 07 16:20:00.322316 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.322293 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 16:20:00.324710 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.324690 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 16:20:00.375525 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.375491 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/62c7c6859d381044f69c9ee34ea39d10-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal\" (UID: \"62c7c6859d381044f69c9ee34ea39d10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" Sep 07 16:20:00.375525 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.375526 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62c7c6859d381044f69c9ee34ea39d10-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal\" (UID: \"62c7c6859d381044f69c9ee34ea39d10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" Sep 07 16:20:00.375726 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.375550 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/329a346aaabf8018f97c250e4e6fc8a2-config\") pod \"kube-apiserver-proxy-ip-10-0-141-30.ec2.internal\" (UID: \"329a346aaabf8018f97c250e4e6fc8a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-30.ec2.internal" Sep 07 16:20:00.476118 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.475998 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/62c7c6859d381044f69c9ee34ea39d10-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal\" (UID: \"62c7c6859d381044f69c9ee34ea39d10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" Sep 07 16:20:00.476118 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.476065 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62c7c6859d381044f69c9ee34ea39d10-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal\" (UID: \"62c7c6859d381044f69c9ee34ea39d10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" Sep 07 16:20:00.476118 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.476091 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/329a346aaabf8018f97c250e4e6fc8a2-config\") pod \"kube-apiserver-proxy-ip-10-0-141-30.ec2.internal\" (UID: \"329a346aaabf8018f97c250e4e6fc8a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-30.ec2.internal" Sep 07 16:20:00.476365 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.476126 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62c7c6859d381044f69c9ee34ea39d10-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal\" (UID: \"62c7c6859d381044f69c9ee34ea39d10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" Sep 07 16:20:00.476365 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.476135 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/329a346aaabf8018f97c250e4e6fc8a2-config\") pod \"kube-apiserver-proxy-ip-10-0-141-30.ec2.internal\" (UID: \"329a346aaabf8018f97c250e4e6fc8a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-30.ec2.internal" Sep 07 16:20:00.476365 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.476140 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/62c7c6859d381044f69c9ee34ea39d10-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal\" (UID: \"62c7c6859d381044f69c9ee34ea39d10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" Sep 07 16:20:00.625486 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.625445 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" Sep 07 16:20:00.627834 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.627803 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-30.ec2.internal" Sep 07 16:20:00.954396 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.954196 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 07 16:20:00.954902 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.954579 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 16:20:00.954902 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.954579 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 16:20:00.954902 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:00.954600 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 16:20:01.016544 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.016459 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 16:15:01 +0000 UTC" deadline="2028-04-28 09:11:19.472999614 +0000 UTC" Sep 07 16:20:01.016544 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.016534 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14368h51m18.456468926s" Sep 07 16:20:01.054682 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.054643 2561 apiserver.go:52] "Watching apiserver" Sep 07 16:20:01.062878 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.062849 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 07 16:20:01.063259 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.063225 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-kjfgl","openshift-ovn-kubernetes/ovnkube-node-f72gx","kube-system/global-pull-secret-syncer-ffbmx","kube-system/konnectivity-agent-pc2zg","kube-system/kube-apiserver-proxy-ip-10-0-141-30.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g","openshift-cluster-node-tuning-operator/tuned-2rrvq","openshift-dns/node-resolver-9hdjp","openshift-image-registry/node-ca-l9j65","openshift-multus/network-metrics-daemon-87hv9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal","openshift-multus/multus-additional-cni-plugins-g68wd","openshift-multus/multus-jbxz9","openshift-network-diagnostics/network-check-target-8fkc9"] Sep 07 16:20:01.065897 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.065873 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kjfgl" Sep 07 16:20:01.067297 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.067270 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.068071 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.068041 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rtznc\"" Sep 07 16:20:01.068346 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.068327 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 07 16:20:01.068433 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.068327 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 07 16:20:01.068433 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.068363 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 07 16:20:01.068654 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.068638 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:01.068736 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:01.068716 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ffbmx" podUID="e2409fd0-edee-41fb-b5e2-00c59ce4ea59" Sep 07 16:20:01.069409 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.069393 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 07 16:20:01.069779 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.069758 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 07 16:20:01.069924 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.069785 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 07 16:20:01.069924 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.069873 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gnfl9\"" Sep 07 16:20:01.070082 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.070018 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pc2zg" Sep 07 16:20:01.070445 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.070428 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 07 16:20:01.070544 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.070527 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 07 16:20:01.070603 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.070561 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 07 16:20:01.071268 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.071250 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.071735 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.071719 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 07 16:20:01.072026 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.072011 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 07 16:20:01.072094 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.072075 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 07 16:20:01.072160 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.072094 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sktph\"" Sep 07 16:20:01.072849 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.072833 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.073156 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.073137 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 07 16:20:01.073235 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.073176 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 07 16:20:01.073235 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.073226 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 07 16:20:01.073322 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.073284 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hkd48\"" Sep 07 16:20:01.074381 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.074343 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9hdjp" Sep 07 16:20:01.075402 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.075286 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 07 16:20:01.075502 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.075442 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8fwcr\"" Sep 07 16:20:01.076949 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.075591 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 07 16:20:01.077447 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.077426 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l9j65" Sep 07 16:20:01.078398 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078353 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-host-cni-netd\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.078484 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078410 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/279b7732-ff48-482d-b216-0167445c26ab-env-overrides\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.078484 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078436 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/279b7732-ff48-482d-b216-0167445c26ab-ovn-node-metrics-cert\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.078484 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078462 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 07 16:20:01.078484 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078463 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/072a72a7-30ae-4d3a-8dea-5daa1f14823c-konnectivity-ca\") pod \"konnectivity-agent-pc2zg\" (UID: \"072a72a7-30ae-4d3a-8dea-5daa1f14823c\") " pod="kube-system/konnectivity-agent-pc2zg" Sep 07 16:20:01.078664 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078502 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7536adc5-f824-4a34-ab2f-9505253e1409-hosts-file\") pod \"node-resolver-9hdjp\" (UID: \"7536adc5-f824-4a34-ab2f-9505253e1409\") " pod="openshift-dns/node-resolver-9hdjp" Sep 07 16:20:01.078664 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078569 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cd7tm\"" Sep 07 16:20:01.078664 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078534 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvkbf\" (UniqueName: \"kubernetes.io/projected/7536adc5-f824-4a34-ab2f-9505253e1409-kube-api-access-nvkbf\") pod \"node-resolver-9hdjp\" (UID: \"7536adc5-f824-4a34-ab2f-9505253e1409\") " pod="openshift-dns/node-resolver-9hdjp" Sep 07 16:20:01.078664 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078621 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e9d4b4f-193a-4824-b5b1-4f53e01ddfbe-host-slash\") pod \"iptables-alerter-kjfgl\" (UID: \"1e9d4b4f-193a-4824-b5b1-4f53e01ddfbe\") " pod="openshift-network-operator/iptables-alerter-kjfgl" Sep 07 16:20:01.078664 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078644 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/87a64fe5-87f1-443a-9958-70142ebd8a03-sys-fs\") pod \"aws-ebs-csi-driver-node-68d8g\" (UID: \"87a64fe5-87f1-443a-9958-70142ebd8a03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.078894 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078681 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-sys\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.078894 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078702 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-etc-openvswitch\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.078894 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078718 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret\") pod \"global-pull-secret-syncer-ffbmx\" (UID: \"e2409fd0-edee-41fb-b5e2-00c59ce4ea59\") " pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:01.078894 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078741 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/87a64fe5-87f1-443a-9958-70142ebd8a03-etc-selinux\") pod \"aws-ebs-csi-driver-node-68d8g\" (UID: \"87a64fe5-87f1-443a-9958-70142ebd8a03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.078894 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078760 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-etc-modprobe-d\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.078894 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078794 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-tmp\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.078894 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078840 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-host-run-netns\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.078894 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078867 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-run-openvswitch\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.078894 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078883 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-log-socket\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.079188 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078905 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.079188 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078932 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 07 16:20:01.079188 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078933 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e9d4b4f-193a-4824-b5b1-4f53e01ddfbe-iptables-alerter-script\") pod \"iptables-alerter-kjfgl\" (UID: \"1e9d4b4f-193a-4824-b5b1-4f53e01ddfbe\") " pod="openshift-network-operator/iptables-alerter-kjfgl" Sep 07 16:20:01.079188 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.078982 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/87a64fe5-87f1-443a-9958-70142ebd8a03-registration-dir\") pod \"aws-ebs-csi-driver-node-68d8g\" (UID: \"87a64fe5-87f1-443a-9958-70142ebd8a03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.079188 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079006 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqkzh\" (UniqueName: \"kubernetes.io/projected/87a64fe5-87f1-443a-9958-70142ebd8a03-kube-api-access-pqkzh\") pod \"aws-ebs-csi-driver-node-68d8g\" (UID: \"87a64fe5-87f1-443a-9958-70142ebd8a03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.079188 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079027 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-etc-systemd\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.079188 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079048 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-run\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.079188 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079080 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-node-log\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.079188 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079118 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7536adc5-f824-4a34-ab2f-9505253e1409-tmp-dir\") pod \"node-resolver-9hdjp\" (UID: \"7536adc5-f824-4a34-ab2f-9505253e1409\") " pod="openshift-dns/node-resolver-9hdjp" Sep 07 16:20:01.079188 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079150 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/87a64fe5-87f1-443a-9958-70142ebd8a03-socket-dir\") pod \"aws-ebs-csi-driver-node-68d8g\" (UID: \"87a64fe5-87f1-443a-9958-70142ebd8a03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.079188 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079183 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-host-slash\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.079700 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079219 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92qbq\" (UniqueName: \"kubernetes.io/projected/279b7732-ff48-482d-b216-0167445c26ab-kube-api-access-92qbq\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.079700 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079241 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/072a72a7-30ae-4d3a-8dea-5daa1f14823c-agent-certs\") pod \"konnectivity-agent-pc2zg\" (UID: \"072a72a7-30ae-4d3a-8dea-5daa1f14823c\") " pod="kube-system/konnectivity-agent-pc2zg" Sep 07 16:20:01.079700 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079257 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-kubelet-config\") pod \"global-pull-secret-syncer-ffbmx\" (UID: \"e2409fd0-edee-41fb-b5e2-00c59ce4ea59\") " pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:01.079700 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079241 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 07 16:20:01.079700 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079276 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-host\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.079700 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079299 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qtdd\" (UniqueName: \"kubernetes.io/projected/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-kube-api-access-6qtdd\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.079700 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079319 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-systemd-units\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.079700 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079333 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-run-systemd\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.079700 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079346 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-var-lib-openvswitch\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.079700 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079361 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/279b7732-ff48-482d-b216-0167445c26ab-ovnkube-config\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.079700 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079398 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-dbus\") pod \"global-pull-secret-syncer-ffbmx\" (UID: \"e2409fd0-edee-41fb-b5e2-00c59ce4ea59\") " pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:01.079700 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079443 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/87a64fe5-87f1-443a-9958-70142ebd8a03-kubelet-dir\") pod \"aws-ebs-csi-driver-node-68d8g\" (UID: \"87a64fe5-87f1-443a-9958-70142ebd8a03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.079700 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079477 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/87a64fe5-87f1-443a-9958-70142ebd8a03-device-dir\") pod \"aws-ebs-csi-driver-node-68d8g\" (UID: \"87a64fe5-87f1-443a-9958-70142ebd8a03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.079700 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079509 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-etc-sysconfig\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.079700 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079532 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 07 16:20:01.079700 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079533 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-run-ovn\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.079700 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079592 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/279b7732-ff48-482d-b216-0167445c26ab-ovnkube-script-lib\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.080440 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079630 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-etc-sysctl-d\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.080440 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079631 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sfk8h\"" Sep 07 16:20:01.080440 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079653 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-etc-sysctl-conf\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.080440 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079681 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-lib-modules\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.080440 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079701 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-var-lib-kubelet\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.080440 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079723 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-host-run-ovn-kubernetes\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.080440 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079746 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6rbv\" (UniqueName: \"kubernetes.io/projected/1e9d4b4f-193a-4824-b5b1-4f53e01ddfbe-kube-api-access-z6rbv\") pod \"iptables-alerter-kjfgl\" (UID: \"1e9d4b4f-193a-4824-b5b1-4f53e01ddfbe\") " pod="openshift-network-operator/iptables-alerter-kjfgl" Sep 07 16:20:01.080440 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079764 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-etc-kubernetes\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.080440 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079785 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-etc-tuned\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.080440 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079815 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-host-kubelet\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.080440 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079841 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-host-cni-bin\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.080440 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.079974 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 07 16:20:01.080440 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.080009 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:01.080440 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:01.080090 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87hv9" podUID="ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc" Sep 07 16:20:01.081586 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.081568 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.083847 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.083624 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 07 16:20:01.083847 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.083631 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.083847 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.083714 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-84nq8\"" Sep 07 16:20:01.083847 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.083724 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 07 16:20:01.083847 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.083729 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 07 16:20:01.083847 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.083714 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 07 16:20:01.084208 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.084079 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 07 16:20:01.084438 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.084383 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 16:20:01.085468 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.085447 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7f9h7\"" Sep 07 16:20:01.085574 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.085553 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:01.085640 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.085625 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 07 16:20:01.085640 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:01.085617 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fkc9" podUID="f565ccb2-4d11-476a-bda4-8e203cf7be65" Sep 07 16:20:01.106396 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.106358 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-95r25" Sep 07 16:20:01.113982 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.113957 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-95r25" Sep 07 16:20:01.174344 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.174319 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 07 16:20:01.180022 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.179993 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/87a64fe5-87f1-443a-9958-70142ebd8a03-socket-dir\") pod \"aws-ebs-csi-driver-node-68d8g\" (UID: \"87a64fe5-87f1-443a-9958-70142ebd8a03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.180217 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180027 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5747be07-7029-4273-a7e3-8024ddaedc17-cni-binary-copy\") pod \"multus-additional-cni-plugins-g68wd\" (UID: \"5747be07-7029-4273-a7e3-8024ddaedc17\") " pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.180217 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180052 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-host-run-netns\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.180217 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180078 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/072a72a7-30ae-4d3a-8dea-5daa1f14823c-agent-certs\") pod \"konnectivity-agent-pc2zg\" (UID: \"072a72a7-30ae-4d3a-8dea-5daa1f14823c\") " pod="kube-system/konnectivity-agent-pc2zg" Sep 07 16:20:01.180217 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180105 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-host\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.180217 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180128 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qtdd\" (UniqueName: \"kubernetes.io/projected/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-kube-api-access-6qtdd\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.180217 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180174 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/87a64fe5-87f1-443a-9958-70142ebd8a03-socket-dir\") pod \"aws-ebs-csi-driver-node-68d8g\" (UID: \"87a64fe5-87f1-443a-9958-70142ebd8a03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.180217 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180212 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-var-lib-openvswitch\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.180520 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180221 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-host\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.180520 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180241 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-system-cni-dir\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.180520 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180280 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-var-lib-openvswitch\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.180520 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180318 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-cni-binary-copy\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.180520 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180341 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-host-var-lib-cni-bin\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.180520 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180357 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-host-var-lib-kubelet\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.180520 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180401 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/87a64fe5-87f1-443a-9958-70142ebd8a03-kubelet-dir\") pod \"aws-ebs-csi-driver-node-68d8g\" (UID: \"87a64fe5-87f1-443a-9958-70142ebd8a03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.180520 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180430 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-etc-sysconfig\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.180520 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180435 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 07 16:20:01.180520 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180468 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-run-ovn\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.180520 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180496 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/87a64fe5-87f1-443a-9958-70142ebd8a03-kubelet-dir\") pod \"aws-ebs-csi-driver-node-68d8g\" (UID: \"87a64fe5-87f1-443a-9958-70142ebd8a03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.180520 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180504 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-etc-sysconfig\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.181069 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180498 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5747be07-7029-4273-a7e3-8024ddaedc17-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g68wd\" (UID: \"5747be07-7029-4273-a7e3-8024ddaedc17\") " pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.181069 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180538 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-run-ovn\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.181069 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180571 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8mvx\" (UniqueName: \"kubernetes.io/projected/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-kube-api-access-j8mvx\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.181069 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180598 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-etc-sysctl-conf\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.181069 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180614 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-var-lib-kubelet\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.181069 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180637 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qw4n\" (UniqueName: \"kubernetes.io/projected/81813711-9d30-4e49-88fb-051b60f3061f-kube-api-access-7qw4n\") pod \"node-ca-l9j65\" (UID: \"81813711-9d30-4e49-88fb-051b60f3061f\") " pod="openshift-image-registry/node-ca-l9j65" Sep 07 16:20:01.181069 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180659 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/279b7732-ff48-482d-b216-0167445c26ab-ovnkube-script-lib\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.181069 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180702 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-var-lib-kubelet\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.181069 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180701 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6rbv\" (UniqueName: \"kubernetes.io/projected/1e9d4b4f-193a-4824-b5b1-4f53e01ddfbe-kube-api-access-z6rbv\") pod \"iptables-alerter-kjfgl\" (UID: \"1e9d4b4f-193a-4824-b5b1-4f53e01ddfbe\") " pod="openshift-network-operator/iptables-alerter-kjfgl" Sep 07 16:20:01.181069 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180739 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-etc-sysctl-conf\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.181069 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180741 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/279b7732-ff48-482d-b216-0167445c26ab-env-overrides\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.181069 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180771 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghnch\" (UniqueName: \"kubernetes.io/projected/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-kube-api-access-ghnch\") pod \"network-metrics-daemon-87hv9\" (UID: \"ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc\") " pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:01.181069 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180802 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7536adc5-f824-4a34-ab2f-9505253e1409-hosts-file\") pod \"node-resolver-9hdjp\" (UID: \"7536adc5-f824-4a34-ab2f-9505253e1409\") " pod="openshift-dns/node-resolver-9hdjp" Sep 07 16:20:01.181069 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180887 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvkbf\" (UniqueName: \"kubernetes.io/projected/7536adc5-f824-4a34-ab2f-9505253e1409-kube-api-access-nvkbf\") pod \"node-resolver-9hdjp\" (UID: \"7536adc5-f824-4a34-ab2f-9505253e1409\") " pod="openshift-dns/node-resolver-9hdjp" Sep 07 16:20:01.181069 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180929 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e9d4b4f-193a-4824-b5b1-4f53e01ddfbe-host-slash\") pod \"iptables-alerter-kjfgl\" (UID: \"1e9d4b4f-193a-4824-b5b1-4f53e01ddfbe\") " pod="openshift-network-operator/iptables-alerter-kjfgl" Sep 07 16:20:01.181069 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180961 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/87a64fe5-87f1-443a-9958-70142ebd8a03-sys-fs\") pod \"aws-ebs-csi-driver-node-68d8g\" (UID: \"87a64fe5-87f1-443a-9958-70142ebd8a03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.181069 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180976 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7536adc5-f824-4a34-ab2f-9505253e1409-hosts-file\") pod \"node-resolver-9hdjp\" (UID: \"7536adc5-f824-4a34-ab2f-9505253e1409\") " pod="openshift-dns/node-resolver-9hdjp" Sep 07 16:20:01.181908 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180979 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e9d4b4f-193a-4824-b5b1-4f53e01ddfbe-host-slash\") pod \"iptables-alerter-kjfgl\" (UID: \"1e9d4b4f-193a-4824-b5b1-4f53e01ddfbe\") " pod="openshift-network-operator/iptables-alerter-kjfgl" Sep 07 16:20:01.181908 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.180986 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-etc-openvswitch\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.181908 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181013 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5747be07-7029-4273-a7e3-8024ddaedc17-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g68wd\" (UID: \"5747be07-7029-4273-a7e3-8024ddaedc17\") " pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.181908 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181038 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-hostroot\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.181908 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181045 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/87a64fe5-87f1-443a-9958-70142ebd8a03-sys-fs\") pod \"aws-ebs-csi-driver-node-68d8g\" (UID: \"87a64fe5-87f1-443a-9958-70142ebd8a03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.181908 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181064 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/87a64fe5-87f1-443a-9958-70142ebd8a03-etc-selinux\") pod \"aws-ebs-csi-driver-node-68d8g\" (UID: \"87a64fe5-87f1-443a-9958-70142ebd8a03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.181908 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181089 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-etc-modprobe-d\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.181908 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181102 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-etc-openvswitch\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.181908 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181118 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-host-run-netns\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.181908 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181143 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-run-openvswitch\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.181908 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181161 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/279b7732-ff48-482d-b216-0167445c26ab-env-overrides\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.181908 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181200 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/87a64fe5-87f1-443a-9958-70142ebd8a03-etc-selinux\") pod \"aws-ebs-csi-driver-node-68d8g\" (UID: \"87a64fe5-87f1-443a-9958-70142ebd8a03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.181908 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181211 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-host-run-netns\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.181908 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181167 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.181908 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181241 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.181908 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181250 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-run-openvswitch\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.181908 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181250 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/279b7732-ff48-482d-b216-0167445c26ab-ovnkube-script-lib\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.182762 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181250 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92qbq\" (UniqueName: \"kubernetes.io/projected/279b7732-ff48-482d-b216-0167445c26ab-kube-api-access-92qbq\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.182762 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181255 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-etc-modprobe-d\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.182762 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181288 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/279b7732-ff48-482d-b216-0167445c26ab-ovn-node-metrics-cert\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.182762 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181315 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-host-var-lib-cni-multus\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.182762 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181343 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/87a64fe5-87f1-443a-9958-70142ebd8a03-registration-dir\") pod \"aws-ebs-csi-driver-node-68d8g\" (UID: \"87a64fe5-87f1-443a-9958-70142ebd8a03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.182762 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181387 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqkzh\" (UniqueName: \"kubernetes.io/projected/87a64fe5-87f1-443a-9958-70142ebd8a03-kube-api-access-pqkzh\") pod \"aws-ebs-csi-driver-node-68d8g\" (UID: \"87a64fe5-87f1-443a-9958-70142ebd8a03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.182762 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181412 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-run\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.182762 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181421 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/87a64fe5-87f1-443a-9958-70142ebd8a03-registration-dir\") pod \"aws-ebs-csi-driver-node-68d8g\" (UID: \"87a64fe5-87f1-443a-9958-70142ebd8a03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.182762 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181437 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs\") pod \"network-metrics-daemon-87hv9\" (UID: \"ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc\") " pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:01.182762 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181462 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-host-run-multus-certs\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.182762 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181515 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7536adc5-f824-4a34-ab2f-9505253e1409-tmp-dir\") pod \"node-resolver-9hdjp\" (UID: \"7536adc5-f824-4a34-ab2f-9505253e1409\") " pod="openshift-dns/node-resolver-9hdjp" Sep 07 16:20:01.182762 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181531 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-run\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.182762 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181546 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-host-slash\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.182762 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181573 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81813711-9d30-4e49-88fb-051b60f3061f-host\") pod \"node-ca-l9j65\" (UID: \"81813711-9d30-4e49-88fb-051b60f3061f\") " pod="openshift-image-registry/node-ca-l9j65" Sep 07 16:20:01.182762 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181596 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5747be07-7029-4273-a7e3-8024ddaedc17-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g68wd\" (UID: \"5747be07-7029-4273-a7e3-8024ddaedc17\") " pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.182762 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181620 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-host-run-k8s-cni-cncf-io\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.182762 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181651 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-etc-kubernetes\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.183690 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-kubelet-config\") pod \"global-pull-secret-syncer-ffbmx\" (UID: \"e2409fd0-edee-41fb-b5e2-00c59ce4ea59\") " pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:01.183690 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181687 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-systemd-units\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.183690 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181688 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-host-slash\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.183690 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181701 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-run-systemd\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.183690 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181721 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/279b7732-ff48-482d-b216-0167445c26ab-ovnkube-config\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.183690 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181736 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-dbus\") pod \"global-pull-secret-syncer-ffbmx\" (UID: \"e2409fd0-edee-41fb-b5e2-00c59ce4ea59\") " pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:01.183690 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181752 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/87a64fe5-87f1-443a-9958-70142ebd8a03-device-dir\") pod \"aws-ebs-csi-driver-node-68d8g\" (UID: \"87a64fe5-87f1-443a-9958-70142ebd8a03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.183690 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181766 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-etc-sysctl-d\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.183690 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181776 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7536adc5-f824-4a34-ab2f-9505253e1409-tmp-dir\") pod \"node-resolver-9hdjp\" (UID: \"7536adc5-f824-4a34-ab2f-9505253e1409\") " pod="openshift-dns/node-resolver-9hdjp" Sep 07 16:20:01.183690 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181785 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-lib-modules\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.183690 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181803 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-host-run-ovn-kubernetes\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.183690 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181819 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-systemd-units\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.183690 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181822 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-multus-daemon-config\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.183690 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181871 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-etc-kubernetes\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.183690 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181896 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-host-run-ovn-kubernetes\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.183690 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181898 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-etc-tuned\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.183690 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181902 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/87a64fe5-87f1-443a-9958-70142ebd8a03-device-dir\") pod \"aws-ebs-csi-driver-node-68d8g\" (UID: \"87a64fe5-87f1-443a-9958-70142ebd8a03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.184562 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181921 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-host-kubelet\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.184562 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181935 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-run-systemd\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.184562 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181954 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-dbus\") pod \"global-pull-secret-syncer-ffbmx\" (UID: \"e2409fd0-edee-41fb-b5e2-00c59ce4ea59\") " pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:01.184562 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181785 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-kubelet-config\") pod \"global-pull-secret-syncer-ffbmx\" (UID: \"e2409fd0-edee-41fb-b5e2-00c59ce4ea59\") " pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:01.184562 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.181968 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-host-cni-bin\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.184562 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182017 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-etc-sysctl-d\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.184562 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182042 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-host-cni-bin\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.184562 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182070 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-lib-modules\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.184562 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182105 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-host-cni-netd\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.184562 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182138 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-host-kubelet\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.184562 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182151 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-etc-kubernetes\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.184562 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182198 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81813711-9d30-4e49-88fb-051b60f3061f-serviceca\") pod \"node-ca-l9j65\" (UID: \"81813711-9d30-4e49-88fb-051b60f3061f\") " pod="openshift-image-registry/node-ca-l9j65" Sep 07 16:20:01.184562 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182230 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5747be07-7029-4273-a7e3-8024ddaedc17-cnibin\") pod \"multus-additional-cni-plugins-g68wd\" (UID: \"5747be07-7029-4273-a7e3-8024ddaedc17\") " pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.184562 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182267 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-multus-socket-dir-parent\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.184562 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182325 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/072a72a7-30ae-4d3a-8dea-5daa1f14823c-konnectivity-ca\") pod \"konnectivity-agent-pc2zg\" (UID: \"072a72a7-30ae-4d3a-8dea-5daa1f14823c\") " pod="kube-system/konnectivity-agent-pc2zg" Sep 07 16:20:01.184562 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182350 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-sys\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.184562 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182391 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-log-socket\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.184562 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182437 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-multus-cni-dir\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.185154 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182460 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-cnibin\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.185154 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182482 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/279b7732-ff48-482d-b216-0167445c26ab-ovnkube-config\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.185154 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182563 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-host-cni-netd\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.185154 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182485 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret\") pod \"global-pull-secret-syncer-ffbmx\" (UID: \"e2409fd0-edee-41fb-b5e2-00c59ce4ea59\") " pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:01.185154 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:01.182583 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 16:20:01.185154 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182619 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-log-socket\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.185154 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182657 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-tmp\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.185154 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182672 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-sys\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.185154 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182688 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb7cn\" (UniqueName: \"kubernetes.io/projected/5747be07-7029-4273-a7e3-8024ddaedc17-kube-api-access-nb7cn\") pod \"multus-additional-cni-plugins-g68wd\" (UID: \"5747be07-7029-4273-a7e3-8024ddaedc17\") " pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.185154 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182720 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cjxl\" (UniqueName: \"kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl\") pod \"network-check-target-8fkc9\" (UID: \"f565ccb2-4d11-476a-bda4-8e203cf7be65\") " pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:01.185154 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:01.182760 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret podName:e2409fd0-edee-41fb-b5e2-00c59ce4ea59 nodeName:}" failed. No retries permitted until 2026-09-07 16:20:01.68273778 +0000 UTC m=+2.055333128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret") pod "global-pull-secret-syncer-ffbmx" (UID: "e2409fd0-edee-41fb-b5e2-00c59ce4ea59") : object "kube-system"/"original-pull-secret" not registered Sep 07 16:20:01.185154 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182793 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e9d4b4f-193a-4824-b5b1-4f53e01ddfbe-iptables-alerter-script\") pod \"iptables-alerter-kjfgl\" (UID: \"1e9d4b4f-193a-4824-b5b1-4f53e01ddfbe\") " pod="openshift-network-operator/iptables-alerter-kjfgl" Sep 07 16:20:01.185154 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182821 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-etc-systemd\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.185154 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182852 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-node-log\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.185154 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182879 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5747be07-7029-4273-a7e3-8024ddaedc17-system-cni-dir\") pod \"multus-additional-cni-plugins-g68wd\" (UID: \"5747be07-7029-4273-a7e3-8024ddaedc17\") " pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.185154 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.182908 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-multus-conf-dir\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.185154 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.183042 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/072a72a7-30ae-4d3a-8dea-5daa1f14823c-konnectivity-ca\") pod \"konnectivity-agent-pc2zg\" (UID: \"072a72a7-30ae-4d3a-8dea-5daa1f14823c\") " pod="kube-system/konnectivity-agent-pc2zg" Sep 07 16:20:01.185668 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.183479 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e9d4b4f-193a-4824-b5b1-4f53e01ddfbe-iptables-alerter-script\") pod \"iptables-alerter-kjfgl\" (UID: \"1e9d4b4f-193a-4824-b5b1-4f53e01ddfbe\") " pod="openshift-network-operator/iptables-alerter-kjfgl" Sep 07 16:20:01.185668 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.183552 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-etc-systemd\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.185668 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.183617 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/279b7732-ff48-482d-b216-0167445c26ab-node-log\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.185668 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.184503 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/279b7732-ff48-482d-b216-0167445c26ab-ovn-node-metrics-cert\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.185668 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.184639 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/072a72a7-30ae-4d3a-8dea-5daa1f14823c-agent-certs\") pod \"konnectivity-agent-pc2zg\" (UID: \"072a72a7-30ae-4d3a-8dea-5daa1f14823c\") " pod="kube-system/konnectivity-agent-pc2zg" Sep 07 16:20:01.185668 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.184714 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-etc-tuned\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.185668 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.185309 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-tmp\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.188801 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.188779 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qtdd\" (UniqueName: \"kubernetes.io/projected/64bb7a70-195f-4d59-aa6b-7fcb7a59a446-kube-api-access-6qtdd\") pod \"tuned-2rrvq\" (UID: \"64bb7a70-195f-4d59-aa6b-7fcb7a59a446\") " pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.192162 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.192137 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvkbf\" (UniqueName: \"kubernetes.io/projected/7536adc5-f824-4a34-ab2f-9505253e1409-kube-api-access-nvkbf\") pod \"node-resolver-9hdjp\" (UID: \"7536adc5-f824-4a34-ab2f-9505253e1409\") " pod="openshift-dns/node-resolver-9hdjp" Sep 07 16:20:01.192575 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.192553 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6rbv\" (UniqueName: \"kubernetes.io/projected/1e9d4b4f-193a-4824-b5b1-4f53e01ddfbe-kube-api-access-z6rbv\") pod \"iptables-alerter-kjfgl\" (UID: \"1e9d4b4f-193a-4824-b5b1-4f53e01ddfbe\") " pod="openshift-network-operator/iptables-alerter-kjfgl" Sep 07 16:20:01.192759 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.192725 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92qbq\" (UniqueName: \"kubernetes.io/projected/279b7732-ff48-482d-b216-0167445c26ab-kube-api-access-92qbq\") pod \"ovnkube-node-f72gx\" (UID: \"279b7732-ff48-482d-b216-0167445c26ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.193003 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.192985 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqkzh\" (UniqueName: \"kubernetes.io/projected/87a64fe5-87f1-443a-9958-70142ebd8a03-kube-api-access-pqkzh\") pod \"aws-ebs-csi-driver-node-68d8g\" (UID: \"87a64fe5-87f1-443a-9958-70142ebd8a03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.242039 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:20:01.241986 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62c7c6859d381044f69c9ee34ea39d10.slice/crio-4a35273cdd080c67164f4e851e79b1b9fd0d600fe967ca97ae9c356dd97d2a59 WatchSource:0}: Error finding container 4a35273cdd080c67164f4e851e79b1b9fd0d600fe967ca97ae9c356dd97d2a59: Status 404 returned error can't find the container with id 4a35273cdd080c67164f4e851e79b1b9fd0d600fe967ca97ae9c356dd97d2a59 Sep 07 16:20:01.245438 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.245416 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 16:20:01.283505 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.283455 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs\") pod \"network-metrics-daemon-87hv9\" (UID: \"ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc\") " pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:01.283505 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.283501 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-host-run-multus-certs\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.283505 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.283519 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81813711-9d30-4e49-88fb-051b60f3061f-host\") pod \"node-ca-l9j65\" (UID: \"81813711-9d30-4e49-88fb-051b60f3061f\") " pod="openshift-image-registry/node-ca-l9j65" Sep 07 16:20:01.283806 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.283538 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5747be07-7029-4273-a7e3-8024ddaedc17-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g68wd\" (UID: \"5747be07-7029-4273-a7e3-8024ddaedc17\") " pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.283806 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.283561 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-host-run-k8s-cni-cncf-io\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.283806 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.283583 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-etc-kubernetes\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.283806 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.283589 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-host-run-multus-certs\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.283806 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.283613 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-multus-daemon-config\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.283806 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:01.283620 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 16:20:01.283806 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.283621 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-host-run-k8s-cni-cncf-io\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.283806 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.283681 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81813711-9d30-4e49-88fb-051b60f3061f-serviceca\") pod \"node-ca-l9j65\" (UID: \"81813711-9d30-4e49-88fb-051b60f3061f\") " pod="openshift-image-registry/node-ca-l9j65" Sep 07 16:20:01.283806 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.283652 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-etc-kubernetes\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.283806 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:01.283700 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs podName:ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc nodeName:}" failed. No retries permitted until 2026-09-07 16:20:01.783680544 +0000 UTC m=+2.156275902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs") pod "network-metrics-daemon-87hv9" (UID: "ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 16:20:01.283806 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.283594 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81813711-9d30-4e49-88fb-051b60f3061f-host\") pod \"node-ca-l9j65\" (UID: \"81813711-9d30-4e49-88fb-051b60f3061f\") " pod="openshift-image-registry/node-ca-l9j65" Sep 07 16:20:01.283806 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.283765 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5747be07-7029-4273-a7e3-8024ddaedc17-cnibin\") pod \"multus-additional-cni-plugins-g68wd\" (UID: \"5747be07-7029-4273-a7e3-8024ddaedc17\") " pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.284392 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.283812 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-multus-socket-dir-parent\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.284392 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.283844 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5747be07-7029-4273-a7e3-8024ddaedc17-cnibin\") pod \"multus-additional-cni-plugins-g68wd\" (UID: \"5747be07-7029-4273-a7e3-8024ddaedc17\") " pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.284392 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.283852 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-multus-cni-dir\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.284392 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.283880 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-cnibin\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.284392 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.283904 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-multus-socket-dir-parent\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.284392 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.283930 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb7cn\" (UniqueName: \"kubernetes.io/projected/5747be07-7029-4273-a7e3-8024ddaedc17-kube-api-access-nb7cn\") pod \"multus-additional-cni-plugins-g68wd\" (UID: \"5747be07-7029-4273-a7e3-8024ddaedc17\") " pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.284392 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.283967 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cjxl\" (UniqueName: \"kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl\") pod \"network-check-target-8fkc9\" (UID: \"f565ccb2-4d11-476a-bda4-8e203cf7be65\") " pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:01.284392 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.283978 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-cnibin\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.284392 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.283940 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-multus-cni-dir\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.284392 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284001 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5747be07-7029-4273-a7e3-8024ddaedc17-system-cni-dir\") pod \"multus-additional-cni-plugins-g68wd\" (UID: \"5747be07-7029-4273-a7e3-8024ddaedc17\") " pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.284392 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284032 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-multus-conf-dir\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.284392 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284062 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5747be07-7029-4273-a7e3-8024ddaedc17-cni-binary-copy\") pod \"multus-additional-cni-plugins-g68wd\" (UID: \"5747be07-7029-4273-a7e3-8024ddaedc17\") " pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.284392 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284083 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-host-run-netns\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.284392 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284110 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-system-cni-dir\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.284392 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284115 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5747be07-7029-4273-a7e3-8024ddaedc17-system-cni-dir\") pod \"multus-additional-cni-plugins-g68wd\" (UID: \"5747be07-7029-4273-a7e3-8024ddaedc17\") " pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.284392 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284130 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-cni-binary-copy\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.284392 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284131 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81813711-9d30-4e49-88fb-051b60f3061f-serviceca\") pod \"node-ca-l9j65\" (UID: \"81813711-9d30-4e49-88fb-051b60f3061f\") " pod="openshift-image-registry/node-ca-l9j65" Sep 07 16:20:01.284392 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284154 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-host-var-lib-cni-bin\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.285197 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284178 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-host-var-lib-kubelet\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.285197 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284182 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-multus-conf-dir\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.285197 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284195 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-host-run-netns\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.285197 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284202 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-multus-daemon-config\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.285197 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284207 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5747be07-7029-4273-a7e3-8024ddaedc17-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g68wd\" (UID: \"5747be07-7029-4273-a7e3-8024ddaedc17\") " pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.285197 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284235 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-host-var-lib-cni-bin\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.285197 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284254 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8mvx\" (UniqueName: \"kubernetes.io/projected/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-kube-api-access-j8mvx\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.285197 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284280 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qw4n\" (UniqueName: \"kubernetes.io/projected/81813711-9d30-4e49-88fb-051b60f3061f-kube-api-access-7qw4n\") pod \"node-ca-l9j65\" (UID: \"81813711-9d30-4e49-88fb-051b60f3061f\") " pod="openshift-image-registry/node-ca-l9j65" Sep 07 16:20:01.285197 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284283 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-host-var-lib-kubelet\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.285197 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284308 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghnch\" (UniqueName: \"kubernetes.io/projected/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-kube-api-access-ghnch\") pod \"network-metrics-daemon-87hv9\" (UID: \"ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc\") " pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:01.285197 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284336 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5747be07-7029-4273-a7e3-8024ddaedc17-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g68wd\" (UID: \"5747be07-7029-4273-a7e3-8024ddaedc17\") " pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.285197 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284357 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-hostroot\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.285197 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284406 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-host-var-lib-cni-multus\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.285197 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284866 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-system-cni-dir\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.285197 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284889 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5747be07-7029-4273-a7e3-8024ddaedc17-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g68wd\" (UID: \"5747be07-7029-4273-a7e3-8024ddaedc17\") " pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.285197 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.284948 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5747be07-7029-4273-a7e3-8024ddaedc17-cni-binary-copy\") pod \"multus-additional-cni-plugins-g68wd\" (UID: \"5747be07-7029-4273-a7e3-8024ddaedc17\") " pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.285197 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.285026 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5747be07-7029-4273-a7e3-8024ddaedc17-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g68wd\" (UID: \"5747be07-7029-4273-a7e3-8024ddaedc17\") " pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.285954 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.285060 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5747be07-7029-4273-a7e3-8024ddaedc17-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g68wd\" (UID: \"5747be07-7029-4273-a7e3-8024ddaedc17\") " pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.285954 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.285092 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-hostroot\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.285954 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.285138 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-host-var-lib-cni-multus\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.285954 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.285207 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-cni-binary-copy\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.289733 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:01.289708 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 16:20:01.289733 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:01.289734 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 16:20:01.289923 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:01.289749 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6cjxl for pod openshift-network-diagnostics/network-check-target-8fkc9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 16:20:01.289923 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:01.289829 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl podName:f565ccb2-4d11-476a-bda4-8e203cf7be65 nodeName:}" failed. No retries permitted until 2026-09-07 16:20:01.789808935 +0000 UTC m=+2.162404296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6cjxl" (UniqueName: "kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl") pod "network-check-target-8fkc9" (UID: "f565ccb2-4d11-476a-bda4-8e203cf7be65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 16:20:01.292039 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.292013 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb7cn\" (UniqueName: \"kubernetes.io/projected/5747be07-7029-4273-a7e3-8024ddaedc17-kube-api-access-nb7cn\") pod \"multus-additional-cni-plugins-g68wd\" (UID: \"5747be07-7029-4273-a7e3-8024ddaedc17\") " pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.292137 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.292039 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qw4n\" (UniqueName: \"kubernetes.io/projected/81813711-9d30-4e49-88fb-051b60f3061f-kube-api-access-7qw4n\") pod \"node-ca-l9j65\" (UID: \"81813711-9d30-4e49-88fb-051b60f3061f\") " pod="openshift-image-registry/node-ca-l9j65" Sep 07 16:20:01.292271 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.292253 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8mvx\" (UniqueName: \"kubernetes.io/projected/75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe-kube-api-access-j8mvx\") pod \"multus-jbxz9\" (UID: \"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe\") " pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.292426 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.292410 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghnch\" (UniqueName: \"kubernetes.io/projected/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-kube-api-access-ghnch\") pod \"network-metrics-daemon-87hv9\" (UID: \"ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc\") " pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:01.406887 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.406850 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kjfgl" Sep 07 16:20:01.416314 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:20:01.416283 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e9d4b4f_193a_4824_b5b1_4f53e01ddfbe.slice/crio-f68bd6d067e240f7eeb7e976fdcbfd97e2ef4f22814813cb29ddaaa84f05c38e WatchSource:0}: Error finding container f68bd6d067e240f7eeb7e976fdcbfd97e2ef4f22814813cb29ddaaa84f05c38e: Status 404 returned error can't find the container with id f68bd6d067e240f7eeb7e976fdcbfd97e2ef4f22814813cb29ddaaa84f05c38e Sep 07 16:20:01.421664 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.421639 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:01.429244 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:20:01.429212 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod279b7732_ff48_482d_b216_0167445c26ab.slice/crio-5675fa8bd813c6a143741dc39e6793a160e55824cfbc792f716f8b0d3bfc211f WatchSource:0}: Error finding container 5675fa8bd813c6a143741dc39e6793a160e55824cfbc792f716f8b0d3bfc211f: Status 404 returned error can't find the container with id 5675fa8bd813c6a143741dc39e6793a160e55824cfbc792f716f8b0d3bfc211f Sep 07 16:20:01.441040 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.441006 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pc2zg" Sep 07 16:20:01.444193 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.444175 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" Sep 07 16:20:01.449201 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:20:01.449165 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod072a72a7_30ae_4d3a_8dea_5daa1f14823c.slice/crio-141fc4d4c00938607ab35e54b9a114b8158b05f2bb03978db983d4b209ac2258 WatchSource:0}: Error finding container 141fc4d4c00938607ab35e54b9a114b8158b05f2bb03978db983d4b209ac2258: Status 404 returned error can't find the container with id 141fc4d4c00938607ab35e54b9a114b8158b05f2bb03978db983d4b209ac2258 Sep 07 16:20:01.451910 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:20:01.451886 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87a64fe5_87f1_443a_9958_70142ebd8a03.slice/crio-003fe07f7abf909db859daf1307d0d32366168862b2040aa9fcd0143aa731215 WatchSource:0}: Error finding container 003fe07f7abf909db859daf1307d0d32366168862b2040aa9fcd0143aa731215: Status 404 returned error can't find the container with id 003fe07f7abf909db859daf1307d0d32366168862b2040aa9fcd0143aa731215 Sep 07 16:20:01.468713 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.468624 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" Sep 07 16:20:01.474124 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.474102 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9hdjp" Sep 07 16:20:01.476569 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:20:01.476430 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64bb7a70_195f_4d59_aa6b_7fcb7a59a446.slice/crio-c4211e3b51910244006bf88fa93154892f81ec839a5fb82e2de878401afb36ab WatchSource:0}: Error finding container c4211e3b51910244006bf88fa93154892f81ec839a5fb82e2de878401afb36ab: Status 404 returned error can't find the container with id c4211e3b51910244006bf88fa93154892f81ec839a5fb82e2de878401afb36ab Sep 07 16:20:01.482169 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:20:01.482144 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7536adc5_f824_4a34_ab2f_9505253e1409.slice/crio-b7479ab05e872a3aa7e14aa7a8480577d50b27f63ad250df39f828fb232e8578 WatchSource:0}: Error finding container b7479ab05e872a3aa7e14aa7a8480577d50b27f63ad250df39f828fb232e8578: Status 404 returned error can't find the container with id b7479ab05e872a3aa7e14aa7a8480577d50b27f63ad250df39f828fb232e8578 Sep 07 16:20:01.509315 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.509275 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l9j65" Sep 07 16:20:01.518142 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:20:01.518112 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81813711_9d30_4e49_88fb_051b60f3061f.slice/crio-1288c25e26e0e710942958572529db1238ceffbf6adb3b0c12a4b666602730c9 WatchSource:0}: Error finding container 1288c25e26e0e710942958572529db1238ceffbf6adb3b0c12a4b666602730c9: Status 404 returned error can't find the container with id 1288c25e26e0e710942958572529db1238ceffbf6adb3b0c12a4b666602730c9 Sep 07 16:20:01.524977 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.524950 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g68wd" Sep 07 16:20:01.529300 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.529272 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jbxz9" Sep 07 16:20:01.535190 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:20:01.535157 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5747be07_7029_4273_a7e3_8024ddaedc17.slice/crio-d0376022248c9907de6228276fe70a42b26c1c13fd805cc4a892453c4b674f90 WatchSource:0}: Error finding container d0376022248c9907de6228276fe70a42b26c1c13fd805cc4a892453c4b674f90: Status 404 returned error can't find the container with id d0376022248c9907de6228276fe70a42b26c1c13fd805cc4a892453c4b674f90 Sep 07 16:20:01.538539 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:20:01.538515 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75bdb20d_73ea_4cf8_b12a_643fc1b7f0fe.slice/crio-eab41bb9380ff3229ac8459565b3b4bbb078bcdb232ed80a35ddc95194cf9fc1 WatchSource:0}: Error finding container eab41bb9380ff3229ac8459565b3b4bbb078bcdb232ed80a35ddc95194cf9fc1: Status 404 returned error can't find the container with id eab41bb9380ff3229ac8459565b3b4bbb078bcdb232ed80a35ddc95194cf9fc1 Sep 07 16:20:01.688019 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.687987 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret\") pod \"global-pull-secret-syncer-ffbmx\" (UID: \"e2409fd0-edee-41fb-b5e2-00c59ce4ea59\") " pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:01.688212 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:01.688129 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 16:20:01.688212 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:01.688200 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret podName:e2409fd0-edee-41fb-b5e2-00c59ce4ea59 nodeName:}" failed. No retries permitted until 2026-09-07 16:20:02.688183448 +0000 UTC m=+3.060778805 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret") pod "global-pull-secret-syncer-ffbmx" (UID: "e2409fd0-edee-41fb-b5e2-00c59ce4ea59") : object "kube-system"/"original-pull-secret" not registered Sep 07 16:20:01.789309 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.789183 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs\") pod \"network-metrics-daemon-87hv9\" (UID: \"ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc\") " pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:01.789564 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:01.789404 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 16:20:01.789564 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:01.789473 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs podName:ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc nodeName:}" failed. No retries permitted until 2026-09-07 16:20:02.789454895 +0000 UTC m=+3.162050256 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs") pod "network-metrics-daemon-87hv9" (UID: "ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 16:20:01.890197 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:01.890076 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cjxl\" (UniqueName: \"kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl\") pod \"network-check-target-8fkc9\" (UID: \"f565ccb2-4d11-476a-bda4-8e203cf7be65\") " pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:01.890363 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:01.890251 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 16:20:01.890363 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:01.890274 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 16:20:01.890363 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:01.890288 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6cjxl for pod openshift-network-diagnostics/network-check-target-8fkc9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 16:20:01.890363 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:01.890354 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl podName:f565ccb2-4d11-476a-bda4-8e203cf7be65 nodeName:}" failed. No retries permitted until 2026-09-07 16:20:02.890334699 +0000 UTC m=+3.262930045 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cjxl" (UniqueName: "kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl") pod "network-check-target-8fkc9" (UID: "f565ccb2-4d11-476a-bda4-8e203cf7be65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 16:20:02.014286 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:02.014246 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 16:20:02.116595 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:02.116476 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 16:15:02 +0000 UTC" deadline="2028-05-22 08:59:34.637705482 +0000 UTC" Sep 07 16:20:02.116595 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:02.116542 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14944h39m32.521167662s" Sep 07 16:20:02.234486 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:02.234419 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" event={"ID":"62c7c6859d381044f69c9ee34ea39d10","Type":"ContainerStarted","Data":"4a35273cdd080c67164f4e851e79b1b9fd0d600fe967ca97ae9c356dd97d2a59"} Sep 07 16:20:02.267560 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:02.267381 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-30.ec2.internal" event={"ID":"329a346aaabf8018f97c250e4e6fc8a2","Type":"ContainerStarted","Data":"7a32181e048f694fdcb5980bf55e763558c11338a675baf0139715f74320ab34"} Sep 07 16:20:02.279675 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:02.279512 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jbxz9" event={"ID":"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe","Type":"ContainerStarted","Data":"eab41bb9380ff3229ac8459565b3b4bbb078bcdb232ed80a35ddc95194cf9fc1"} Sep 07 16:20:02.293079 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:02.293035 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" event={"ID":"64bb7a70-195f-4d59-aa6b-7fcb7a59a446","Type":"ContainerStarted","Data":"c4211e3b51910244006bf88fa93154892f81ec839a5fb82e2de878401afb36ab"} Sep 07 16:20:02.316269 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:02.316142 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" event={"ID":"87a64fe5-87f1-443a-9958-70142ebd8a03","Type":"ContainerStarted","Data":"003fe07f7abf909db859daf1307d0d32366168862b2040aa9fcd0143aa731215"} Sep 07 16:20:02.351009 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:02.350929 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pc2zg" event={"ID":"072a72a7-30ae-4d3a-8dea-5daa1f14823c","Type":"ContainerStarted","Data":"141fc4d4c00938607ab35e54b9a114b8158b05f2bb03978db983d4b209ac2258"} Sep 07 16:20:02.363899 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:02.363854 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" event={"ID":"279b7732-ff48-482d-b216-0167445c26ab","Type":"ContainerStarted","Data":"5675fa8bd813c6a143741dc39e6793a160e55824cfbc792f716f8b0d3bfc211f"} Sep 07 16:20:02.394682 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:02.394635 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g68wd" event={"ID":"5747be07-7029-4273-a7e3-8024ddaedc17","Type":"ContainerStarted","Data":"d0376022248c9907de6228276fe70a42b26c1c13fd805cc4a892453c4b674f90"} Sep 07 16:20:02.422706 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:02.422658 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l9j65" event={"ID":"81813711-9d30-4e49-88fb-051b60f3061f","Type":"ContainerStarted","Data":"1288c25e26e0e710942958572529db1238ceffbf6adb3b0c12a4b666602730c9"} Sep 07 16:20:04.268421 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:04.268295 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9hdjp" event={"ID":"7536adc5-f824-4a34-ab2f-9505253e1409","Type":"ContainerStarted","Data":"b7479ab05e872a3aa7e14aa7a8480577d50b27f63ad250df39f828fb232e8578"} Sep 07 16:20:04.282797 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:04.282424 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 16:20:04.289649 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:04.289561 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kjfgl" event={"ID":"1e9d4b4f-193a-4824-b5b1-4f53e01ddfbe","Type":"ContainerStarted","Data":"f68bd6d067e240f7eeb7e976fdcbfd97e2ef4f22814813cb29ddaaa84f05c38e"} Sep 07 16:20:04.336227 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:04.335984 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 16:20:04.513963 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:04.513314 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret\") pod \"global-pull-secret-syncer-ffbmx\" (UID: \"e2409fd0-edee-41fb-b5e2-00c59ce4ea59\") " pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:04.513963 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:04.513467 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 16:20:04.513963 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:04.513534 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret podName:e2409fd0-edee-41fb-b5e2-00c59ce4ea59 nodeName:}" failed. No retries permitted until 2026-09-07 16:20:06.513515348 +0000 UTC m=+5.070872846 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret") pod "global-pull-secret-syncer-ffbmx" (UID: "e2409fd0-edee-41fb-b5e2-00c59ce4ea59") : object "kube-system"/"original-pull-secret" not registered Sep 07 16:20:04.614329 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:04.614258 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs\") pod \"network-metrics-daemon-87hv9\" (UID: \"ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc\") " pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:04.614523 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:04.614440 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 16:20:04.614583 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:04.614531 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs podName:ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc nodeName:}" failed. No retries permitted until 2026-09-07 16:20:06.614509768 +0000 UTC m=+5.171867273 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs") pod "network-metrics-daemon-87hv9" (UID: "ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 16:20:04.715499 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:04.715458 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cjxl\" (UniqueName: \"kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl\") pod \"network-check-target-8fkc9\" (UID: \"f565ccb2-4d11-476a-bda4-8e203cf7be65\") " pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:04.715706 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:04.715648 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 16:20:04.715706 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:04.715677 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 16:20:04.715706 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:04.715691 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6cjxl for pod openshift-network-diagnostics/network-check-target-8fkc9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 16:20:04.715881 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:04.715755 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl podName:f565ccb2-4d11-476a-bda4-8e203cf7be65 nodeName:}" failed. No retries permitted until 2026-09-07 16:20:06.715735399 +0000 UTC m=+5.273092896 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cjxl" (UniqueName: "kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl") pod "network-check-target-8fkc9" (UID: "f565ccb2-4d11-476a-bda4-8e203cf7be65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 16:20:04.933836 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:04.933713 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 16:15:02 +0000 UTC" deadline="2028-02-15 10:35:18.50396855 +0000 UTC" Sep 07 16:20:04.933836 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:04.933758 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12618h15m13.570216829s" Sep 07 16:20:05.007062 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:05.006021 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:05.007062 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:05.006178 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ffbmx" podUID="e2409fd0-edee-41fb-b5e2-00c59ce4ea59" Sep 07 16:20:05.007062 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:05.006619 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:05.007062 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:05.006751 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87hv9" podUID="ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc" Sep 07 16:20:05.007062 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:05.006822 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:05.007062 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:05.006895 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fkc9" podUID="f565ccb2-4d11-476a-bda4-8e203cf7be65" Sep 07 16:20:06.532960 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:06.532912 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret\") pod \"global-pull-secret-syncer-ffbmx\" (UID: \"e2409fd0-edee-41fb-b5e2-00c59ce4ea59\") " pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:06.533658 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:06.533080 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 16:20:06.533658 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:06.533146 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret podName:e2409fd0-edee-41fb-b5e2-00c59ce4ea59 nodeName:}" failed. No retries permitted until 2026-09-07 16:20:10.533127281 +0000 UTC m=+9.090484789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret") pod "global-pull-secret-syncer-ffbmx" (UID: "e2409fd0-edee-41fb-b5e2-00c59ce4ea59") : object "kube-system"/"original-pull-secret" not registered Sep 07 16:20:06.634370 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:06.633724 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs\") pod \"network-metrics-daemon-87hv9\" (UID: \"ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc\") " pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:06.634370 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:06.633929 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 16:20:06.634370 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:06.633994 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs podName:ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc nodeName:}" failed. No retries permitted until 2026-09-07 16:20:10.633975108 +0000 UTC m=+9.191332604 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs") pod "network-metrics-daemon-87hv9" (UID: "ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 16:20:06.735696 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:06.734855 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cjxl\" (UniqueName: \"kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl\") pod \"network-check-target-8fkc9\" (UID: \"f565ccb2-4d11-476a-bda4-8e203cf7be65\") " pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:06.735696 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:06.735079 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 16:20:06.735696 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:06.735099 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 16:20:06.735696 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:06.735111 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6cjxl for pod openshift-network-diagnostics/network-check-target-8fkc9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 16:20:06.735696 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:06.735169 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl podName:f565ccb2-4d11-476a-bda4-8e203cf7be65 nodeName:}" failed. No retries permitted until 2026-09-07 16:20:10.735152087 +0000 UTC m=+9.292509580 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cjxl" (UniqueName: "kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl") pod "network-check-target-8fkc9" (UID: "f565ccb2-4d11-476a-bda4-8e203cf7be65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 16:20:07.005975 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:07.005376 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:07.005975 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:07.005376 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:07.005975 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:07.005506 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fkc9" podUID="f565ccb2-4d11-476a-bda4-8e203cf7be65" Sep 07 16:20:07.005975 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:07.005525 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:07.005975 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:07.005642 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87hv9" podUID="ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc" Sep 07 16:20:07.005975 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:07.005728 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ffbmx" podUID="e2409fd0-edee-41fb-b5e2-00c59ce4ea59" Sep 07 16:20:09.005667 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:09.005629 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:09.006139 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:09.005794 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87hv9" podUID="ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc" Sep 07 16:20:09.006221 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:09.006194 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:09.006311 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:09.006288 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fkc9" podUID="f565ccb2-4d11-476a-bda4-8e203cf7be65" Sep 07 16:20:09.006370 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:09.006348 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:09.006443 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:09.006420 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ffbmx" podUID="e2409fd0-edee-41fb-b5e2-00c59ce4ea59" Sep 07 16:20:10.570212 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:10.570121 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret\") pod \"global-pull-secret-syncer-ffbmx\" (UID: \"e2409fd0-edee-41fb-b5e2-00c59ce4ea59\") " pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:10.570807 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:10.570284 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 16:20:10.570807 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:10.570372 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret podName:e2409fd0-edee-41fb-b5e2-00c59ce4ea59 nodeName:}" failed. No retries permitted until 2026-09-07 16:20:18.570351776 +0000 UTC m=+17.127709285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret") pod "global-pull-secret-syncer-ffbmx" (UID: "e2409fd0-edee-41fb-b5e2-00c59ce4ea59") : object "kube-system"/"original-pull-secret" not registered Sep 07 16:20:10.670895 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:10.670841 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs\") pod \"network-metrics-daemon-87hv9\" (UID: \"ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc\") " pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:10.671086 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:10.670987 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 16:20:10.671086 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:10.671061 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs podName:ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc nodeName:}" failed. No retries permitted until 2026-09-07 16:20:18.671043244 +0000 UTC m=+17.228400754 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs") pod "network-metrics-daemon-87hv9" (UID: "ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 16:20:10.772200 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:10.772034 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cjxl\" (UniqueName: \"kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl\") pod \"network-check-target-8fkc9\" (UID: \"f565ccb2-4d11-476a-bda4-8e203cf7be65\") " pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:10.772392 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:10.772249 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 16:20:10.772392 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:10.772274 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 16:20:10.772392 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:10.772289 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6cjxl for pod openshift-network-diagnostics/network-check-target-8fkc9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 16:20:10.772392 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:10.772348 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl podName:f565ccb2-4d11-476a-bda4-8e203cf7be65 nodeName:}" failed. No retries permitted until 2026-09-07 16:20:18.772335389 +0000 UTC m=+17.329692908 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cjxl" (UniqueName: "kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl") pod "network-check-target-8fkc9" (UID: "f565ccb2-4d11-476a-bda4-8e203cf7be65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 16:20:11.005796 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:11.005421 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:11.005796 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:11.005452 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:11.005796 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:11.005573 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87hv9" podUID="ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc" Sep 07 16:20:11.006107 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:11.005927 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:11.006107 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:11.006030 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ffbmx" podUID="e2409fd0-edee-41fb-b5e2-00c59ce4ea59" Sep 07 16:20:11.006197 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:11.006108 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fkc9" podUID="f565ccb2-4d11-476a-bda4-8e203cf7be65" Sep 07 16:20:13.005485 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:13.005446 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:13.005970 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:13.005456 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:13.005970 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:13.005587 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87hv9" podUID="ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc" Sep 07 16:20:13.005970 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:13.005636 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:13.005970 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:13.005739 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fkc9" podUID="f565ccb2-4d11-476a-bda4-8e203cf7be65" Sep 07 16:20:13.005970 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:13.005832 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ffbmx" podUID="e2409fd0-edee-41fb-b5e2-00c59ce4ea59" Sep 07 16:20:15.005402 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:15.005368 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:15.005750 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:15.005383 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:15.005750 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:15.005490 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87hv9" podUID="ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc" Sep 07 16:20:15.005750 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:15.005498 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:15.005750 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:15.005599 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fkc9" podUID="f565ccb2-4d11-476a-bda4-8e203cf7be65" Sep 07 16:20:15.005750 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:15.005672 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ffbmx" podUID="e2409fd0-edee-41fb-b5e2-00c59ce4ea59" Sep 07 16:20:17.005979 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:17.005948 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:17.006469 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:17.005990 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:17.006469 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:17.006028 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:17.006469 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:17.006047 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fkc9" podUID="f565ccb2-4d11-476a-bda4-8e203cf7be65" Sep 07 16:20:17.006469 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:17.006120 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ffbmx" podUID="e2409fd0-edee-41fb-b5e2-00c59ce4ea59" Sep 07 16:20:17.006469 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:17.006187 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87hv9" podUID="ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc" Sep 07 16:20:18.630125 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:18.630034 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret\") pod \"global-pull-secret-syncer-ffbmx\" (UID: \"e2409fd0-edee-41fb-b5e2-00c59ce4ea59\") " pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:18.630559 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:18.630179 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 16:20:18.630559 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:18.630244 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret podName:e2409fd0-edee-41fb-b5e2-00c59ce4ea59 nodeName:}" failed. No retries permitted until 2026-09-07 16:20:34.630226228 +0000 UTC m=+33.187583732 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret") pod "global-pull-secret-syncer-ffbmx" (UID: "e2409fd0-edee-41fb-b5e2-00c59ce4ea59") : object "kube-system"/"original-pull-secret" not registered Sep 07 16:20:18.731033 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:18.730997 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs\") pod \"network-metrics-daemon-87hv9\" (UID: \"ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc\") " pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:18.731192 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:18.731113 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 16:20:18.731192 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:18.731174 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs podName:ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc nodeName:}" failed. No retries permitted until 2026-09-07 16:20:34.731158775 +0000 UTC m=+33.288516266 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs") pod "network-metrics-daemon-87hv9" (UID: "ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 16:20:18.831389 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:18.831356 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cjxl\" (UniqueName: \"kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl\") pod \"network-check-target-8fkc9\" (UID: \"f565ccb2-4d11-476a-bda4-8e203cf7be65\") " pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:18.831573 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:18.831550 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 16:20:18.831573 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:18.831572 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 16:20:18.831707 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:18.831585 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6cjxl for pod openshift-network-diagnostics/network-check-target-8fkc9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 16:20:18.831707 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:18.831666 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl podName:f565ccb2-4d11-476a-bda4-8e203cf7be65 nodeName:}" failed. No retries permitted until 2026-09-07 16:20:34.831645956 +0000 UTC m=+33.389003463 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cjxl" (UniqueName: "kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl") pod "network-check-target-8fkc9" (UID: "f565ccb2-4d11-476a-bda4-8e203cf7be65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 16:20:19.005618 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:19.005558 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:19.005823 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:19.005571 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:19.005823 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:19.005715 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:19.005823 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:19.005709 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fkc9" podUID="f565ccb2-4d11-476a-bda4-8e203cf7be65" Sep 07 16:20:19.005823 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:19.005792 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87hv9" podUID="ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc" Sep 07 16:20:19.006014 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:19.005881 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ffbmx" podUID="e2409fd0-edee-41fb-b5e2-00c59ce4ea59" Sep 07 16:20:21.005361 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:21.005318 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:21.005896 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:21.005317 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:21.005896 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:21.005464 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ffbmx" podUID="e2409fd0-edee-41fb-b5e2-00c59ce4ea59" Sep 07 16:20:21.005896 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:21.005316 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:21.005896 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:21.005519 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87hv9" podUID="ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc" Sep 07 16:20:21.005896 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:21.005623 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fkc9" podUID="f565ccb2-4d11-476a-bda4-8e203cf7be65" Sep 07 16:20:23.006401 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.005997 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:23.007049 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.006025 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:23.007049 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.006025 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:23.007049 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:23.006522 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87hv9" podUID="ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc" Sep 07 16:20:23.007049 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:23.006573 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ffbmx" podUID="e2409fd0-edee-41fb-b5e2-00c59ce4ea59" Sep 07 16:20:23.007049 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:23.006639 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fkc9" podUID="f565ccb2-4d11-476a-bda4-8e203cf7be65" Sep 07 16:20:23.340163 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.340116 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pc2zg" event={"ID":"072a72a7-30ae-4d3a-8dea-5daa1f14823c","Type":"ContainerStarted","Data":"a35e4d790543a30acab774d963bd277b1c2a0cf9dfa046f7868c08c03f716d79"} Sep 07 16:20:23.345292 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.345268 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f72gx_279b7732-ff48-482d-b216-0167445c26ab/ovn-acl-logging/0.log" Sep 07 16:20:23.345675 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.345657 2561 generic.go:356] "Generic (PLEG): container finished" podID="279b7732-ff48-482d-b216-0167445c26ab" containerID="0f17888978c1b8a695fe3e63e5a7f68ac88e6bf77e9300c4b06b17c13c97a768" exitCode=1 Sep 07 16:20:23.345757 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.345729 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" event={"ID":"279b7732-ff48-482d-b216-0167445c26ab","Type":"ContainerStarted","Data":"df96089fae03e7cec4280488ca189f24c6316516d90668ae8e18be2075a3ba18"} Sep 07 16:20:23.345833 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.345797 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" event={"ID":"279b7732-ff48-482d-b216-0167445c26ab","Type":"ContainerStarted","Data":"60b85c3d8f19510860321afd9451375bb6b709da5e597955ff05042954eb8d2b"} Sep 07 16:20:23.345889 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.345840 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" event={"ID":"279b7732-ff48-482d-b216-0167445c26ab","Type":"ContainerStarted","Data":"c96b73b22093d049e30847aac7d7d56fe496338404ca988d7c2c99c66977c139"} Sep 07 16:20:23.345889 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.345869 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" event={"ID":"279b7732-ff48-482d-b216-0167445c26ab","Type":"ContainerStarted","Data":"df53d4cdf7daf5332da07de64f496f1fd6088c4dd7bde62e3f44f36cdc2a886d"} Sep 07 16:20:23.345984 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.345905 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" event={"ID":"279b7732-ff48-482d-b216-0167445c26ab","Type":"ContainerDied","Data":"0f17888978c1b8a695fe3e63e5a7f68ac88e6bf77e9300c4b06b17c13c97a768"} Sep 07 16:20:23.345984 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.345939 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" event={"ID":"279b7732-ff48-482d-b216-0167445c26ab","Type":"ContainerStarted","Data":"51e73cead5159e9bc80629bb6e951e3b7d156f9d1b58490cda2e37002532c09e"} Sep 07 16:20:23.347385 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.347364 2561 generic.go:356] "Generic (PLEG): container finished" podID="5747be07-7029-4273-a7e3-8024ddaedc17" containerID="32075b6fb07362028a1f026022530f66f98dc9d7df0f9373788cfb3e13433c31" exitCode=0 Sep 07 16:20:23.347465 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.347431 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g68wd" event={"ID":"5747be07-7029-4273-a7e3-8024ddaedc17","Type":"ContainerDied","Data":"32075b6fb07362028a1f026022530f66f98dc9d7df0f9373788cfb3e13433c31"} Sep 07 16:20:23.349042 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.349022 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l9j65" event={"ID":"81813711-9d30-4e49-88fb-051b60f3061f","Type":"ContainerStarted","Data":"30faa2d45650fa178f24a82fe8ee8f2cb70834e15cbf83f68ebadacff90d6a47"} Sep 07 16:20:23.350435 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.350413 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9hdjp" event={"ID":"7536adc5-f824-4a34-ab2f-9505253e1409","Type":"ContainerStarted","Data":"0c9b1eccb336214d3e8ab89367f21f097b78342ea0ba5c7883321cfc155e8f7f"} Sep 07 16:20:23.351844 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.351821 2561 generic.go:356] "Generic (PLEG): container finished" podID="62c7c6859d381044f69c9ee34ea39d10" containerID="ab38c9e64f07c22b3a4d13e8501e55f9dfc7d44cd55f5a829e3ae32bf1dfba3b" exitCode=0 Sep 07 16:20:23.351956 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.351885 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" event={"ID":"62c7c6859d381044f69c9ee34ea39d10","Type":"ContainerDied","Data":"ab38c9e64f07c22b3a4d13e8501e55f9dfc7d44cd55f5a829e3ae32bf1dfba3b"} Sep 07 16:20:23.353416 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.353387 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-30.ec2.internal" event={"ID":"329a346aaabf8018f97c250e4e6fc8a2","Type":"ContainerStarted","Data":"7bcfd3c6474403e9164e05a8ba8155793a61de5cdc600d8086ebe890018433a1"} Sep 07 16:20:23.354933 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.354909 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jbxz9" event={"ID":"75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe","Type":"ContainerStarted","Data":"02669bdd4d7f436bf45e716ef49ab71af66dff78db127b4c1a145b2621e9a273"} Sep 07 16:20:23.355155 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.355078 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pc2zg" podStartSLOduration=6.26704673 podStartE2EDuration="21.355064111s" totalImagesPullingTime="15.088017381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:20:23.3548172 +0000 UTC m=+21.912174733" watchObservedRunningTime="2026-09-07 16:20:23.355064111 +0000 UTC m=+21.912421624" Sep 07 16:20:23.356549 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.356526 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" event={"ID":"64bb7a70-195f-4d59-aa6b-7fcb7a59a446","Type":"ContainerStarted","Data":"00cb5635579345163cc8424947de3b86dacee995a12bd7b4a5ea1c12e88af9bd"} Sep 07 16:20:23.357947 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.357929 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" event={"ID":"87a64fe5-87f1-443a-9958-70142ebd8a03","Type":"ContainerStarted","Data":"1fe55a5e9f93637740fc314706a96d8662689fc0ec106a92ead348c98797aeed"} Sep 07 16:20:23.380951 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.380815 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-30.ec2.internal" podStartSLOduration=21.380794535 podStartE2EDuration="21.380794535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:20:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:20:23.380022433 +0000 UTC m=+21.937379949" watchObservedRunningTime="2026-09-07 16:20:23.380794535 +0000 UTC m=+21.938152049" Sep 07 16:20:23.394629 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.394565 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9hdjp" podStartSLOduration=2.371787601 podStartE2EDuration="21.394546403s" totalImagesPullingTime="19.022758802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:20:23.394287642 +0000 UTC m=+21.951645362" watchObservedRunningTime="2026-09-07 16:20:23.394546403 +0000 UTC m=+21.951903917" Sep 07 16:20:23.432750 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.432706 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l9j65" podStartSLOduration=2.4782111000000002 podStartE2EDuration="21.432688649s" totalImagesPullingTime="18.954477549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:20:23.432368166 +0000 UTC m=+21.989725703" watchObservedRunningTime="2026-09-07 16:20:23.432688649 +0000 UTC m=+21.990046165" Sep 07 16:20:23.450985 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.450929 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2rrvq" podStartSLOduration=2.421532572 podStartE2EDuration="21.45090798s" totalImagesPullingTime="19.029375408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:20:23.450624953 +0000 UTC m=+22.007982494" watchObservedRunningTime="2026-09-07 16:20:23.45090798 +0000 UTC m=+22.008265496" Sep 07 16:20:23.471707 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.471643 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jbxz9" podStartSLOduration=2.274867168 podStartE2EDuration="21.47161901s" totalImagesPullingTime="19.196751842s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:20:23.470703174 +0000 UTC m=+22.028060688" watchObservedRunningTime="2026-09-07 16:20:23.47161901 +0000 UTC m=+22.028976516" Sep 07 16:20:23.886242 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.886057 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 07 16:20:23.975803 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.975679 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T16:20:23.886230865Z","UUID":"ce2a6cfa-cf73-422a-ac12-cdd91db5c292","Handler":null,"Name":"","Endpoint":""} Sep 07 16:20:23.977409 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.977374 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 07 16:20:23.977409 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:23.977405 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 07 16:20:24.364343 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:24.364297 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" event={"ID":"87a64fe5-87f1-443a-9958-70142ebd8a03","Type":"ContainerStarted","Data":"1fb80f72897229285c338046164563552c2f73a1c6fe55ff99e5d703226563f1"} Sep 07 16:20:24.366599 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:24.366564 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kjfgl" event={"ID":"1e9d4b4f-193a-4824-b5b1-4f53e01ddfbe","Type":"ContainerStarted","Data":"3e59acf3c5d11ebea61b2ef16d22bb2cef7f261e33bd4468b6c457a51d99108e"} Sep 07 16:20:24.369372 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:24.369317 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" event={"ID":"62c7c6859d381044f69c9ee34ea39d10","Type":"ContainerStarted","Data":"1d6782552be7444afd94a98eba1a876c8849a26a7d72a6bf3661cbbbdaea2c10"} Sep 07 16:20:24.382709 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:24.382645 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kjfgl" podStartSLOduration=3.326609634 podStartE2EDuration="22.382623734s" totalImagesPullingTime="19.0560141s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:20:24.38205047 +0000 UTC m=+22.939407984" watchObservedRunningTime="2026-09-07 16:20:24.382623734 +0000 UTC m=+22.939981240" Sep 07 16:20:24.395456 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:24.395395 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-30.ec2.internal" podStartSLOduration=22.395374579 podStartE2EDuration="22.395374579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:20:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:20:24.395018617 +0000 UTC m=+22.952376161" watchObservedRunningTime="2026-09-07 16:20:24.395374579 +0000 UTC m=+22.952732093" Sep 07 16:20:25.006047 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:25.006017 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:25.006173 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:25.006151 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:25.006229 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:25.006164 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87hv9" podUID="ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc" Sep 07 16:20:25.006229 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:25.006197 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:25.006318 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:25.006293 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ffbmx" podUID="e2409fd0-edee-41fb-b5e2-00c59ce4ea59" Sep 07 16:20:25.006400 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:25.006370 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fkc9" podUID="f565ccb2-4d11-476a-bda4-8e203cf7be65" Sep 07 16:20:25.374743 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:25.374645 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" event={"ID":"87a64fe5-87f1-443a-9958-70142ebd8a03","Type":"ContainerStarted","Data":"7ad3eda2a4e4c1264a849509c9551ff0572357d800e2a5f5f1ad93b847aba072"} Sep 07 16:20:25.378458 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:25.378430 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f72gx_279b7732-ff48-482d-b216-0167445c26ab/ovn-acl-logging/0.log" Sep 07 16:20:25.378970 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:25.378927 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" event={"ID":"279b7732-ff48-482d-b216-0167445c26ab","Type":"ContainerStarted","Data":"96fe10cdca2bd4c300b724c643df01bfc70c44e2b787fb6dbc15a0b75ba4d04e"} Sep 07 16:20:25.390243 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:25.390185 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68d8g" podStartSLOduration=2.673721871 podStartE2EDuration="23.390163344s" totalImagesPullingTime="20.716441473s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:20:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:20:25.389791739 +0000 UTC m=+23.947149377" watchObservedRunningTime="2026-09-07 16:20:25.390163344 +0000 UTC m=+23.947520858" Sep 07 16:20:27.006122 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:27.006077 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:27.006122 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:27.006124 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:27.006593 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:27.006229 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fkc9" podUID="f565ccb2-4d11-476a-bda4-8e203cf7be65" Sep 07 16:20:27.006593 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:27.006316 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87hv9" podUID="ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc" Sep 07 16:20:27.006593 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:27.006361 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:27.006593 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:27.006439 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ffbmx" podUID="e2409fd0-edee-41fb-b5e2-00c59ce4ea59" Sep 07 16:20:27.169494 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:27.169450 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pc2zg" Sep 07 16:20:27.170135 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:27.170109 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pc2zg" Sep 07 16:20:28.389747 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:28.389578 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f72gx_279b7732-ff48-482d-b216-0167445c26ab/ovn-acl-logging/0.log" Sep 07 16:20:28.390192 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:28.390159 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" event={"ID":"279b7732-ff48-482d-b216-0167445c26ab","Type":"ContainerStarted","Data":"a4f0d7259bce08343742a7e747b698f87d0743d22fd225a2893a94d1f7af2537"} Sep 07 16:20:28.390489 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:28.390464 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:28.390661 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:28.390641 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:28.390741 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:28.390717 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:28.390827 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:28.390650 2561 scope.go:117] "RemoveContainer" containerID="0f17888978c1b8a695fe3e63e5a7f68ac88e6bf77e9300c4b06b17c13c97a768" Sep 07 16:20:28.392301 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:28.392281 2561 generic.go:356] "Generic (PLEG): container finished" podID="5747be07-7029-4273-a7e3-8024ddaedc17" containerID="02fb10d164b42ddc78f460b002646179a5fc710a58389e6f3130700852c425a7" exitCode=0 Sep 07 16:20:28.392363 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:28.392336 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g68wd" event={"ID":"5747be07-7029-4273-a7e3-8024ddaedc17","Type":"ContainerDied","Data":"02fb10d164b42ddc78f460b002646179a5fc710a58389e6f3130700852c425a7"} Sep 07 16:20:28.407237 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:28.407205 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:28.408884 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:28.408855 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:20:29.006001 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:29.005955 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:29.006177 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:29.005965 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:29.006177 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:29.006111 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87hv9" podUID="ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc" Sep 07 16:20:29.006177 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:29.006157 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ffbmx" podUID="e2409fd0-edee-41fb-b5e2-00c59ce4ea59" Sep 07 16:20:29.006326 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:29.005964 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:29.006326 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:29.006243 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fkc9" podUID="f565ccb2-4d11-476a-bda4-8e203cf7be65" Sep 07 16:20:29.315091 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:29.314836 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-87hv9"] Sep 07 16:20:29.317759 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:29.317724 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ffbmx"] Sep 07 16:20:29.318401 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:29.318380 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8fkc9"] Sep 07 16:20:29.398776 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:29.398751 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f72gx_279b7732-ff48-482d-b216-0167445c26ab/ovn-acl-logging/0.log" Sep 07 16:20:29.399585 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:29.399145 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" event={"ID":"279b7732-ff48-482d-b216-0167445c26ab","Type":"ContainerStarted","Data":"11bfa6457de29caca699af036bd0e158c03917ac1389c2b546507d7af3287f56"} Sep 07 16:20:29.401227 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:29.401192 2561 generic.go:356] "Generic (PLEG): container finished" podID="5747be07-7029-4273-a7e3-8024ddaedc17" containerID="ae4c1ac5a99048b270e99fdd9903b60eef8fb9f66c328e682f1a643814c26ec9" exitCode=0 Sep 07 16:20:29.401348 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:29.401269 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:29.401348 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:29.401290 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g68wd" event={"ID":"5747be07-7029-4273-a7e3-8024ddaedc17","Type":"ContainerDied","Data":"ae4c1ac5a99048b270e99fdd9903b60eef8fb9f66c328e682f1a643814c26ec9"} Sep 07 16:20:29.401348 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:29.401334 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:29.401526 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:29.401355 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:29.401526 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:29.401423 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87hv9" podUID="ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc" Sep 07 16:20:29.401526 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:29.401457 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ffbmx" podUID="e2409fd0-edee-41fb-b5e2-00c59ce4ea59" Sep 07 16:20:29.401526 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:29.401516 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fkc9" podUID="f565ccb2-4d11-476a-bda4-8e203cf7be65" Sep 07 16:20:29.426943 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:29.426892 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" podStartSLOduration=8.335404105 podStartE2EDuration="27.426875552s" totalImagesPullingTime="19.091471447s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:20:29.426649466 +0000 UTC m=+27.984006980" watchObservedRunningTime="2026-09-07 16:20:29.426875552 +0000 UTC m=+27.984233099" Sep 07 16:20:30.406719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:30.406625 2561 generic.go:356] "Generic (PLEG): container finished" podID="5747be07-7029-4273-a7e3-8024ddaedc17" containerID="7b4f0782524e52c0704cf9f1a7dd0350551bbb2232a7635e7132405be1287370" exitCode=0 Sep 07 16:20:30.406719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:30.406702 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g68wd" event={"ID":"5747be07-7029-4273-a7e3-8024ddaedc17","Type":"ContainerDied","Data":"7b4f0782524e52c0704cf9f1a7dd0350551bbb2232a7635e7132405be1287370"} Sep 07 16:20:30.587972 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:30.587925 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pc2zg" Sep 07 16:20:30.588163 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:30.588070 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 07 16:20:30.588681 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:30.588637 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pc2zg" Sep 07 16:20:31.005749 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:31.005712 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:31.005945 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:31.005725 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:31.005945 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:31.005847 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87hv9" podUID="ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc" Sep 07 16:20:31.005945 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:31.005728 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:31.005945 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:31.005917 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fkc9" podUID="f565ccb2-4d11-476a-bda4-8e203cf7be65" Sep 07 16:20:31.006107 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:31.005994 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ffbmx" podUID="e2409fd0-edee-41fb-b5e2-00c59ce4ea59" Sep 07 16:20:33.005443 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:33.005412 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:33.005958 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:33.005522 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:33.005958 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:33.005538 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fkc9" podUID="f565ccb2-4d11-476a-bda4-8e203cf7be65" Sep 07 16:20:33.005958 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:33.005661 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87hv9" podUID="ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc" Sep 07 16:20:33.005958 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:33.005724 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:33.005958 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:33.005810 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ffbmx" podUID="e2409fd0-edee-41fb-b5e2-00c59ce4ea59" Sep 07 16:20:34.644777 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:34.644736 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret\") pod \"global-pull-secret-syncer-ffbmx\" (UID: \"e2409fd0-edee-41fb-b5e2-00c59ce4ea59\") " pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:34.645162 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:34.644880 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 16:20:34.645162 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:34.644941 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret podName:e2409fd0-edee-41fb-b5e2-00c59ce4ea59 nodeName:}" failed. No retries permitted until 2026-09-07 16:21:06.644926413 +0000 UTC m=+65.202283908 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret") pod "global-pull-secret-syncer-ffbmx" (UID: "e2409fd0-edee-41fb-b5e2-00c59ce4ea59") : object "kube-system"/"original-pull-secret" not registered Sep 07 16:20:34.745697 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:34.745658 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs\") pod \"network-metrics-daemon-87hv9\" (UID: \"ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc\") " pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:34.745864 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:34.745815 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 16:20:34.745909 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:34.745876 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs podName:ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc nodeName:}" failed. No retries permitted until 2026-09-07 16:21:06.745859117 +0000 UTC m=+65.303216621 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs") pod "network-metrics-daemon-87hv9" (UID: "ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 16:20:34.846063 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:34.846020 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cjxl\" (UniqueName: \"kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl\") pod \"network-check-target-8fkc9\" (UID: \"f565ccb2-4d11-476a-bda4-8e203cf7be65\") " pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:34.846268 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:34.846171 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 16:20:34.846268 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:34.846196 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 16:20:34.846268 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:34.846207 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6cjxl for pod openshift-network-diagnostics/network-check-target-8fkc9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 16:20:34.846268 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:34.846257 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl podName:f565ccb2-4d11-476a-bda4-8e203cf7be65 nodeName:}" failed. No retries permitted until 2026-09-07 16:21:06.846244178 +0000 UTC m=+65.403601686 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cjxl" (UniqueName: "kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl") pod "network-check-target-8fkc9" (UID: "f565ccb2-4d11-476a-bda4-8e203cf7be65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 16:20:35.005308 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:35.005279 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:35.005308 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:35.005299 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:35.005468 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:35.005292 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:35.005468 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:35.005388 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fkc9" podUID="f565ccb2-4d11-476a-bda4-8e203cf7be65" Sep 07 16:20:35.005468 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:35.005450 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ffbmx" podUID="e2409fd0-edee-41fb-b5e2-00c59ce4ea59" Sep 07 16:20:35.005599 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:35.005574 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-87hv9" podUID="ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc" Sep 07 16:20:35.420557 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:35.420521 2561 generic.go:356] "Generic (PLEG): container finished" podID="5747be07-7029-4273-a7e3-8024ddaedc17" containerID="94e564dbe13064ed99eb07c990883c7493a755ca3b8b9fbc0bf8b6ebed8f9efd" exitCode=0 Sep 07 16:20:35.420732 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:35.420567 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g68wd" event={"ID":"5747be07-7029-4273-a7e3-8024ddaedc17","Type":"ContainerDied","Data":"94e564dbe13064ed99eb07c990883c7493a755ca3b8b9fbc0bf8b6ebed8f9efd"} Sep 07 16:20:36.227672 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.227481 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-30.ec2.internal" event="NodeReady" Sep 07 16:20:36.228100 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.227770 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 07 16:20:36.268361 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.268289 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hg9mt"] Sep 07 16:20:36.283566 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.283536 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-54jsp"] Sep 07 16:20:36.283739 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.283696 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hg9mt" Sep 07 16:20:36.286599 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.286571 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-frzrw\"" Sep 07 16:20:36.286768 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.286708 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 07 16:20:36.286830 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.286766 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 07 16:20:36.305625 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.305579 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hg9mt"] Sep 07 16:20:36.305789 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.305647 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-54jsp"] Sep 07 16:20:36.305789 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.305740 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-54jsp" Sep 07 16:20:36.308177 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.308153 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 07 16:20:36.308311 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.308154 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 07 16:20:36.308311 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.308201 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dwtvh\"" Sep 07 16:20:36.308311 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.308201 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 07 16:20:36.356207 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.356169 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af773224-6d75-4aef-aaf6-445513ce226f-tmp-dir\") pod \"dns-default-hg9mt\" (UID: \"af773224-6d75-4aef-aaf6-445513ce226f\") " pod="openshift-dns/dns-default-hg9mt" Sep 07 16:20:36.356415 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.356246 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74fh7\" (UniqueName: \"kubernetes.io/projected/af773224-6d75-4aef-aaf6-445513ce226f-kube-api-access-74fh7\") pod \"dns-default-hg9mt\" (UID: \"af773224-6d75-4aef-aaf6-445513ce226f\") " pod="openshift-dns/dns-default-hg9mt" Sep 07 16:20:36.356415 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.356278 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/af773224-6d75-4aef-aaf6-445513ce226f-config-volume\") pod \"dns-default-hg9mt\" (UID: \"af773224-6d75-4aef-aaf6-445513ce226f\") " pod="openshift-dns/dns-default-hg9mt" Sep 07 16:20:36.356415 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.356325 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls\") pod \"dns-default-hg9mt\" (UID: \"af773224-6d75-4aef-aaf6-445513ce226f\") " pod="openshift-dns/dns-default-hg9mt" Sep 07 16:20:36.356415 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.356346 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e50c82f0-242a-44e6-8f95-b99991f6a6fa-cert\") pod \"ingress-canary-54jsp\" (UID: \"e50c82f0-242a-44e6-8f95-b99991f6a6fa\") " pod="openshift-ingress-canary/ingress-canary-54jsp" Sep 07 16:20:36.356553 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.356405 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w57md\" (UniqueName: \"kubernetes.io/projected/e50c82f0-242a-44e6-8f95-b99991f6a6fa-kube-api-access-w57md\") pod \"ingress-canary-54jsp\" (UID: \"e50c82f0-242a-44e6-8f95-b99991f6a6fa\") " pod="openshift-ingress-canary/ingress-canary-54jsp" Sep 07 16:20:36.426485 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.426455 2561 generic.go:356] "Generic (PLEG): container finished" podID="5747be07-7029-4273-a7e3-8024ddaedc17" containerID="9b049360af3f034444d5c0316ef62a2de8791b863376bfe99904b8c402c718e7" exitCode=0 Sep 07 16:20:36.426680 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.426526 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g68wd" event={"ID":"5747be07-7029-4273-a7e3-8024ddaedc17","Type":"ContainerDied","Data":"9b049360af3f034444d5c0316ef62a2de8791b863376bfe99904b8c402c718e7"} Sep 07 16:20:36.456866 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.456840 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w57md\" (UniqueName: \"kubernetes.io/projected/e50c82f0-242a-44e6-8f95-b99991f6a6fa-kube-api-access-w57md\") pod \"ingress-canary-54jsp\" (UID: \"e50c82f0-242a-44e6-8f95-b99991f6a6fa\") " pod="openshift-ingress-canary/ingress-canary-54jsp" Sep 07 16:20:36.456990 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.456877 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af773224-6d75-4aef-aaf6-445513ce226f-tmp-dir\") pod \"dns-default-hg9mt\" (UID: \"af773224-6d75-4aef-aaf6-445513ce226f\") " pod="openshift-dns/dns-default-hg9mt" Sep 07 16:20:36.457047 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.457001 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74fh7\" (UniqueName: \"kubernetes.io/projected/af773224-6d75-4aef-aaf6-445513ce226f-kube-api-access-74fh7\") pod \"dns-default-hg9mt\" (UID: \"af773224-6d75-4aef-aaf6-445513ce226f\") " pod="openshift-dns/dns-default-hg9mt" Sep 07 16:20:36.457047 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.457035 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/af773224-6d75-4aef-aaf6-445513ce226f-config-volume\") pod \"dns-default-hg9mt\" (UID: \"af773224-6d75-4aef-aaf6-445513ce226f\") " pod="openshift-dns/dns-default-hg9mt" Sep 07 16:20:36.457148 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.457132 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af773224-6d75-4aef-aaf6-445513ce226f-tmp-dir\") pod \"dns-default-hg9mt\" (UID: \"af773224-6d75-4aef-aaf6-445513ce226f\") " pod="openshift-dns/dns-default-hg9mt" Sep 07 16:20:36.457221 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.457186 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls\") pod \"dns-default-hg9mt\" (UID: \"af773224-6d75-4aef-aaf6-445513ce226f\") " pod="openshift-dns/dns-default-hg9mt" Sep 07 16:20:36.457273 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.457234 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e50c82f0-242a-44e6-8f95-b99991f6a6fa-cert\") pod \"ingress-canary-54jsp\" (UID: \"e50c82f0-242a-44e6-8f95-b99991f6a6fa\") " pod="openshift-ingress-canary/ingress-canary-54jsp" Sep 07 16:20:36.457329 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:36.457291 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 16:20:36.457382 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:36.457339 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls podName:af773224-6d75-4aef-aaf6-445513ce226f nodeName:}" failed. No retries permitted until 2026-09-07 16:20:36.957324086 +0000 UTC m=+35.514681577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls") pod "dns-default-hg9mt" (UID: "af773224-6d75-4aef-aaf6-445513ce226f") : secret "dns-default-metrics-tls" not found Sep 07 16:20:36.457546 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.457530 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/af773224-6d75-4aef-aaf6-445513ce226f-config-volume\") pod \"dns-default-hg9mt\" (UID: \"af773224-6d75-4aef-aaf6-445513ce226f\") " pod="openshift-dns/dns-default-hg9mt" Sep 07 16:20:36.461393 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.461365 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e50c82f0-242a-44e6-8f95-b99991f6a6fa-cert\") pod \"ingress-canary-54jsp\" (UID: \"e50c82f0-242a-44e6-8f95-b99991f6a6fa\") " pod="openshift-ingress-canary/ingress-canary-54jsp" Sep 07 16:20:36.468421 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.468397 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74fh7\" (UniqueName: \"kubernetes.io/projected/af773224-6d75-4aef-aaf6-445513ce226f-kube-api-access-74fh7\") pod \"dns-default-hg9mt\" (UID: \"af773224-6d75-4aef-aaf6-445513ce226f\") " pod="openshift-dns/dns-default-hg9mt" Sep 07 16:20:36.468602 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.468540 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w57md\" (UniqueName: \"kubernetes.io/projected/e50c82f0-242a-44e6-8f95-b99991f6a6fa-kube-api-access-w57md\") pod \"ingress-canary-54jsp\" (UID: \"e50c82f0-242a-44e6-8f95-b99991f6a6fa\") " pod="openshift-ingress-canary/ingress-canary-54jsp" Sep 07 16:20:36.613885 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.613845 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-54jsp" Sep 07 16:20:36.918083 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.917997 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-54jsp"] Sep 07 16:20:36.921664 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:20:36.921625 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode50c82f0_242a_44e6_8f95_b99991f6a6fa.slice/crio-c8e3a39b360e52ef68c66148f849a60d91d752de569ff1cafaf40c520992efaf WatchSource:0}: Error finding container c8e3a39b360e52ef68c66148f849a60d91d752de569ff1cafaf40c520992efaf: Status 404 returned error can't find the container with id c8e3a39b360e52ef68c66148f849a60d91d752de569ff1cafaf40c520992efaf Sep 07 16:20:36.961662 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:36.961626 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls\") pod \"dns-default-hg9mt\" (UID: \"af773224-6d75-4aef-aaf6-445513ce226f\") " pod="openshift-dns/dns-default-hg9mt" Sep 07 16:20:36.961838 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:36.961741 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 16:20:36.961838 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:36.961793 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls podName:af773224-6d75-4aef-aaf6-445513ce226f nodeName:}" failed. No retries permitted until 2026-09-07 16:20:37.961779405 +0000 UTC m=+36.519136895 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls") pod "dns-default-hg9mt" (UID: "af773224-6d75-4aef-aaf6-445513ce226f") : secret "dns-default-metrics-tls" not found Sep 07 16:20:37.005367 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:37.005324 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:20:37.005367 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:37.005358 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:20:37.005568 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:37.005348 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:20:37.007759 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:37.007736 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4t747\"" Sep 07 16:20:37.008081 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:37.008063 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 16:20:37.008165 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:37.008106 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hq6jn\"" Sep 07 16:20:37.008754 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:37.008735 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 16:20:37.008754 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:37.008744 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 16:20:37.008892 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:37.008787 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 16:20:37.430271 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:37.430233 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-54jsp" event={"ID":"e50c82f0-242a-44e6-8f95-b99991f6a6fa","Type":"ContainerStarted","Data":"c8e3a39b360e52ef68c66148f849a60d91d752de569ff1cafaf40c520992efaf"} Sep 07 16:20:37.434429 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:37.434398 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g68wd" event={"ID":"5747be07-7029-4273-a7e3-8024ddaedc17","Type":"ContainerStarted","Data":"ce5887cabbfdbc0ef2135b6a0f133a7186a90ca3aa5bc566a1238bfcbd1a8e79"} Sep 07 16:20:37.455705 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:37.455641 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g68wd" podStartSLOduration=6.764833544 podStartE2EDuration="35.455619149s" totalImagesPullingTime="28.690785605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:20:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:20:37.45399461 +0000 UTC m=+36.011352162" watchObservedRunningTime="2026-09-07 16:20:37.455619149 +0000 UTC m=+36.012976655" Sep 07 16:20:37.971265 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:37.971230 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls\") pod \"dns-default-hg9mt\" (UID: \"af773224-6d75-4aef-aaf6-445513ce226f\") " pod="openshift-dns/dns-default-hg9mt" Sep 07 16:20:37.971538 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:37.971397 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 16:20:37.971538 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:37.971479 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls podName:af773224-6d75-4aef-aaf6-445513ce226f nodeName:}" failed. No retries permitted until 2026-09-07 16:20:39.971458283 +0000 UTC m=+38.528815779 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls") pod "dns-default-hg9mt" (UID: "af773224-6d75-4aef-aaf6-445513ce226f") : secret "dns-default-metrics-tls" not found Sep 07 16:20:39.986832 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:39.986596 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls\") pod \"dns-default-hg9mt\" (UID: \"af773224-6d75-4aef-aaf6-445513ce226f\") " pod="openshift-dns/dns-default-hg9mt" Sep 07 16:20:39.987211 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:39.986756 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 16:20:39.987211 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:39.986942 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls podName:af773224-6d75-4aef-aaf6-445513ce226f nodeName:}" failed. No retries permitted until 2026-09-07 16:20:43.986924694 +0000 UTC m=+42.544282204 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls") pod "dns-default-hg9mt" (UID: "af773224-6d75-4aef-aaf6-445513ce226f") : secret "dns-default-metrics-tls" not found Sep 07 16:20:40.443996 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:40.443959 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-54jsp" event={"ID":"e50c82f0-242a-44e6-8f95-b99991f6a6fa","Type":"ContainerStarted","Data":"098587a2906ff7283e5c26d5891c3e469542638afdafd1ebf9616d35e9f1fbca"} Sep 07 16:20:44.018623 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:44.018568 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls\") pod \"dns-default-hg9mt\" (UID: \"af773224-6d75-4aef-aaf6-445513ce226f\") " pod="openshift-dns/dns-default-hg9mt" Sep 07 16:20:44.019163 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:44.018752 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 16:20:44.019163 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:44.018851 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls podName:af773224-6d75-4aef-aaf6-445513ce226f nodeName:}" failed. No retries permitted until 2026-09-07 16:20:52.018829164 +0000 UTC m=+50.576186671 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls") pod "dns-default-hg9mt" (UID: "af773224-6d75-4aef-aaf6-445513ce226f") : secret "dns-default-metrics-tls" not found Sep 07 16:20:52.074274 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:20:52.074232 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls\") pod \"dns-default-hg9mt\" (UID: \"af773224-6d75-4aef-aaf6-445513ce226f\") " pod="openshift-dns/dns-default-hg9mt" Sep 07 16:20:52.074765 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:52.074354 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 16:20:52.074765 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:20:52.074418 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls podName:af773224-6d75-4aef-aaf6-445513ce226f nodeName:}" failed. No retries permitted until 2026-09-07 16:21:08.074403356 +0000 UTC m=+66.631760847 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls") pod "dns-default-hg9mt" (UID: "af773224-6d75-4aef-aaf6-445513ce226f") : secret "dns-default-metrics-tls" not found Sep 07 16:21:00.417837 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:00.417807 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f72gx" Sep 07 16:21:00.442769 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:00.442709 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-54jsp" podStartSLOduration=21.889783101 podStartE2EDuration="24.442692912s" totalImagesPullingTime="2.552909811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:20:40.45721455 +0000 UTC m=+39.014572060" watchObservedRunningTime="2026-09-07 16:21:00.442692912 +0000 UTC m=+59.000050481" Sep 07 16:21:06.677593 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:06.677557 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret\") pod \"global-pull-secret-syncer-ffbmx\" (UID: \"e2409fd0-edee-41fb-b5e2-00c59ce4ea59\") " pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:21:06.680062 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:06.680035 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 16:21:06.691926 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:06.691888 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2409fd0-edee-41fb-b5e2-00c59ce4ea59-original-pull-secret\") pod \"global-pull-secret-syncer-ffbmx\" (UID: \"e2409fd0-edee-41fb-b5e2-00c59ce4ea59\") " pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:21:06.716074 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:06.716036 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ffbmx" Sep 07 16:21:06.778865 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:06.778830 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs\") pod \"network-metrics-daemon-87hv9\" (UID: \"ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc\") " pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:21:06.781148 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:06.781124 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 16:21:06.789287 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:21:06.789254 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 16:21:06.789437 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:21:06.789326 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs podName:ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc nodeName:}" failed. No retries permitted until 2026-09-07 16:22:10.78930883 +0000 UTC m=+129.346666326 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs") pod "network-metrics-daemon-87hv9" (UID: "ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc") : secret "metrics-daemon-secret" not found Sep 07 16:21:06.879773 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:06.879724 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cjxl\" (UniqueName: \"kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl\") pod \"network-check-target-8fkc9\" (UID: \"f565ccb2-4d11-476a-bda4-8e203cf7be65\") " pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:21:06.882258 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:06.882234 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 16:21:06.891751 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:06.891725 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 16:21:06.903123 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:06.903085 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cjxl\" (UniqueName: \"kubernetes.io/projected/f565ccb2-4d11-476a-bda4-8e203cf7be65-kube-api-access-6cjxl\") pod \"network-check-target-8fkc9\" (UID: \"f565ccb2-4d11-476a-bda4-8e203cf7be65\") " pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:21:07.018697 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:07.018661 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ffbmx"] Sep 07 16:21:07.020811 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:21:07.020784 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2409fd0_edee_41fb_b5e2_00c59ce4ea59.slice/crio-481da5c384d55041c56a75dfde30912d5858020f2fbd0e173e729bc94f0a7390 WatchSource:0}: Error finding container 481da5c384d55041c56a75dfde30912d5858020f2fbd0e173e729bc94f0a7390: Status 404 returned error can't find the container with id 481da5c384d55041c56a75dfde30912d5858020f2fbd0e173e729bc94f0a7390 Sep 07 16:21:07.028022 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:07.027996 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hq6jn\"" Sep 07 16:21:07.036317 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:07.036285 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:21:07.314127 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:07.314048 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8fkc9"] Sep 07 16:21:07.317153 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:21:07.317130 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf565ccb2_4d11_476a_bda4_8e203cf7be65.slice/crio-a0fc713a8c86df297bfcde59253b380d1a5afeeebfbe0588b4b21608366ff2bf WatchSource:0}: Error finding container a0fc713a8c86df297bfcde59253b380d1a5afeeebfbe0588b4b21608366ff2bf: Status 404 returned error can't find the container with id a0fc713a8c86df297bfcde59253b380d1a5afeeebfbe0588b4b21608366ff2bf Sep 07 16:21:07.509121 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:07.509074 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ffbmx" event={"ID":"e2409fd0-edee-41fb-b5e2-00c59ce4ea59","Type":"ContainerStarted","Data":"481da5c384d55041c56a75dfde30912d5858020f2fbd0e173e729bc94f0a7390"} Sep 07 16:21:07.510487 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:07.510455 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8fkc9" event={"ID":"f565ccb2-4d11-476a-bda4-8e203cf7be65","Type":"ContainerStarted","Data":"a0fc713a8c86df297bfcde59253b380d1a5afeeebfbe0588b4b21608366ff2bf"} Sep 07 16:21:08.088747 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:08.088698 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls\") pod \"dns-default-hg9mt\" (UID: \"af773224-6d75-4aef-aaf6-445513ce226f\") " pod="openshift-dns/dns-default-hg9mt" Sep 07 16:21:08.089226 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:21:08.088835 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 16:21:08.089226 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:21:08.088915 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls podName:af773224-6d75-4aef-aaf6-445513ce226f nodeName:}" failed. No retries permitted until 2026-09-07 16:21:40.088893781 +0000 UTC m=+98.646251277 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls") pod "dns-default-hg9mt" (UID: "af773224-6d75-4aef-aaf6-445513ce226f") : secret "dns-default-metrics-tls" not found Sep 07 16:21:12.525951 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:12.525910 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ffbmx" event={"ID":"e2409fd0-edee-41fb-b5e2-00c59ce4ea59","Type":"ContainerStarted","Data":"932295df9aba10c8c3b5975b572def8cc01fd5f7510bb310265eb559cdee79d5"} Sep 07 16:21:12.527461 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:12.527436 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8fkc9" event={"ID":"f565ccb2-4d11-476a-bda4-8e203cf7be65","Type":"ContainerStarted","Data":"ce106100e555c7276ebc4e3a419dbc4e4a5f53bb677db95ff3eaa622c5529c19"} Sep 07 16:21:12.527576 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:12.527561 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:21:12.539828 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:12.539778 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ffbmx" podStartSLOduration=66.01628355 podStartE2EDuration="1m10.539763379s" totalImagesPullingTime="4.523479829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:21:12.538780916 +0000 UTC m=+71.096138443" watchObservedRunningTime="2026-09-07 16:21:12.539763379 +0000 UTC m=+71.097120891" Sep 07 16:21:12.552193 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:12.552137 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8fkc9" podStartSLOduration=66.328929252 podStartE2EDuration="1m10.552118529s" totalImagesPullingTime="4.223189277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:21:12.551866605 +0000 UTC m=+71.109224128" watchObservedRunningTime="2026-09-07 16:21:12.552118529 +0000 UTC m=+71.109476032" Sep 07 16:21:19.121409 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.121369 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm"] Sep 07 16:21:19.124102 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.124080 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" Sep 07 16:21:19.127056 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.127035 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 07 16:21:19.127938 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.127913 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 07 16:21:19.128040 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.127959 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 07 16:21:19.128040 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.127977 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 07 16:21:19.128736 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.128722 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 07 16:21:19.128798 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.128748 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 07 16:21:19.128865 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.128845 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 07 16:21:19.138915 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.138887 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm"] Sep 07 16:21:19.267004 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.266958 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a476862b-9aa5-4a9c-af13-66718859de7e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c884465f8-vp5nm\" (UID: \"a476862b-9aa5-4a9c-af13-66718859de7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" Sep 07 16:21:19.267201 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.267038 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a476862b-9aa5-4a9c-af13-66718859de7e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c884465f8-vp5nm\" (UID: \"a476862b-9aa5-4a9c-af13-66718859de7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" Sep 07 16:21:19.267201 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.267090 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a476862b-9aa5-4a9c-af13-66718859de7e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c884465f8-vp5nm\" (UID: \"a476862b-9aa5-4a9c-af13-66718859de7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" Sep 07 16:21:19.267201 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.267114 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a476862b-9aa5-4a9c-af13-66718859de7e-hub\") pod \"cluster-proxy-proxy-agent-6c884465f8-vp5nm\" (UID: \"a476862b-9aa5-4a9c-af13-66718859de7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" Sep 07 16:21:19.267201 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.267157 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a476862b-9aa5-4a9c-af13-66718859de7e-ca\") pod \"cluster-proxy-proxy-agent-6c884465f8-vp5nm\" (UID: \"a476862b-9aa5-4a9c-af13-66718859de7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" Sep 07 16:21:19.267201 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.267196 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4rpm\" (UniqueName: \"kubernetes.io/projected/a476862b-9aa5-4a9c-af13-66718859de7e-kube-api-access-h4rpm\") pod \"cluster-proxy-proxy-agent-6c884465f8-vp5nm\" (UID: \"a476862b-9aa5-4a9c-af13-66718859de7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" Sep 07 16:21:19.367493 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.367456 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a476862b-9aa5-4a9c-af13-66718859de7e-hub\") pod \"cluster-proxy-proxy-agent-6c884465f8-vp5nm\" (UID: \"a476862b-9aa5-4a9c-af13-66718859de7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" Sep 07 16:21:19.367493 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.367494 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a476862b-9aa5-4a9c-af13-66718859de7e-ca\") pod \"cluster-proxy-proxy-agent-6c884465f8-vp5nm\" (UID: \"a476862b-9aa5-4a9c-af13-66718859de7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" Sep 07 16:21:19.367683 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.367517 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4rpm\" (UniqueName: \"kubernetes.io/projected/a476862b-9aa5-4a9c-af13-66718859de7e-kube-api-access-h4rpm\") pod \"cluster-proxy-proxy-agent-6c884465f8-vp5nm\" (UID: \"a476862b-9aa5-4a9c-af13-66718859de7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" Sep 07 16:21:19.367683 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.367536 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a476862b-9aa5-4a9c-af13-66718859de7e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c884465f8-vp5nm\" (UID: \"a476862b-9aa5-4a9c-af13-66718859de7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" Sep 07 16:21:19.367683 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.367571 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a476862b-9aa5-4a9c-af13-66718859de7e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c884465f8-vp5nm\" (UID: \"a476862b-9aa5-4a9c-af13-66718859de7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" Sep 07 16:21:19.367683 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.367600 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a476862b-9aa5-4a9c-af13-66718859de7e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c884465f8-vp5nm\" (UID: \"a476862b-9aa5-4a9c-af13-66718859de7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" Sep 07 16:21:19.368339 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.368314 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a476862b-9aa5-4a9c-af13-66718859de7e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c884465f8-vp5nm\" (UID: \"a476862b-9aa5-4a9c-af13-66718859de7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" Sep 07 16:21:19.370340 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.370314 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a476862b-9aa5-4a9c-af13-66718859de7e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c884465f8-vp5nm\" (UID: \"a476862b-9aa5-4a9c-af13-66718859de7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" Sep 07 16:21:19.370436 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.370357 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a476862b-9aa5-4a9c-af13-66718859de7e-ca\") pod \"cluster-proxy-proxy-agent-6c884465f8-vp5nm\" (UID: \"a476862b-9aa5-4a9c-af13-66718859de7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" Sep 07 16:21:19.370512 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.370495 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a476862b-9aa5-4a9c-af13-66718859de7e-hub\") pod \"cluster-proxy-proxy-agent-6c884465f8-vp5nm\" (UID: \"a476862b-9aa5-4a9c-af13-66718859de7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" Sep 07 16:21:19.370551 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.370501 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a476862b-9aa5-4a9c-af13-66718859de7e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c884465f8-vp5nm\" (UID: \"a476862b-9aa5-4a9c-af13-66718859de7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" Sep 07 16:21:19.374778 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.374725 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4rpm\" (UniqueName: \"kubernetes.io/projected/a476862b-9aa5-4a9c-af13-66718859de7e-kube-api-access-h4rpm\") pod \"cluster-proxy-proxy-agent-6c884465f8-vp5nm\" (UID: \"a476862b-9aa5-4a9c-af13-66718859de7e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" Sep 07 16:21:19.449815 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.449778 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" Sep 07 16:21:19.721329 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:19.721292 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm"] Sep 07 16:21:19.725785 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:21:19.725742 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda476862b_9aa5_4a9c_af13_66718859de7e.slice/crio-5bfe262061a7d31974bc0b1626097385093dcf12ee5dcdcd681cbfa48beb186e WatchSource:0}: Error finding container 5bfe262061a7d31974bc0b1626097385093dcf12ee5dcdcd681cbfa48beb186e: Status 404 returned error can't find the container with id 5bfe262061a7d31974bc0b1626097385093dcf12ee5dcdcd681cbfa48beb186e Sep 07 16:21:20.548232 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:20.548194 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" event={"ID":"a476862b-9aa5-4a9c-af13-66718859de7e","Type":"ContainerStarted","Data":"5bfe262061a7d31974bc0b1626097385093dcf12ee5dcdcd681cbfa48beb186e"} Sep 07 16:21:40.119558 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:40.119518 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls\") pod \"dns-default-hg9mt\" (UID: \"af773224-6d75-4aef-aaf6-445513ce226f\") " pod="openshift-dns/dns-default-hg9mt" Sep 07 16:21:40.120052 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:21:40.119717 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 16:21:40.120052 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:21:40.119805 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls podName:af773224-6d75-4aef-aaf6-445513ce226f nodeName:}" failed. No retries permitted until 2026-09-07 16:22:44.119783851 +0000 UTC m=+162.677141345 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls") pod "dns-default-hg9mt" (UID: "af773224-6d75-4aef-aaf6-445513ce226f") : secret "dns-default-metrics-tls" not found Sep 07 16:21:42.604797 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:42.604746 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" event={"ID":"a476862b-9aa5-4a9c-af13-66718859de7e","Type":"ContainerStarted","Data":"027fb13edd8c8277b3762f9d9ef61ba72a304c93e5723fe48956fef6ef5372ca"} Sep 07 16:21:42.605272 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:42.604810 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" event={"ID":"a476862b-9aa5-4a9c-af13-66718859de7e","Type":"ContainerStarted","Data":"c70fd8fbe07435b8f13491ba70a2d5aa490eb0d3a03f6006fe4a8a1e91c5e120"} Sep 07 16:21:42.605272 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:42.604827 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" event={"ID":"a476862b-9aa5-4a9c-af13-66718859de7e","Type":"ContainerStarted","Data":"0dd388e2bf56632d205f42ada261d43f255abed06bb6e914612acca4a52f9ff3"} Sep 07 16:21:42.621214 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:42.621146 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" podStartSLOduration=1.5835134069999999 podStartE2EDuration="23.621129605s" totalImagesPullingTime="22.037616198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:21:42.619686028 +0000 UTC m=+101.177043552" watchObservedRunningTime="2026-09-07 16:21:42.621129605 +0000 UTC m=+101.178487118" Sep 07 16:21:43.532804 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:21:43.532762 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8fkc9" Sep 07 16:22:10.834874 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:22:10.834815 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs\") pod \"network-metrics-daemon-87hv9\" (UID: \"ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc\") " pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:22:10.835381 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:22:10.834970 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 16:22:10.835381 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:22:10.835044 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs podName:ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc nodeName:}" failed. No retries permitted until 2026-09-07 16:24:12.835028768 +0000 UTC m=+251.392386265 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs") pod "network-metrics-daemon-87hv9" (UID: "ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc") : secret "metrics-daemon-secret" not found Sep 07 16:22:39.293575 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:22:39.293511 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hg9mt" podUID="af773224-6d75-4aef-aaf6-445513ce226f" Sep 07 16:22:39.777155 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:22:39.777123 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hg9mt" Sep 07 16:22:40.021133 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:22:40.021071 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-87hv9" podUID="ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc" Sep 07 16:22:44.169152 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:22:44.169106 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls\") pod \"dns-default-hg9mt\" (UID: \"af773224-6d75-4aef-aaf6-445513ce226f\") " pod="openshift-dns/dns-default-hg9mt" Sep 07 16:22:44.169670 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:22:44.169224 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 16:22:44.169670 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:22:44.169308 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls podName:af773224-6d75-4aef-aaf6-445513ce226f nodeName:}" failed. No retries permitted until 2026-09-07 16:24:46.169293228 +0000 UTC m=+284.726650719 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls") pod "dns-default-hg9mt" (UID: "af773224-6d75-4aef-aaf6-445513ce226f") : secret "dns-default-metrics-tls" not found Sep 07 16:22:54.005591 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:22:54.005499 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:24:12.882240 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:12.882196 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs\") pod \"network-metrics-daemon-87hv9\" (UID: \"ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc\") " pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:24:12.882761 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:12.882329 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 16:24:12.882761 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:12.882393 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs podName:ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc nodeName:}" failed. No retries permitted until 2026-09-07 16:26:14.882378848 +0000 UTC m=+373.439736339 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs") pod "network-metrics-daemon-87hv9" (UID: "ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc") : secret "metrics-daemon-secret" not found Sep 07 16:24:24.158925 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.158832 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6v52m"] Sep 07 16:24:24.160863 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.160837 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:24.165981 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.165955 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 07 16:24:24.166157 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.166073 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-c5qhj\"" Sep 07 16:24:24.166407 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.166384 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 07 16:24:24.166523 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.166421 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 07 16:24:24.166701 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.166684 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 07 16:24:24.176246 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.176212 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6v52m"] Sep 07 16:24:24.265708 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.265667 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4b52d58-79e7-48ce-bcaa-cdc38323e992-data-volume\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:24.265892 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.265716 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4b52d58-79e7-48ce-bcaa-cdc38323e992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:24.265892 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.265776 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6d8p\" (UniqueName: \"kubernetes.io/projected/d4b52d58-79e7-48ce-bcaa-cdc38323e992-kube-api-access-j6d8p\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:24.265892 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.265805 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d4b52d58-79e7-48ce-bcaa-cdc38323e992-crio-socket\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:24.265892 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.265841 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4b52d58-79e7-48ce-bcaa-cdc38323e992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:24.366463 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.366432 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4b52d58-79e7-48ce-bcaa-cdc38323e992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:24.366463 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.366468 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4b52d58-79e7-48ce-bcaa-cdc38323e992-data-volume\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:24.366721 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.366492 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4b52d58-79e7-48ce-bcaa-cdc38323e992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:24.366721 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.366521 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6d8p\" (UniqueName: \"kubernetes.io/projected/d4b52d58-79e7-48ce-bcaa-cdc38323e992-kube-api-access-j6d8p\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:24.366721 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.366543 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d4b52d58-79e7-48ce-bcaa-cdc38323e992-crio-socket\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:24.366721 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:24.366566 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 16:24:24.366721 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:24.366641 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 16:24:24.366721 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.366649 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d4b52d58-79e7-48ce-bcaa-cdc38323e992-crio-socket\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:24.366721 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:24.366696 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4b52d58-79e7-48ce-bcaa-cdc38323e992-kube-rbac-proxy-cm podName:d4b52d58-79e7-48ce-bcaa-cdc38323e992 nodeName:}" failed. No retries permitted until 2026-09-07 16:24:24.866673652 +0000 UTC m=+263.424031165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d4b52d58-79e7-48ce-bcaa-cdc38323e992-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6v52m" (UID: "d4b52d58-79e7-48ce-bcaa-cdc38323e992") : configmap "kube-rbac-proxy" not found Sep 07 16:24:24.366721 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:24.366711 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4b52d58-79e7-48ce-bcaa-cdc38323e992-insights-runtime-extractor-tls podName:d4b52d58-79e7-48ce-bcaa-cdc38323e992 nodeName:}" failed. No retries permitted until 2026-09-07 16:24:24.866705457 +0000 UTC m=+263.424062948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d4b52d58-79e7-48ce-bcaa-cdc38323e992-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6v52m" (UID: "d4b52d58-79e7-48ce-bcaa-cdc38323e992") : secret "insights-runtime-extractor-tls" not found Sep 07 16:24:24.367010 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.366798 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4b52d58-79e7-48ce-bcaa-cdc38323e992-data-volume\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:24.391340 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.391303 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6d8p\" (UniqueName: \"kubernetes.io/projected/d4b52d58-79e7-48ce-bcaa-cdc38323e992-kube-api-access-j6d8p\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:24.870879 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.870827 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4b52d58-79e7-48ce-bcaa-cdc38323e992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:24.870879 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:24.870887 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4b52d58-79e7-48ce-bcaa-cdc38323e992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:24.871116 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:24.870960 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 16:24:24.871116 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:24.870979 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 16:24:24.871116 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:24.871031 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4b52d58-79e7-48ce-bcaa-cdc38323e992-insights-runtime-extractor-tls podName:d4b52d58-79e7-48ce-bcaa-cdc38323e992 nodeName:}" failed. No retries permitted until 2026-09-07 16:24:25.871018111 +0000 UTC m=+264.428375602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d4b52d58-79e7-48ce-bcaa-cdc38323e992-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6v52m" (UID: "d4b52d58-79e7-48ce-bcaa-cdc38323e992") : secret "insights-runtime-extractor-tls" not found Sep 07 16:24:24.871116 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:24.871044 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4b52d58-79e7-48ce-bcaa-cdc38323e992-kube-rbac-proxy-cm podName:d4b52d58-79e7-48ce-bcaa-cdc38323e992 nodeName:}" failed. No retries permitted until 2026-09-07 16:24:25.871037552 +0000 UTC m=+264.428395043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d4b52d58-79e7-48ce-bcaa-cdc38323e992-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6v52m" (UID: "d4b52d58-79e7-48ce-bcaa-cdc38323e992") : configmap "kube-rbac-proxy" not found Sep 07 16:24:25.866656 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:25.866626 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9hdjp_7536adc5-f824-4a34-ab2f-9505253e1409/dns-node-resolver/0.log" Sep 07 16:24:25.878069 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:25.878036 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4b52d58-79e7-48ce-bcaa-cdc38323e992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:25.878165 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:25.878131 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4b52d58-79e7-48ce-bcaa-cdc38323e992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:25.878207 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:25.878192 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 16:24:25.878241 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:25.878203 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 16:24:25.878274 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:25.878264 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4b52d58-79e7-48ce-bcaa-cdc38323e992-kube-rbac-proxy-cm podName:d4b52d58-79e7-48ce-bcaa-cdc38323e992 nodeName:}" failed. No retries permitted until 2026-09-07 16:24:27.878246152 +0000 UTC m=+266.435603659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d4b52d58-79e7-48ce-bcaa-cdc38323e992-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6v52m" (UID: "d4b52d58-79e7-48ce-bcaa-cdc38323e992") : configmap "kube-rbac-proxy" not found Sep 07 16:24:25.878314 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:25.878280 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4b52d58-79e7-48ce-bcaa-cdc38323e992-insights-runtime-extractor-tls podName:d4b52d58-79e7-48ce-bcaa-cdc38323e992 nodeName:}" failed. No retries permitted until 2026-09-07 16:24:27.878272337 +0000 UTC m=+266.435629827 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d4b52d58-79e7-48ce-bcaa-cdc38323e992-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6v52m" (UID: "d4b52d58-79e7-48ce-bcaa-cdc38323e992") : secret "insights-runtime-extractor-tls" not found Sep 07 16:24:27.070372 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.070336 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-4nrmz"] Sep 07 16:24:27.072672 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.072648 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l9j65_81813711-9d30-4e49-88fb-051b60f3061f/node-ca/0.log" Sep 07 16:24:27.072809 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.072751 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-4nrmz" Sep 07 16:24:27.075113 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.075084 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 07 16:24:27.075487 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.075468 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qsp6w\"" Sep 07 16:24:27.075952 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.075931 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 07 16:24:27.076066 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.075971 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 07 16:24:27.076066 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.076037 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 07 16:24:27.083507 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.083479 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-4nrmz"] Sep 07 16:24:27.190989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.190916 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e4d65bed-a47e-4fc6-acd0-a71338a8dcb4-signing-key\") pod \"service-ca-75d99c484-4nrmz\" (UID: \"e4d65bed-a47e-4fc6-acd0-a71338a8dcb4\") " pod="openshift-service-ca/service-ca-75d99c484-4nrmz" Sep 07 16:24:27.191175 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.191043 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e4d65bed-a47e-4fc6-acd0-a71338a8dcb4-signing-cabundle\") pod \"service-ca-75d99c484-4nrmz\" (UID: \"e4d65bed-a47e-4fc6-acd0-a71338a8dcb4\") " pod="openshift-service-ca/service-ca-75d99c484-4nrmz" Sep 07 16:24:27.191175 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.191073 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9m4s\" (UniqueName: \"kubernetes.io/projected/e4d65bed-a47e-4fc6-acd0-a71338a8dcb4-kube-api-access-p9m4s\") pod \"service-ca-75d99c484-4nrmz\" (UID: \"e4d65bed-a47e-4fc6-acd0-a71338a8dcb4\") " pod="openshift-service-ca/service-ca-75d99c484-4nrmz" Sep 07 16:24:27.291999 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.291965 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e4d65bed-a47e-4fc6-acd0-a71338a8dcb4-signing-cabundle\") pod \"service-ca-75d99c484-4nrmz\" (UID: \"e4d65bed-a47e-4fc6-acd0-a71338a8dcb4\") " pod="openshift-service-ca/service-ca-75d99c484-4nrmz" Sep 07 16:24:27.292074 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.292003 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9m4s\" (UniqueName: \"kubernetes.io/projected/e4d65bed-a47e-4fc6-acd0-a71338a8dcb4-kube-api-access-p9m4s\") pod \"service-ca-75d99c484-4nrmz\" (UID: \"e4d65bed-a47e-4fc6-acd0-a71338a8dcb4\") " pod="openshift-service-ca/service-ca-75d99c484-4nrmz" Sep 07 16:24:27.292074 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.292052 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e4d65bed-a47e-4fc6-acd0-a71338a8dcb4-signing-key\") pod \"service-ca-75d99c484-4nrmz\" (UID: \"e4d65bed-a47e-4fc6-acd0-a71338a8dcb4\") " pod="openshift-service-ca/service-ca-75d99c484-4nrmz" Sep 07 16:24:27.292698 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.292674 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e4d65bed-a47e-4fc6-acd0-a71338a8dcb4-signing-cabundle\") pod \"service-ca-75d99c484-4nrmz\" (UID: \"e4d65bed-a47e-4fc6-acd0-a71338a8dcb4\") " pod="openshift-service-ca/service-ca-75d99c484-4nrmz" Sep 07 16:24:27.294581 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.294558 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e4d65bed-a47e-4fc6-acd0-a71338a8dcb4-signing-key\") pod \"service-ca-75d99c484-4nrmz\" (UID: \"e4d65bed-a47e-4fc6-acd0-a71338a8dcb4\") " pod="openshift-service-ca/service-ca-75d99c484-4nrmz" Sep 07 16:24:27.300174 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.300148 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9m4s\" (UniqueName: \"kubernetes.io/projected/e4d65bed-a47e-4fc6-acd0-a71338a8dcb4-kube-api-access-p9m4s\") pod \"service-ca-75d99c484-4nrmz\" (UID: \"e4d65bed-a47e-4fc6-acd0-a71338a8dcb4\") " pod="openshift-service-ca/service-ca-75d99c484-4nrmz" Sep 07 16:24:27.381950 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.381865 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-4nrmz" Sep 07 16:24:27.656985 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.656897 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-4nrmz"] Sep 07 16:24:27.660542 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:24:27.660506 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d65bed_a47e_4fc6_acd0_a71338a8dcb4.slice/crio-6c746048c37db5bb3c93bded288016b1f29389543738a65b2b94d62c53844621 WatchSource:0}: Error finding container 6c746048c37db5bb3c93bded288016b1f29389543738a65b2b94d62c53844621: Status 404 returned error can't find the container with id 6c746048c37db5bb3c93bded288016b1f29389543738a65b2b94d62c53844621 Sep 07 16:24:27.666113 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.666086 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-54jsp_e50c82f0-242a-44e6-8f95-b99991f6a6fa/serve-healthcheck-canary/0.log" Sep 07 16:24:27.895949 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.895906 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4b52d58-79e7-48ce-bcaa-cdc38323e992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:27.896132 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:27.896080 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 16:24:27.896132 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:27.896108 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4b52d58-79e7-48ce-bcaa-cdc38323e992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:27.896218 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:27.896155 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4b52d58-79e7-48ce-bcaa-cdc38323e992-insights-runtime-extractor-tls podName:d4b52d58-79e7-48ce-bcaa-cdc38323e992 nodeName:}" failed. No retries permitted until 2026-09-07 16:24:31.896137827 +0000 UTC m=+270.453495338 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d4b52d58-79e7-48ce-bcaa-cdc38323e992-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6v52m" (UID: "d4b52d58-79e7-48ce-bcaa-cdc38323e992") : secret "insights-runtime-extractor-tls" not found Sep 07 16:24:27.896218 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:27.896196 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 16:24:27.896306 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:27.896233 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4b52d58-79e7-48ce-bcaa-cdc38323e992-kube-rbac-proxy-cm podName:d4b52d58-79e7-48ce-bcaa-cdc38323e992 nodeName:}" failed. No retries permitted until 2026-09-07 16:24:31.896220525 +0000 UTC m=+270.453578016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d4b52d58-79e7-48ce-bcaa-cdc38323e992-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6v52m" (UID: "d4b52d58-79e7-48ce-bcaa-cdc38323e992") : configmap "kube-rbac-proxy" not found Sep 07 16:24:28.083704 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:28.083644 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-4nrmz" event={"ID":"e4d65bed-a47e-4fc6-acd0-a71338a8dcb4","Type":"ContainerStarted","Data":"6c746048c37db5bb3c93bded288016b1f29389543738a65b2b94d62c53844621"} Sep 07 16:24:30.091583 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:30.091545 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-4nrmz" event={"ID":"e4d65bed-a47e-4fc6-acd0-a71338a8dcb4","Type":"ContainerStarted","Data":"c18b4fc917370b32cfc6881c6c4337428ad2070614a534bdd4dff4bef2d2bda5"} Sep 07 16:24:31.930321 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:31.930274 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4b52d58-79e7-48ce-bcaa-cdc38323e992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:31.930745 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:31.930367 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4b52d58-79e7-48ce-bcaa-cdc38323e992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:31.930745 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:31.930440 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 16:24:31.930745 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:31.930444 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 16:24:31.930745 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:31.930493 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4b52d58-79e7-48ce-bcaa-cdc38323e992-kube-rbac-proxy-cm podName:d4b52d58-79e7-48ce-bcaa-cdc38323e992 nodeName:}" failed. No retries permitted until 2026-09-07 16:24:39.930478601 +0000 UTC m=+278.487836105 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d4b52d58-79e7-48ce-bcaa-cdc38323e992-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6v52m" (UID: "d4b52d58-79e7-48ce-bcaa-cdc38323e992") : configmap "kube-rbac-proxy" not found Sep 07 16:24:31.930745 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:31.930506 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4b52d58-79e7-48ce-bcaa-cdc38323e992-insights-runtime-extractor-tls podName:d4b52d58-79e7-48ce-bcaa-cdc38323e992 nodeName:}" failed. No retries permitted until 2026-09-07 16:24:39.930500118 +0000 UTC m=+278.487857608 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d4b52d58-79e7-48ce-bcaa-cdc38323e992-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6v52m" (UID: "d4b52d58-79e7-48ce-bcaa-cdc38323e992") : secret "insights-runtime-extractor-tls" not found Sep 07 16:24:39.989253 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:39.989203 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4b52d58-79e7-48ce-bcaa-cdc38323e992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:39.989699 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:39.989276 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 16:24:39.989699 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:39.989320 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4b52d58-79e7-48ce-bcaa-cdc38323e992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:39.989699 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:39.989349 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4b52d58-79e7-48ce-bcaa-cdc38323e992-insights-runtime-extractor-tls podName:d4b52d58-79e7-48ce-bcaa-cdc38323e992 nodeName:}" failed. No retries permitted until 2026-09-07 16:24:55.989329139 +0000 UTC m=+294.546686630 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d4b52d58-79e7-48ce-bcaa-cdc38323e992-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6v52m" (UID: "d4b52d58-79e7-48ce-bcaa-cdc38323e992") : secret "insights-runtime-extractor-tls" not found Sep 07 16:24:39.989819 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:39.989756 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4b52d58-79e7-48ce-bcaa-cdc38323e992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:42.778122 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:42.778067 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hg9mt" podUID="af773224-6d75-4aef-aaf6-445513ce226f" Sep 07 16:24:43.131013 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:43.130927 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hg9mt" Sep 07 16:24:46.237874 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:46.237814 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls\") pod \"dns-default-hg9mt\" (UID: \"af773224-6d75-4aef-aaf6-445513ce226f\") " pod="openshift-dns/dns-default-hg9mt" Sep 07 16:24:46.240244 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:46.240216 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af773224-6d75-4aef-aaf6-445513ce226f-metrics-tls\") pod \"dns-default-hg9mt\" (UID: \"af773224-6d75-4aef-aaf6-445513ce226f\") " pod="openshift-dns/dns-default-hg9mt" Sep 07 16:24:46.433940 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:46.433912 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-frzrw\"" Sep 07 16:24:46.442799 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:46.442766 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hg9mt" Sep 07 16:24:46.710328 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:46.710243 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-4nrmz" podStartSLOduration=17.900016047 podStartE2EDuration="19.71022443s" totalImagesPullingTime="1.810208383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:24:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:24:30.134543286 +0000 UTC m=+268.691900801" watchObservedRunningTime="2026-09-07 16:24:46.71022443 +0000 UTC m=+285.267581940" Sep 07 16:24:46.710519 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:46.710505 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hg9mt"] Sep 07 16:24:46.713183 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:24:46.713151 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf773224_6d75_4aef_aaf6_445513ce226f.slice/crio-ce9a80e4470476792a7f5bcd777e70317f38e6cdf3b2959dbb6be991dc4ab06f WatchSource:0}: Error finding container ce9a80e4470476792a7f5bcd777e70317f38e6cdf3b2959dbb6be991dc4ab06f: Status 404 returned error can't find the container with id ce9a80e4470476792a7f5bcd777e70317f38e6cdf3b2959dbb6be991dc4ab06f Sep 07 16:24:47.142811 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.142772 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hg9mt" event={"ID":"af773224-6d75-4aef-aaf6-445513ce226f","Type":"ContainerStarted","Data":"ce9a80e4470476792a7f5bcd777e70317f38e6cdf3b2959dbb6be991dc4ab06f"} Sep 07 16:24:47.591255 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.591219 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cbd4dd8-5szcm"] Sep 07 16:24:47.594556 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.594529 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.597792 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.597764 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 07 16:24:47.597792 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.597783 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5jf79\"" Sep 07 16:24:47.598001 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.597811 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 07 16:24:47.598001 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.597764 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 07 16:24:47.601914 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.601878 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 07 16:24:47.608079 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.608050 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cbd4dd8-5szcm"] Sep 07 16:24:47.647989 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.647943 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/442d3ce0-b47d-4e50-9271-aef27cf7b33c-ca-trust-extracted\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.648176 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.648003 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/442d3ce0-b47d-4e50-9271-aef27cf7b33c-registry-certificates\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.648176 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.648023 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gdfc\" (UniqueName: \"kubernetes.io/projected/442d3ce0-b47d-4e50-9271-aef27cf7b33c-kube-api-access-5gdfc\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.648176 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.648045 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/442d3ce0-b47d-4e50-9271-aef27cf7b33c-bound-sa-token\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.648176 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.648093 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/442d3ce0-b47d-4e50-9271-aef27cf7b33c-trusted-ca\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.648176 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.648138 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/442d3ce0-b47d-4e50-9271-aef27cf7b33c-image-registry-private-configuration\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.648176 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.648163 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/442d3ce0-b47d-4e50-9271-aef27cf7b33c-installation-pull-secrets\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.648505 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.648207 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/442d3ce0-b47d-4e50-9271-aef27cf7b33c-registry-tls\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.749363 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.749318 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/442d3ce0-b47d-4e50-9271-aef27cf7b33c-ca-trust-extracted\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.749363 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.749367 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/442d3ce0-b47d-4e50-9271-aef27cf7b33c-registry-certificates\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.749628 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.749491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gdfc\" (UniqueName: \"kubernetes.io/projected/442d3ce0-b47d-4e50-9271-aef27cf7b33c-kube-api-access-5gdfc\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.749628 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.749589 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/442d3ce0-b47d-4e50-9271-aef27cf7b33c-bound-sa-token\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.749752 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.749638 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/442d3ce0-b47d-4e50-9271-aef27cf7b33c-trusted-ca\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.749823 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.749794 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/442d3ce0-b47d-4e50-9271-aef27cf7b33c-image-registry-private-configuration\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.749875 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.749837 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/442d3ce0-b47d-4e50-9271-aef27cf7b33c-installation-pull-secrets\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.749875 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.749867 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/442d3ce0-b47d-4e50-9271-aef27cf7b33c-registry-tls\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.749979 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.749907 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/442d3ce0-b47d-4e50-9271-aef27cf7b33c-ca-trust-extracted\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.750446 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.750396 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/442d3ce0-b47d-4e50-9271-aef27cf7b33c-registry-certificates\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.751051 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.751028 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/442d3ce0-b47d-4e50-9271-aef27cf7b33c-trusted-ca\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.752844 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.752795 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/442d3ce0-b47d-4e50-9271-aef27cf7b33c-registry-tls\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.752844 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.752809 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/442d3ce0-b47d-4e50-9271-aef27cf7b33c-image-registry-private-configuration\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.753011 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.752999 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/442d3ce0-b47d-4e50-9271-aef27cf7b33c-installation-pull-secrets\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.757437 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.757400 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/442d3ce0-b47d-4e50-9271-aef27cf7b33c-bound-sa-token\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.757566 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.757537 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gdfc\" (UniqueName: \"kubernetes.io/projected/442d3ce0-b47d-4e50-9271-aef27cf7b33c-kube-api-access-5gdfc\") pod \"image-registry-6cbd4dd8-5szcm\" (UID: \"442d3ce0-b47d-4e50-9271-aef27cf7b33c\") " pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:47.907024 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:47.906936 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:48.187575 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:48.187534 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cbd4dd8-5szcm"] Sep 07 16:24:48.428783 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:24:48.428749 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod442d3ce0_b47d_4e50_9271_aef27cf7b33c.slice/crio-70cead66ae689c364b5d69db83e21d88271b529baf98ea0da1c23cd7b3eb3799 WatchSource:0}: Error finding container 70cead66ae689c364b5d69db83e21d88271b529baf98ea0da1c23cd7b3eb3799: Status 404 returned error can't find the container with id 70cead66ae689c364b5d69db83e21d88271b529baf98ea0da1c23cd7b3eb3799 Sep 07 16:24:49.150815 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:49.150777 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" event={"ID":"442d3ce0-b47d-4e50-9271-aef27cf7b33c","Type":"ContainerStarted","Data":"af7e8bf55f6455408ee267265d728b7a266ef0a5967e1cda18d0b8e52b1957e6"} Sep 07 16:24:49.151252 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:49.150831 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" event={"ID":"442d3ce0-b47d-4e50-9271-aef27cf7b33c","Type":"ContainerStarted","Data":"70cead66ae689c364b5d69db83e21d88271b529baf98ea0da1c23cd7b3eb3799"} Sep 07 16:24:49.151252 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:49.150890 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:24:49.152726 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:49.152698 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hg9mt" event={"ID":"af773224-6d75-4aef-aaf6-445513ce226f","Type":"ContainerStarted","Data":"861a4cd32fa84aeb59c8eafdae12dd73df5e0714eac7a17008371b34fbea4ea3"} Sep 07 16:24:49.152862 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:49.152744 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hg9mt" event={"ID":"af773224-6d75-4aef-aaf6-445513ce226f","Type":"ContainerStarted","Data":"e84df0ee9f407d97a3a6447e969a2903b9c3566bf594dfdb234cec1de2ad1d97"} Sep 07 16:24:49.152862 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:49.152835 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hg9mt" Sep 07 16:24:49.167770 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:49.167720 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" podStartSLOduration=2.16770484 podStartE2EDuration="2.16770484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:24:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:24:49.166828452 +0000 UTC m=+287.724185984" watchObservedRunningTime="2026-09-07 16:24:49.16770484 +0000 UTC m=+287.725062352" Sep 07 16:24:49.181130 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:49.181077 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hg9mt" podStartSLOduration=251.418681754 podStartE2EDuration="4m13.181058433s" totalImagesPullingTime="1.762376679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:24:49.180261392 +0000 UTC m=+287.737618928" watchObservedRunningTime="2026-09-07 16:24:49.181058433 +0000 UTC m=+287.738415945" Sep 07 16:24:56.013493 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.013452 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4b52d58-79e7-48ce-bcaa-cdc38323e992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:56.015846 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.015818 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4b52d58-79e7-48ce-bcaa-cdc38323e992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v52m\" (UID: \"d4b52d58-79e7-48ce-bcaa-cdc38323e992\") " pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:56.269994 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.269882 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6v52m" Sep 07 16:24:56.540386 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.540303 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6v52m"] Sep 07 16:24:56.543491 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:24:56.543454 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4b52d58_79e7_48ce_bcaa_cdc38323e992.slice/crio-68cdaaab720f40058507f17d472c71fee728cd80dfdb32637f4f0aa70bbfee4f WatchSource:0}: Error finding container 68cdaaab720f40058507f17d472c71fee728cd80dfdb32637f4f0aa70bbfee4f: Status 404 returned error can't find the container with id 68cdaaab720f40058507f17d472c71fee728cd80dfdb32637f4f0aa70bbfee4f Sep 07 16:24:56.731645 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.731596 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-hkjvl"] Sep 07 16:24:56.734827 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.734808 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-hkjvl" Sep 07 16:24:56.737249 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.737221 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 07 16:24:56.737249 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.737229 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 07 16:24:56.738235 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.738214 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 07 16:24:56.738294 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.738232 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 07 16:24:56.738294 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.738253 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 07 16:24:56.738400 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.738290 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6qbv9\"" Sep 07 16:24:56.743309 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.743275 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-hkjvl"] Sep 07 16:24:56.819490 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.819402 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e057836-5665-41b9-99ca-a0307af1dfaa-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-hkjvl\" (UID: \"1e057836-5665-41b9-99ca-a0307af1dfaa\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hkjvl" Sep 07 16:24:56.819490 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.819451 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e057836-5665-41b9-99ca-a0307af1dfaa-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-hkjvl\" (UID: \"1e057836-5665-41b9-99ca-a0307af1dfaa\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hkjvl" Sep 07 16:24:56.819490 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.819479 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e057836-5665-41b9-99ca-a0307af1dfaa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-hkjvl\" (UID: \"1e057836-5665-41b9-99ca-a0307af1dfaa\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hkjvl" Sep 07 16:24:56.819799 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.819641 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz6nw\" (UniqueName: \"kubernetes.io/projected/1e057836-5665-41b9-99ca-a0307af1dfaa-kube-api-access-lz6nw\") pod \"prometheus-operator-6f4946db56-hkjvl\" (UID: \"1e057836-5665-41b9-99ca-a0307af1dfaa\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hkjvl" Sep 07 16:24:56.920476 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.920437 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz6nw\" (UniqueName: \"kubernetes.io/projected/1e057836-5665-41b9-99ca-a0307af1dfaa-kube-api-access-lz6nw\") pod \"prometheus-operator-6f4946db56-hkjvl\" (UID: \"1e057836-5665-41b9-99ca-a0307af1dfaa\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hkjvl" Sep 07 16:24:56.920644 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.920507 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e057836-5665-41b9-99ca-a0307af1dfaa-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-hkjvl\" (UID: \"1e057836-5665-41b9-99ca-a0307af1dfaa\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hkjvl" Sep 07 16:24:56.920644 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.920540 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e057836-5665-41b9-99ca-a0307af1dfaa-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-hkjvl\" (UID: \"1e057836-5665-41b9-99ca-a0307af1dfaa\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hkjvl" Sep 07 16:24:56.920644 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.920557 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e057836-5665-41b9-99ca-a0307af1dfaa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-hkjvl\" (UID: \"1e057836-5665-41b9-99ca-a0307af1dfaa\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hkjvl" Sep 07 16:24:56.920800 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:56.920691 2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 07 16:24:56.920800 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:56.920766 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e057836-5665-41b9-99ca-a0307af1dfaa-prometheus-operator-tls podName:1e057836-5665-41b9-99ca-a0307af1dfaa nodeName:}" failed. No retries permitted until 2026-09-07 16:24:57.420746215 +0000 UTC m=+295.978103716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/1e057836-5665-41b9-99ca-a0307af1dfaa-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-hkjvl" (UID: "1e057836-5665-41b9-99ca-a0307af1dfaa") : secret "prometheus-operator-tls" not found Sep 07 16:24:56.921235 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.921205 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e057836-5665-41b9-99ca-a0307af1dfaa-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-hkjvl\" (UID: \"1e057836-5665-41b9-99ca-a0307af1dfaa\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hkjvl" Sep 07 16:24:56.923005 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.922985 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e057836-5665-41b9-99ca-a0307af1dfaa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-hkjvl\" (UID: \"1e057836-5665-41b9-99ca-a0307af1dfaa\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hkjvl" Sep 07 16:24:56.928708 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:56.928683 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz6nw\" (UniqueName: \"kubernetes.io/projected/1e057836-5665-41b9-99ca-a0307af1dfaa-kube-api-access-lz6nw\") pod \"prometheus-operator-6f4946db56-hkjvl\" (UID: \"1e057836-5665-41b9-99ca-a0307af1dfaa\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hkjvl" Sep 07 16:24:57.006705 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:24:57.006658 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-87hv9" podUID="ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc" Sep 07 16:24:57.180213 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:57.180123 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6v52m" event={"ID":"d4b52d58-79e7-48ce-bcaa-cdc38323e992","Type":"ContainerStarted","Data":"3c0ba1d6eaad5259c7cbf56063546b0c23bb7bdae6e26a93a5039bcfbc15b0a8"} Sep 07 16:24:57.180213 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:57.180193 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6v52m" event={"ID":"d4b52d58-79e7-48ce-bcaa-cdc38323e992","Type":"ContainerStarted","Data":"68cdaaab720f40058507f17d472c71fee728cd80dfdb32637f4f0aa70bbfee4f"} Sep 07 16:24:57.424721 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:57.424678 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e057836-5665-41b9-99ca-a0307af1dfaa-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-hkjvl\" (UID: \"1e057836-5665-41b9-99ca-a0307af1dfaa\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hkjvl" Sep 07 16:24:57.427085 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:57.427051 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e057836-5665-41b9-99ca-a0307af1dfaa-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-hkjvl\" (UID: \"1e057836-5665-41b9-99ca-a0307af1dfaa\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hkjvl" Sep 07 16:24:57.644413 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:57.644353 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-hkjvl" Sep 07 16:24:57.914157 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:57.914065 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-hkjvl"] Sep 07 16:24:57.917399 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:24:57.917365 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e057836_5665_41b9_99ca_a0307af1dfaa.slice/crio-261b417f6b36e350fd0b9744c96752c981c84c47ad50fea3ad8a62435c06bc00 WatchSource:0}: Error finding container 261b417f6b36e350fd0b9744c96752c981c84c47ad50fea3ad8a62435c06bc00: Status 404 returned error can't find the container with id 261b417f6b36e350fd0b9744c96752c981c84c47ad50fea3ad8a62435c06bc00 Sep 07 16:24:58.186171 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:58.186131 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6v52m" event={"ID":"d4b52d58-79e7-48ce-bcaa-cdc38323e992","Type":"ContainerStarted","Data":"f244dcd9323e1e1d0dd38be3782880401b29be908f806930558eba3dd586671b"} Sep 07 16:24:58.187544 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:58.187507 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-hkjvl" event={"ID":"1e057836-5665-41b9-99ca-a0307af1dfaa","Type":"ContainerStarted","Data":"261b417f6b36e350fd0b9744c96752c981c84c47ad50fea3ad8a62435c06bc00"} Sep 07 16:24:59.159136 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:59.159106 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hg9mt" Sep 07 16:24:59.194801 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:59.194758 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6v52m" event={"ID":"d4b52d58-79e7-48ce-bcaa-cdc38323e992","Type":"ContainerStarted","Data":"840cff520e44a6b802acec64e05747fd3023a2c401b3c0a654a750c329685d95"} Sep 07 16:24:59.211929 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:24:59.211864 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6v52m" podStartSLOduration=33.323623765 podStartE2EDuration="35.211842381s" totalImagesPullingTime="1.888218616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:24:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:24:59.21058584 +0000 UTC m=+297.767943372" watchObservedRunningTime="2026-09-07 16:24:59.211842381 +0000 UTC m=+297.769199896" Sep 07 16:25:00.199644 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:00.199591 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-hkjvl" event={"ID":"1e057836-5665-41b9-99ca-a0307af1dfaa","Type":"ContainerStarted","Data":"9f8c1693117fd310687908763cd9f315a0d1b449ea2ba20b9508d17cb828a5b1"} Sep 07 16:25:00.200000 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:00.199661 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-hkjvl" event={"ID":"1e057836-5665-41b9-99ca-a0307af1dfaa","Type":"ContainerStarted","Data":"7aa01ff84ebda2a6a94e001a22ab9ca693e06b0441c516716ca2abfece53a31f"} Sep 07 16:25:00.216119 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:00.216063 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-hkjvl" podStartSLOduration=2.6919014089999997 podStartE2EDuration="4.216046974s" totalImagesPullingTime="1.524145565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:25:00.214953036 +0000 UTC m=+298.772310550" watchObservedRunningTime="2026-09-07 16:25:00.216046974 +0000 UTC m=+298.773404486" Sep 07 16:25:01.907223 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:01.907189 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f72gx_279b7732-ff48-482d-b216-0167445c26ab/ovn-acl-logging/0.log" Sep 07 16:25:01.907729 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:01.907657 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f72gx_279b7732-ff48-482d-b216-0167445c26ab/ovn-acl-logging/0.log" Sep 07 16:25:01.916699 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:01.916663 2561 kubelet.go:1648] "Image garbage collection succeeded" Sep 07 16:25:02.093967 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.093808 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5r8xm"] Sep 07 16:25:02.112901 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.097472 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.112901 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.103636 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 07 16:25:02.112901 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.103641 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 07 16:25:02.112901 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.103972 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 07 16:25:02.112901 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.105395 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wjq9t\"" Sep 07 16:25:02.163872 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.163776 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-node-exporter-tls\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.163872 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.163839 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-sys\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.164090 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.163926 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-node-exporter-textfile\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.164090 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.163966 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd9tn\" (UniqueName: \"kubernetes.io/projected/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-kube-api-access-bd9tn\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.164090 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.163999 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-root\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.164090 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.164045 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-metrics-client-ca\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.164090 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.164080 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-node-exporter-wtmp\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.164274 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.164105 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.164274 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.164161 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.264794 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.264757 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-node-exporter-textfile\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.264794 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.264795 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd9tn\" (UniqueName: \"kubernetes.io/projected/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-kube-api-access-bd9tn\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.265058 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.264815 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-root\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.265058 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.264878 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-root\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.265058 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.264907 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-metrics-client-ca\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.265058 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.264938 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-node-exporter-wtmp\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.265058 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.264958 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.265058 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.264998 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.265058 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.265036 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-node-exporter-tls\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.265416 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.265078 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-sys\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.265416 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.265136 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-sys\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.265416 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.265221 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-node-exporter-textfile\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.265416 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.265265 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-node-exporter-wtmp\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.265648 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.265623 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-metrics-client-ca\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.265748 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.265725 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.267705 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.267680 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-node-exporter-tls\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.268082 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.268060 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.272216 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.272189 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd9tn\" (UniqueName: \"kubernetes.io/projected/194addcd-6f3a-4312-b306-cd9f1ff5c6fd-kube-api-access-bd9tn\") pod \"node-exporter-5r8xm\" (UID: \"194addcd-6f3a-4312-b306-cd9f1ff5c6fd\") " pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.409988 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:02.409946 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5r8xm" Sep 07 16:25:02.423272 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:25:02.423239 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod194addcd_6f3a_4312_b306_cd9f1ff5c6fd.slice/crio-f4d61dff8b1caf9331c5e2e14b6fce8529559e91cc6fb62c50a6420843816b3d WatchSource:0}: Error finding container f4d61dff8b1caf9331c5e2e14b6fce8529559e91cc6fb62c50a6420843816b3d: Status 404 returned error can't find the container with id f4d61dff8b1caf9331c5e2e14b6fce8529559e91cc6fb62c50a6420843816b3d Sep 07 16:25:03.212333 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:03.212280 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5r8xm" event={"ID":"194addcd-6f3a-4312-b306-cd9f1ff5c6fd","Type":"ContainerStarted","Data":"f4d61dff8b1caf9331c5e2e14b6fce8529559e91cc6fb62c50a6420843816b3d"} Sep 07 16:25:04.217700 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:04.217659 2561 generic.go:356] "Generic (PLEG): container finished" podID="194addcd-6f3a-4312-b306-cd9f1ff5c6fd" containerID="d252723dc49ba2fbb9450c24b9e706b99ec5b966e5d67bf0eb8ca619203f0e15" exitCode=0 Sep 07 16:25:04.218095 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:04.217724 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5r8xm" event={"ID":"194addcd-6f3a-4312-b306-cd9f1ff5c6fd","Type":"ContainerDied","Data":"d252723dc49ba2fbb9450c24b9e706b99ec5b966e5d67bf0eb8ca619203f0e15"} Sep 07 16:25:05.224787 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:05.224748 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5r8xm" event={"ID":"194addcd-6f3a-4312-b306-cd9f1ff5c6fd","Type":"ContainerStarted","Data":"0e8aab1f229acc3e2d968060c8b61762eb24dcb80beda1f5a79cafcf6695e68f"} Sep 07 16:25:05.225285 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:05.224815 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5r8xm" event={"ID":"194addcd-6f3a-4312-b306-cd9f1ff5c6fd","Type":"ContainerStarted","Data":"6e29f12ef21d2390a4fc83c4279e480d7beb50b8b87daf7c564657247df2c623"} Sep 07 16:25:05.243760 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:05.243703 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5r8xm" podStartSLOduration=2.000619086 podStartE2EDuration="3.243684663s" totalImagesPullingTime="1.174892959s" totalInitContainerRuntime="68.172618ms" isStatefulPod=true podCreationTimestamp="2026-09-07 16:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:25:05.24235247 +0000 UTC m=+303.799710008" watchObservedRunningTime="2026-09-07 16:25:05.243684663 +0000 UTC m=+303.801042215" Sep 07 16:25:08.281437 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.281398 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 16:25:08.285765 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.285737 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.288154 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.288005 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 07 16:25:08.288308 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.288286 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 07 16:25:08.288308 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.288292 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 07 16:25:08.288726 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.288698 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4b0jv4n8b343\"" Sep 07 16:25:08.288726 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.288706 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 07 16:25:08.288934 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.288835 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 07 16:25:08.288934 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.288842 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 07 16:25:08.289039 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.288978 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 07 16:25:08.289039 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.288981 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 07 16:25:08.289306 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.289288 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 07 16:25:08.289905 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.289878 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 07 16:25:08.289905 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.289896 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z26kg\"" Sep 07 16:25:08.290154 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.290138 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 07 16:25:08.290282 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.290163 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 07 16:25:08.290535 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.290510 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 07 16:25:08.291151 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.291130 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 07 16:25:08.296282 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.296037 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 07 16:25:08.303214 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.303176 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 16:25:08.422914 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.422857 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.423204 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.423181 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.423346 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.423330 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.423450 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.423437 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.423568 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.423556 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.423700 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.423686 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.423836 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.423822 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.423935 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.423924 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-web-config\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.424049 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.424036 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.424153 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.424139 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdxj7\" (UniqueName: \"kubernetes.io/projected/f2385d54-6d72-4600-9dce-614c8b581328-kube-api-access-cdxj7\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.424238 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.424219 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.424303 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.424263 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.424303 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.424294 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.424388 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.424321 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.424388 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.424364 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-config\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.424505 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.424389 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f2385d54-6d72-4600-9dce-614c8b581328-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.424505 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.424405 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.424505 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.424425 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.424602 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.424499 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f2385d54-6d72-4600-9dce-614c8b581328-config-out\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.424602 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.424543 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.525824 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.525787 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.525824 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.525828 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.526076 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.525855 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.526076 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.525979 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-config\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.526076 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.526018 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f2385d54-6d72-4600-9dce-614c8b581328-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.526076 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.526043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.526252 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.526109 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.526252 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.526155 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f2385d54-6d72-4600-9dce-614c8b581328-config-out\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.526252 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.526202 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.526252 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.526232 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.526447 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.526263 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.526447 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.526307 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.526447 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.526335 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.526447 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.526378 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.526447 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.526405 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.526711 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.526460 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.526711 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.526491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-web-config\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.526711 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.526529 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.526711 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.526560 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdxj7\" (UniqueName: \"kubernetes.io/projected/f2385d54-6d72-4600-9dce-614c8b581328-kube-api-access-cdxj7\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.526711 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.526592 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.529573 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.529138 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.529573 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.529371 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-config\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.532654 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.529960 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.532654 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.530519 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.532654 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.530721 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.532654 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.530815 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.532654 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.531431 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f2385d54-6d72-4600-9dce-614c8b581328-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.532654 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.531588 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.532654 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.532125 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.533088 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.532723 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.533088 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.532789 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.533088 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.532800 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.533088 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.533065 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.533435 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.533392 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.533686 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.533640 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.533812 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.533749 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f2385d54-6d72-4600-9dce-614c8b581328-config-out\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.534103 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.534079 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.534835 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.534816 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.535620 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.535583 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-web-config\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.540885 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.540862 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdxj7\" (UniqueName: \"kubernetes.io/projected/f2385d54-6d72-4600-9dce-614c8b581328-kube-api-access-cdxj7\") pod \"prometheus-k8s-0\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.600547 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.600486 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:08.890966 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.890876 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 16:25:08.893876 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:25:08.893844 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2385d54_6d72_4600_9dce_614c8b581328.slice/crio-c1128d92e9eec15db5322a6f2edf6771305b8b8604e9b124b0d1b11ee9eb6028 WatchSource:0}: Error finding container c1128d92e9eec15db5322a6f2edf6771305b8b8604e9b124b0d1b11ee9eb6028: Status 404 returned error can't find the container with id c1128d92e9eec15db5322a6f2edf6771305b8b8604e9b124b0d1b11ee9eb6028 Sep 07 16:25:08.896362 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:08.896338 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 16:25:09.238487 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:09.238448 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f2385d54-6d72-4600-9dce-614c8b581328","Type":"ContainerStarted","Data":"c1128d92e9eec15db5322a6f2edf6771305b8b8604e9b124b0d1b11ee9eb6028"} Sep 07 16:25:10.161283 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:10.161192 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6cbd4dd8-5szcm" Sep 07 16:25:10.244135 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:10.244101 2561 generic.go:356] "Generic (PLEG): container finished" podID="f2385d54-6d72-4600-9dce-614c8b581328" containerID="8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb" exitCode=0 Sep 07 16:25:10.244322 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:10.244191 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f2385d54-6d72-4600-9dce-614c8b581328","Type":"ContainerDied","Data":"8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb"} Sep 07 16:25:12.010429 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:12.008825 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:25:14.263332 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:14.263290 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f2385d54-6d72-4600-9dce-614c8b581328","Type":"ContainerStarted","Data":"0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501"} Sep 07 16:25:14.263800 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:14.263378 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f2385d54-6d72-4600-9dce-614c8b581328","Type":"ContainerStarted","Data":"ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f"} Sep 07 16:25:16.279532 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:16.279493 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f2385d54-6d72-4600-9dce-614c8b581328","Type":"ContainerStarted","Data":"1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0"} Sep 07 16:25:16.279914 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:16.279591 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f2385d54-6d72-4600-9dce-614c8b581328","Type":"ContainerStarted","Data":"c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767"} Sep 07 16:25:16.279914 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:16.279642 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f2385d54-6d72-4600-9dce-614c8b581328","Type":"ContainerStarted","Data":"d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425"} Sep 07 16:25:16.279914 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:16.279669 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f2385d54-6d72-4600-9dce-614c8b581328","Type":"ContainerStarted","Data":"d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf"} Sep 07 16:25:16.309495 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:16.309426 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.295247249 podStartE2EDuration="8.309404929s" totalImagesPullingTime="5.994332919s" totalInitContainerRuntime="19.824761ms" isStatefulPod=false podCreationTimestamp="2026-09-07 16:25:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:25:16.307164256 +0000 UTC m=+314.864521823" watchObservedRunningTime="2026-09-07 16:25:16.309404929 +0000 UTC m=+314.866762441" Sep 07 16:25:18.601460 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:18.601423 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:25:49.451941 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:49.451895 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" podUID="a476862b-9aa5-4a9c-af13-66718859de7e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 07 16:25:59.451789 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:25:59.451739 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" podUID="a476862b-9aa5-4a9c-af13-66718859de7e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 07 16:26:08.600665 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:08.600634 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:08.620478 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:08.620452 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:09.451727 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:09.451681 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" podUID="a476862b-9aa5-4a9c-af13-66718859de7e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 07 16:26:09.451888 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:09.451770 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" Sep 07 16:26:09.452281 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:09.452251 2561 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"027fb13edd8c8277b3762f9d9ef61ba72a304c93e5723fe48956fef6ef5372ca"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" containerMessage="Container service-proxy failed liveness probe, will be restarted" Sep 07 16:26:09.452326 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:09.452301 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" podUID="a476862b-9aa5-4a9c-af13-66718859de7e" containerName="service-proxy" containerID="cri-o://027fb13edd8c8277b3762f9d9ef61ba72a304c93e5723fe48956fef6ef5372ca" gracePeriod=30 Sep 07 16:26:09.488773 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:09.488731 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:10.478248 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:10.478214 2561 generic.go:356] "Generic (PLEG): container finished" podID="a476862b-9aa5-4a9c-af13-66718859de7e" containerID="027fb13edd8c8277b3762f9d9ef61ba72a304c93e5723fe48956fef6ef5372ca" exitCode=2 Sep 07 16:26:10.478723 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:10.478291 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" event={"ID":"a476862b-9aa5-4a9c-af13-66718859de7e","Type":"ContainerDied","Data":"027fb13edd8c8277b3762f9d9ef61ba72a304c93e5723fe48956fef6ef5372ca"} Sep 07 16:26:10.478723 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:10.478343 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c884465f8-vp5nm" event={"ID":"a476862b-9aa5-4a9c-af13-66718859de7e","Type":"ContainerStarted","Data":"e1cd559a02ce5f180085c2b4b11b7e4bf32ccc9a30fcdab16ba3d3c4c0373603"} Sep 07 16:26:14.883690 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:14.883604 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs\") pod \"network-metrics-daemon-87hv9\" (UID: \"ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc\") " pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:26:14.885996 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:14.885974 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc-metrics-certs\") pod \"network-metrics-daemon-87hv9\" (UID: \"ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc\") " pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:26:15.011665 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:15.011635 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4t747\"" Sep 07 16:26:15.020362 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:15.020328 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-87hv9" Sep 07 16:26:15.288427 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:15.288395 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-87hv9"] Sep 07 16:26:15.291762 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:26:15.291733 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab4d0800_7e1c_4f30_9e9c_b8bee24cc9dc.slice/crio-81cafac1d62286e0e3fb29a754c9e7f70ea00b603af765c190ac486988567be3 WatchSource:0}: Error finding container 81cafac1d62286e0e3fb29a754c9e7f70ea00b603af765c190ac486988567be3: Status 404 returned error can't find the container with id 81cafac1d62286e0e3fb29a754c9e7f70ea00b603af765c190ac486988567be3 Sep 07 16:26:15.498121 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:15.498082 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-87hv9" event={"ID":"ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc","Type":"ContainerStarted","Data":"81cafac1d62286e0e3fb29a754c9e7f70ea00b603af765c190ac486988567be3"} Sep 07 16:26:16.504190 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:16.504151 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-87hv9" event={"ID":"ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc","Type":"ContainerStarted","Data":"4e1080d2af321127f2ac1ad6acfb9899df15187b6fc6944dcf23d885a03725f2"} Sep 07 16:26:16.504629 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:16.504210 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-87hv9" event={"ID":"ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc","Type":"ContainerStarted","Data":"865d7450780c61a4a98194b0787eb507616ac1b45e1cb01f0ca500414082621f"} Sep 07 16:26:16.529778 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:16.529718 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-87hv9" podStartSLOduration=373.682566956 podStartE2EDuration="6m14.52969749s" totalImagesPullingTime="847.130534ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:26:16.529087726 +0000 UTC m=+375.086445259" watchObservedRunningTime="2026-09-07 16:26:16.52969749 +0000 UTC m=+375.087055002" Sep 07 16:26:26.694359 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:26.694309 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 16:26:26.695013 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:26.694821 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="prometheus" containerID="cri-o://ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f" gracePeriod=600 Sep 07 16:26:26.695013 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:26.694843 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="kube-rbac-proxy" containerID="cri-o://c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767" gracePeriod=600 Sep 07 16:26:26.695013 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:26.694894 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="kube-rbac-proxy-web" containerID="cri-o://d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425" gracePeriod=600 Sep 07 16:26:26.695013 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:26.694950 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0" gracePeriod=600 Sep 07 16:26:26.695013 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:26.694869 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="thanos-sidecar" containerID="cri-o://d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf" gracePeriod=600 Sep 07 16:26:26.695268 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:26.694871 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="config-reloader" containerID="cri-o://0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501" gracePeriod=600 Sep 07 16:26:26.954994 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:26.954915 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.083633 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.083559 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-kube-rbac-proxy\") pod \"f2385d54-6d72-4600-9dce-614c8b581328\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " Sep 07 16:26:27.083633 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.083631 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-configmap-kubelet-serving-ca-bundle\") pod \"f2385d54-6d72-4600-9dce-614c8b581328\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " Sep 07 16:26:27.083877 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.083660 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-configmap-metrics-client-ca\") pod \"f2385d54-6d72-4600-9dce-614c8b581328\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " Sep 07 16:26:27.083877 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.083684 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-metrics-client-certs\") pod \"f2385d54-6d72-4600-9dce-614c8b581328\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " Sep 07 16:26:27.083877 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.083706 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-prometheus-k8s-tls\") pod \"f2385d54-6d72-4600-9dce-614c8b581328\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " Sep 07 16:26:27.083877 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.083732 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-trusted-ca-bundle\") pod \"f2385d54-6d72-4600-9dce-614c8b581328\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " Sep 07 16:26:27.083877 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.083762 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f2385d54-6d72-4600-9dce-614c8b581328-config-out\") pod \"f2385d54-6d72-4600-9dce-614c8b581328\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " Sep 07 16:26:27.083877 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.083798 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-rulefiles-2\") pod \"f2385d54-6d72-4600-9dce-614c8b581328\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " Sep 07 16:26:27.083877 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.083822 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdxj7\" (UniqueName: \"kubernetes.io/projected/f2385d54-6d72-4600-9dce-614c8b581328-kube-api-access-cdxj7\") pod \"f2385d54-6d72-4600-9dce-614c8b581328\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " Sep 07 16:26:27.083877 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.083862 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f2385d54-6d72-4600-9dce-614c8b581328\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " Sep 07 16:26:27.084274 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.083898 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f2385d54-6d72-4600-9dce-614c8b581328\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " Sep 07 16:26:27.084274 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.083924 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f2385d54-6d72-4600-9dce-614c8b581328-tls-assets\") pod \"f2385d54-6d72-4600-9dce-614c8b581328\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " Sep 07 16:26:27.084274 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.083952 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-config\") pod \"f2385d54-6d72-4600-9dce-614c8b581328\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " Sep 07 16:26:27.084274 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.083983 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-thanos-prometheus-http-client-file\") pod \"f2385d54-6d72-4600-9dce-614c8b581328\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " Sep 07 16:26:27.084274 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.084000 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f2385d54-6d72-4600-9dce-614c8b581328" (UID: "f2385d54-6d72-4600-9dce-614c8b581328"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 16:26:27.084274 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.084036 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-grpc-tls\") pod \"f2385d54-6d72-4600-9dce-614c8b581328\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " Sep 07 16:26:27.084274 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.084070 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-web-config\") pod \"f2385d54-6d72-4600-9dce-614c8b581328\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " Sep 07 16:26:27.084274 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.084066 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f2385d54-6d72-4600-9dce-614c8b581328" (UID: "f2385d54-6d72-4600-9dce-614c8b581328"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 16:26:27.084274 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.084102 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-configmap-serving-certs-ca-bundle\") pod \"f2385d54-6d72-4600-9dce-614c8b581328\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " Sep 07 16:26:27.084274 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.084134 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-rulefiles-0\") pod \"f2385d54-6d72-4600-9dce-614c8b581328\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " Sep 07 16:26:27.084274 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.084178 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-db\") pod \"f2385d54-6d72-4600-9dce-614c8b581328\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " Sep 07 16:26:27.084274 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.084216 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-rulefiles-1\") pod \"f2385d54-6d72-4600-9dce-614c8b581328\" (UID: \"f2385d54-6d72-4600-9dce-614c8b581328\") " Sep 07 16:26:27.084883 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.084343 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f2385d54-6d72-4600-9dce-614c8b581328" (UID: "f2385d54-6d72-4600-9dce-614c8b581328"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 16:26:27.084883 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.084466 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:26:27.084883 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.084487 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-configmap-metrics-client-ca\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:26:27.084883 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.084503 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:26:27.084883 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.084660 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f2385d54-6d72-4600-9dce-614c8b581328" (UID: "f2385d54-6d72-4600-9dce-614c8b581328"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 16:26:27.085138 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.084911 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f2385d54-6d72-4600-9dce-614c8b581328" (UID: "f2385d54-6d72-4600-9dce-614c8b581328"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 16:26:27.086388 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.086292 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f2385d54-6d72-4600-9dce-614c8b581328" (UID: "f2385d54-6d72-4600-9dce-614c8b581328"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 16:26:27.086511 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.086444 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f2385d54-6d72-4600-9dce-614c8b581328" (UID: "f2385d54-6d72-4600-9dce-614c8b581328"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 16:26:27.086511 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.086467 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f2385d54-6d72-4600-9dce-614c8b581328" (UID: "f2385d54-6d72-4600-9dce-614c8b581328"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 16:26:27.086828 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.086798 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2385d54-6d72-4600-9dce-614c8b581328-config-out" (OuterVolumeSpecName: "config-out") pod "f2385d54-6d72-4600-9dce-614c8b581328" (UID: "f2385d54-6d72-4600-9dce-614c8b581328"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 16:26:27.086942 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.086832 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2385d54-6d72-4600-9dce-614c8b581328-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f2385d54-6d72-4600-9dce-614c8b581328" (UID: "f2385d54-6d72-4600-9dce-614c8b581328"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 16:26:27.087032 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.086979 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-config" (OuterVolumeSpecName: "config") pod "f2385d54-6d72-4600-9dce-614c8b581328" (UID: "f2385d54-6d72-4600-9dce-614c8b581328"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 16:26:27.087217 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.087188 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f2385d54-6d72-4600-9dce-614c8b581328" (UID: "f2385d54-6d72-4600-9dce-614c8b581328"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 16:26:27.087926 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.087894 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f2385d54-6d72-4600-9dce-614c8b581328" (UID: "f2385d54-6d72-4600-9dce-614c8b581328"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 16:26:27.088029 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.087933 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f2385d54-6d72-4600-9dce-614c8b581328" (UID: "f2385d54-6d72-4600-9dce-614c8b581328"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 16:26:27.088376 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.088342 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f2385d54-6d72-4600-9dce-614c8b581328" (UID: "f2385d54-6d72-4600-9dce-614c8b581328"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 16:26:27.088855 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.088822 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f2385d54-6d72-4600-9dce-614c8b581328" (UID: "f2385d54-6d72-4600-9dce-614c8b581328"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 16:26:27.089095 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.089074 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2385d54-6d72-4600-9dce-614c8b581328-kube-api-access-cdxj7" (OuterVolumeSpecName: "kube-api-access-cdxj7") pod "f2385d54-6d72-4600-9dce-614c8b581328" (UID: "f2385d54-6d72-4600-9dce-614c8b581328"). InnerVolumeSpecName "kube-api-access-cdxj7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 16:26:27.089095 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.089076 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f2385d54-6d72-4600-9dce-614c8b581328" (UID: "f2385d54-6d72-4600-9dce-614c8b581328"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 16:26:27.089276 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.089258 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f2385d54-6d72-4600-9dce-614c8b581328" (UID: "f2385d54-6d72-4600-9dce-614c8b581328"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 16:26:27.099057 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.099018 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-web-config" (OuterVolumeSpecName: "web-config") pod "f2385d54-6d72-4600-9dce-614c8b581328" (UID: "f2385d54-6d72-4600-9dce-614c8b581328"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 16:26:27.185182 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.185140 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdxj7\" (UniqueName: \"kubernetes.io/projected/f2385d54-6d72-4600-9dce-614c8b581328-kube-api-access-cdxj7\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:26:27.185182 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.185173 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:26:27.185182 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.185183 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:26:27.185182 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.185192 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f2385d54-6d72-4600-9dce-614c8b581328-tls-assets\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:26:27.185508 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.185200 2561 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-config\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:26:27.185508 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.185208 2561 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:26:27.185508 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.185216 2561 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-grpc-tls\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:26:27.185508 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.185226 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-web-config\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:26:27.185508 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.185234 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:26:27.185508 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.185246 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:26:27.185508 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.185258 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-db\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:26:27.185508 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.185269 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:26:27.185508 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.185277 2561 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-kube-rbac-proxy\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:26:27.185508 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.185286 2561 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-metrics-client-certs\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:26:27.185508 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.185295 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f2385d54-6d72-4600-9dce-614c8b581328-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:26:27.185508 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.185306 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2385d54-6d72-4600-9dce-614c8b581328-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:26:27.185508 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.185322 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f2385d54-6d72-4600-9dce-614c8b581328-config-out\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:26:27.551522 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.551486 2561 generic.go:356] "Generic (PLEG): container finished" podID="f2385d54-6d72-4600-9dce-614c8b581328" containerID="1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0" exitCode=0 Sep 07 16:26:27.551522 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.551515 2561 generic.go:356] "Generic (PLEG): container finished" podID="f2385d54-6d72-4600-9dce-614c8b581328" containerID="c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767" exitCode=0 Sep 07 16:26:27.551522 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.551521 2561 generic.go:356] "Generic (PLEG): container finished" podID="f2385d54-6d72-4600-9dce-614c8b581328" containerID="d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425" exitCode=0 Sep 07 16:26:27.551522 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.551527 2561 generic.go:356] "Generic (PLEG): container finished" podID="f2385d54-6d72-4600-9dce-614c8b581328" containerID="d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf" exitCode=0 Sep 07 16:26:27.551522 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.551533 2561 generic.go:356] "Generic (PLEG): container finished" podID="f2385d54-6d72-4600-9dce-614c8b581328" containerID="0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501" exitCode=0 Sep 07 16:26:27.551836 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.551540 2561 generic.go:356] "Generic (PLEG): container finished" podID="f2385d54-6d72-4600-9dce-614c8b581328" containerID="ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f" exitCode=0 Sep 07 16:26:27.551836 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.551574 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.551836 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.551570 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f2385d54-6d72-4600-9dce-614c8b581328","Type":"ContainerDied","Data":"1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0"} Sep 07 16:26:27.551836 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.551715 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f2385d54-6d72-4600-9dce-614c8b581328","Type":"ContainerDied","Data":"c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767"} Sep 07 16:26:27.551836 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.551745 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f2385d54-6d72-4600-9dce-614c8b581328","Type":"ContainerDied","Data":"d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425"} Sep 07 16:26:27.551836 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.551775 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f2385d54-6d72-4600-9dce-614c8b581328","Type":"ContainerDied","Data":"d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf"} Sep 07 16:26:27.551836 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.551783 2561 scope.go:117] "RemoveContainer" containerID="1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0" Sep 07 16:26:27.551836 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.551815 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f2385d54-6d72-4600-9dce-614c8b581328","Type":"ContainerDied","Data":"0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501"} Sep 07 16:26:27.552129 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.551855 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f2385d54-6d72-4600-9dce-614c8b581328","Type":"ContainerDied","Data":"ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f"} Sep 07 16:26:27.552129 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.551896 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f2385d54-6d72-4600-9dce-614c8b581328","Type":"ContainerDied","Data":"c1128d92e9eec15db5322a6f2edf6771305b8b8604e9b124b0d1b11ee9eb6028"} Sep 07 16:26:27.559975 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.559950 2561 scope.go:117] "RemoveContainer" containerID="c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767" Sep 07 16:26:27.567353 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.567332 2561 scope.go:117] "RemoveContainer" containerID="d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425" Sep 07 16:26:27.574108 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.574079 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 16:26:27.575261 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.575240 2561 scope.go:117] "RemoveContainer" containerID="d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf" Sep 07 16:26:27.582650 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.582632 2561 scope.go:117] "RemoveContainer" containerID="0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501" Sep 07 16:26:27.584341 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.584316 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 16:26:27.590250 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.590233 2561 scope.go:117] "RemoveContainer" containerID="ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f" Sep 07 16:26:27.598159 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.598134 2561 scope.go:117] "RemoveContainer" containerID="8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb" Sep 07 16:26:27.605673 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.605647 2561 scope.go:117] "RemoveContainer" containerID="1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0" Sep 07 16:26:27.606003 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:26:27.605979 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0\": container with ID starting with 1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0 not found: ID does not exist" containerID="1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0" Sep 07 16:26:27.606087 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.606010 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0"} err="failed to get container status \"1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0\": rpc error: code = NotFound desc = could not find container \"1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0\": container with ID starting with 1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0 not found: ID does not exist" Sep 07 16:26:27.606087 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.606028 2561 scope.go:117] "RemoveContainer" containerID="c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767" Sep 07 16:26:27.606416 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:26:27.606366 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767\": container with ID starting with c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767 not found: ID does not exist" containerID="c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767" Sep 07 16:26:27.606527 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.606411 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767"} err="failed to get container status \"c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767\": rpc error: code = NotFound desc = could not find container \"c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767\": container with ID starting with c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767 not found: ID does not exist" Sep 07 16:26:27.606527 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.606434 2561 scope.go:117] "RemoveContainer" containerID="d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425" Sep 07 16:26:27.606827 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:26:27.606799 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425\": container with ID starting with d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425 not found: ID does not exist" containerID="d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425" Sep 07 16:26:27.606958 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.606833 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425"} err="failed to get container status \"d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425\": rpc error: code = NotFound desc = could not find container \"d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425\": container with ID starting with d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425 not found: ID does not exist" Sep 07 16:26:27.606958 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.606855 2561 scope.go:117] "RemoveContainer" containerID="d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf" Sep 07 16:26:27.612420 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:26:27.607169 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf\": container with ID starting with d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf not found: ID does not exist" containerID="d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf" Sep 07 16:26:27.612420 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.607547 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf"} err="failed to get container status \"d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf\": rpc error: code = NotFound desc = could not find container \"d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf\": container with ID starting with d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf not found: ID does not exist" Sep 07 16:26:27.612420 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.607584 2561 scope.go:117] "RemoveContainer" containerID="0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501" Sep 07 16:26:27.612420 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.610084 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 16:26:27.613360 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:26:27.613163 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501\": container with ID starting with 0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501 not found: ID does not exist" containerID="0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501" Sep 07 16:26:27.613360 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.613202 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501"} err="failed to get container status \"0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501\": rpc error: code = NotFound desc = could not find container \"0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501\": container with ID starting with 0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501 not found: ID does not exist" Sep 07 16:26:27.613360 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.613228 2561 scope.go:117] "RemoveContainer" containerID="ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f" Sep 07 16:26:27.613913 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.613892 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="thanos-sidecar" Sep 07 16:26:27.613913 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.613915 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="thanos-sidecar" Sep 07 16:26:27.614099 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.613939 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="kube-rbac-proxy-thanos" Sep 07 16:26:27.614099 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.613947 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="kube-rbac-proxy-thanos" Sep 07 16:26:27.614099 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.613961 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="config-reloader" Sep 07 16:26:27.614099 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.613969 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="config-reloader" Sep 07 16:26:27.614099 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.613999 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="init-config-reloader" Sep 07 16:26:27.614099 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.614008 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="init-config-reloader" Sep 07 16:26:27.614099 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.614020 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="prometheus" Sep 07 16:26:27.614099 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.614035 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="prometheus" Sep 07 16:26:27.614099 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.614044 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="kube-rbac-proxy-web" Sep 07 16:26:27.614099 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.614053 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="kube-rbac-proxy-web" Sep 07 16:26:27.614099 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.614062 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="kube-rbac-proxy" Sep 07 16:26:27.614099 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.614072 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="kube-rbac-proxy" Sep 07 16:26:27.614664 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.614219 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="kube-rbac-proxy-thanos" Sep 07 16:26:27.614664 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.614233 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="thanos-sidecar" Sep 07 16:26:27.614664 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.614244 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="prometheus" Sep 07 16:26:27.614664 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.614260 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="kube-rbac-proxy-web" Sep 07 16:26:27.614664 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.614270 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="kube-rbac-proxy" Sep 07 16:26:27.614664 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.614279 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2385d54-6d72-4600-9dce-614c8b581328" containerName="config-reloader" Sep 07 16:26:27.614930 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:26:27.614908 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f\": container with ID starting with ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f not found: ID does not exist" containerID="ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f" Sep 07 16:26:27.614988 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.614935 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f"} err="failed to get container status \"ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f\": rpc error: code = NotFound desc = could not find container \"ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f\": container with ID starting with ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f not found: ID does not exist" Sep 07 16:26:27.614988 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.614950 2561 scope.go:117] "RemoveContainer" containerID="8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb" Sep 07 16:26:27.615242 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:26:27.615221 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb\": container with ID starting with 8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb not found: ID does not exist" containerID="8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb" Sep 07 16:26:27.615305 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.615249 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb"} err="failed to get container status \"8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb\": rpc error: code = NotFound desc = could not find container \"8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb\": container with ID starting with 8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb not found: ID does not exist" Sep 07 16:26:27.615305 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.615265 2561 scope.go:117] "RemoveContainer" containerID="1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0" Sep 07 16:26:27.615497 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.615477 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0"} err="failed to get container status \"1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0\": rpc error: code = NotFound desc = could not find container \"1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0\": container with ID starting with 1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0 not found: ID does not exist" Sep 07 16:26:27.615554 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.615496 2561 scope.go:117] "RemoveContainer" containerID="c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767" Sep 07 16:26:27.615743 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.615719 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767"} err="failed to get container status \"c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767\": rpc error: code = NotFound desc = could not find container \"c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767\": container with ID starting with c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767 not found: ID does not exist" Sep 07 16:26:27.615812 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.615745 2561 scope.go:117] "RemoveContainer" containerID="d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425" Sep 07 16:26:27.616048 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.616019 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425"} err="failed to get container status \"d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425\": rpc error: code = NotFound desc = could not find container \"d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425\": container with ID starting with d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425 not found: ID does not exist" Sep 07 16:26:27.616048 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.616038 2561 scope.go:117] "RemoveContainer" containerID="d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf" Sep 07 16:26:27.616309 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.616287 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf"} err="failed to get container status \"d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf\": rpc error: code = NotFound desc = could not find container \"d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf\": container with ID starting with d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf not found: ID does not exist" Sep 07 16:26:27.616309 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.616309 2561 scope.go:117] "RemoveContainer" containerID="0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501" Sep 07 16:26:27.616571 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.616549 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501"} err="failed to get container status \"0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501\": rpc error: code = NotFound desc = could not find container \"0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501\": container with ID starting with 0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501 not found: ID does not exist" Sep 07 16:26:27.616697 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.616572 2561 scope.go:117] "RemoveContainer" containerID="ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f" Sep 07 16:26:27.616836 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.616816 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f"} err="failed to get container status \"ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f\": rpc error: code = NotFound desc = could not find container \"ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f\": container with ID starting with ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f not found: ID does not exist" Sep 07 16:26:27.616888 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.616838 2561 scope.go:117] "RemoveContainer" containerID="8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb" Sep 07 16:26:27.617064 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.617047 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb"} err="failed to get container status \"8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb\": rpc error: code = NotFound desc = could not find container \"8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb\": container with ID starting with 8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb not found: ID does not exist" Sep 07 16:26:27.617107 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.617064 2561 scope.go:117] "RemoveContainer" containerID="1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0" Sep 07 16:26:27.617333 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.617308 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0"} err="failed to get container status \"1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0\": rpc error: code = NotFound desc = could not find container \"1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0\": container with ID starting with 1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0 not found: ID does not exist" Sep 07 16:26:27.617386 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.617333 2561 scope.go:117] "RemoveContainer" containerID="c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767" Sep 07 16:26:27.617538 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.617522 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767"} err="failed to get container status \"c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767\": rpc error: code = NotFound desc = could not find container \"c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767\": container with ID starting with c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767 not found: ID does not exist" Sep 07 16:26:27.617580 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.617538 2561 scope.go:117] "RemoveContainer" containerID="d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425" Sep 07 16:26:27.617798 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.617781 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425"} err="failed to get container status \"d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425\": rpc error: code = NotFound desc = could not find container \"d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425\": container with ID starting with d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425 not found: ID does not exist" Sep 07 16:26:27.617798 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.617797 2561 scope.go:117] "RemoveContainer" containerID="d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf" Sep 07 16:26:27.618005 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.617989 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf"} err="failed to get container status \"d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf\": rpc error: code = NotFound desc = could not find container \"d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf\": container with ID starting with d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf not found: ID does not exist" Sep 07 16:26:27.618050 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.618005 2561 scope.go:117] "RemoveContainer" containerID="0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501" Sep 07 16:26:27.618237 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.618218 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501"} err="failed to get container status \"0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501\": rpc error: code = NotFound desc = could not find container \"0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501\": container with ID starting with 0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501 not found: ID does not exist" Sep 07 16:26:27.618291 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.618237 2561 scope.go:117] "RemoveContainer" containerID="ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f" Sep 07 16:26:27.618449 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.618433 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f"} err="failed to get container status \"ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f\": rpc error: code = NotFound desc = could not find container \"ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f\": container with ID starting with ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f not found: ID does not exist" Sep 07 16:26:27.618449 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.618448 2561 scope.go:117] "RemoveContainer" containerID="8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb" Sep 07 16:26:27.618665 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.618647 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb"} err="failed to get container status \"8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb\": rpc error: code = NotFound desc = could not find container \"8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb\": container with ID starting with 8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb not found: ID does not exist" Sep 07 16:26:27.618714 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.618665 2561 scope.go:117] "RemoveContainer" containerID="1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0" Sep 07 16:26:27.618867 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.618851 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0"} err="failed to get container status \"1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0\": rpc error: code = NotFound desc = could not find container \"1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0\": container with ID starting with 1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0 not found: ID does not exist" Sep 07 16:26:27.618912 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.618867 2561 scope.go:117] "RemoveContainer" containerID="c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767" Sep 07 16:26:27.619087 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.619070 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767"} err="failed to get container status \"c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767\": rpc error: code = NotFound desc = could not find container \"c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767\": container with ID starting with c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767 not found: ID does not exist" Sep 07 16:26:27.619087 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.619086 2561 scope.go:117] "RemoveContainer" containerID="d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425" Sep 07 16:26:27.619283 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.619269 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425"} err="failed to get container status \"d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425\": rpc error: code = NotFound desc = could not find container \"d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425\": container with ID starting with d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425 not found: ID does not exist" Sep 07 16:26:27.619283 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.619283 2561 scope.go:117] "RemoveContainer" containerID="d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf" Sep 07 16:26:27.619483 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.619467 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf"} err="failed to get container status \"d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf\": rpc error: code = NotFound desc = could not find container \"d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf\": container with ID starting with d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf not found: ID does not exist" Sep 07 16:26:27.619483 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.619482 2561 scope.go:117] "RemoveContainer" containerID="0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501" Sep 07 16:26:27.619685 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.619668 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501"} err="failed to get container status \"0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501\": rpc error: code = NotFound desc = could not find container \"0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501\": container with ID starting with 0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501 not found: ID does not exist" Sep 07 16:26:27.619744 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.619685 2561 scope.go:117] "RemoveContainer" containerID="ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f" Sep 07 16:26:27.619897 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.619882 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f"} err="failed to get container status \"ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f\": rpc error: code = NotFound desc = could not find container \"ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f\": container with ID starting with ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f not found: ID does not exist" Sep 07 16:26:27.619897 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.619896 2561 scope.go:117] "RemoveContainer" containerID="8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb" Sep 07 16:26:27.620089 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.620074 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb"} err="failed to get container status \"8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb\": rpc error: code = NotFound desc = could not find container \"8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb\": container with ID starting with 8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb not found: ID does not exist" Sep 07 16:26:27.620089 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.620084 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.620214 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.620089 2561 scope.go:117] "RemoveContainer" containerID="1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0" Sep 07 16:26:27.620714 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.620687 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0"} err="failed to get container status \"1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0\": rpc error: code = NotFound desc = could not find container \"1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0\": container with ID starting with 1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0 not found: ID does not exist" Sep 07 16:26:27.620714 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.620713 2561 scope.go:117] "RemoveContainer" containerID="c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767" Sep 07 16:26:27.620999 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.620978 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767"} err="failed to get container status \"c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767\": rpc error: code = NotFound desc = could not find container \"c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767\": container with ID starting with c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767 not found: ID does not exist" Sep 07 16:26:27.620999 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.620999 2561 scope.go:117] "RemoveContainer" containerID="d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425" Sep 07 16:26:27.621268 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.621241 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425"} err="failed to get container status \"d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425\": rpc error: code = NotFound desc = could not find container \"d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425\": container with ID starting with d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425 not found: ID does not exist" Sep 07 16:26:27.621344 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.621270 2561 scope.go:117] "RemoveContainer" containerID="d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf" Sep 07 16:26:27.621548 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.621527 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf"} err="failed to get container status \"d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf\": rpc error: code = NotFound desc = could not find container \"d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf\": container with ID starting with d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf not found: ID does not exist" Sep 07 16:26:27.621631 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.621549 2561 scope.go:117] "RemoveContainer" containerID="0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501" Sep 07 16:26:27.621988 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.621949 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501"} err="failed to get container status \"0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501\": rpc error: code = NotFound desc = could not find container \"0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501\": container with ID starting with 0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501 not found: ID does not exist" Sep 07 16:26:27.621988 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.621975 2561 scope.go:117] "RemoveContainer" containerID="ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f" Sep 07 16:26:27.622316 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.622287 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f"} err="failed to get container status \"ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f\": rpc error: code = NotFound desc = could not find container \"ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f\": container with ID starting with ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f not found: ID does not exist" Sep 07 16:26:27.622316 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.622315 2561 scope.go:117] "RemoveContainer" containerID="8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb" Sep 07 16:26:27.622595 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.622575 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb"} err="failed to get container status \"8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb\": rpc error: code = NotFound desc = could not find container \"8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb\": container with ID starting with 8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb not found: ID does not exist" Sep 07 16:26:27.622595 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.622595 2561 scope.go:117] "RemoveContainer" containerID="1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0" Sep 07 16:26:27.622898 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.622873 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0"} err="failed to get container status \"1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0\": rpc error: code = NotFound desc = could not find container \"1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0\": container with ID starting with 1be41d8272d416a9338f998228a128d5ed1768797581df75955170b00fde56c0 not found: ID does not exist" Sep 07 16:26:27.622994 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.622898 2561 scope.go:117] "RemoveContainer" containerID="c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767" Sep 07 16:26:27.622994 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.622912 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 07 16:26:27.623105 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.623014 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 07 16:26:27.623105 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.623015 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 07 16:26:27.623105 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.623015 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 07 16:26:27.623248 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.623141 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 07 16:26:27.623248 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.623221 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 07 16:26:27.623248 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.623233 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 07 16:26:27.623565 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.623545 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 07 16:26:27.623565 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.623570 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 07 16:26:27.623738 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.623602 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767"} err="failed to get container status \"c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767\": rpc error: code = NotFound desc = could not find container \"c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767\": container with ID starting with c43b7a46a744b7568ca585ab3c45d233340c972e449095e2e100ad6269bd4767 not found: ID does not exist" Sep 07 16:26:27.623738 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.623643 2561 scope.go:117] "RemoveContainer" containerID="d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425" Sep 07 16:26:27.623849 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.623792 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 07 16:26:27.623908 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.623884 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4b0jv4n8b343\"" Sep 07 16:26:27.623964 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.623913 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 07 16:26:27.623964 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.623951 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425"} err="failed to get container status \"d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425\": rpc error: code = NotFound desc = could not find container \"d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425\": container with ID starting with d7fca1cecb9641585223445a181bdbd13d1dc3908fff747a48083e6aa7682425 not found: ID does not exist" Sep 07 16:26:27.624059 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.623968 2561 scope.go:117] "RemoveContainer" containerID="d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf" Sep 07 16:26:27.624167 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.624152 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z26kg\"" Sep 07 16:26:27.624261 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.624248 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 07 16:26:27.624323 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.624261 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf"} err="failed to get container status \"d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf\": rpc error: code = NotFound desc = could not find container \"d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf\": container with ID starting with d16267bd529345474e8cda4252011278d44a9c0f3e527005b490f7ecfabf47bf not found: ID does not exist" Sep 07 16:26:27.624323 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.624284 2561 scope.go:117] "RemoveContainer" containerID="0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501" Sep 07 16:26:27.624424 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.624339 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 07 16:26:27.624716 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.624687 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501"} err="failed to get container status \"0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501\": rpc error: code = NotFound desc = could not find container \"0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501\": container with ID starting with 0ca00adcc31cb20a81c60c4ef7e74d7133504f51320220c0d975c9d5cc1c7501 not found: ID does not exist" Sep 07 16:26:27.624716 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.624716 2561 scope.go:117] "RemoveContainer" containerID="ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f" Sep 07 16:26:27.625061 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.625036 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f"} err="failed to get container status \"ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f\": rpc error: code = NotFound desc = could not find container \"ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f\": container with ID starting with ccd7831aee417dff80cdb545e7765a45b6d1dedf02a3ce2038cb6a1bf21f822f not found: ID does not exist" Sep 07 16:26:27.625147 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.625062 2561 scope.go:117] "RemoveContainer" containerID="8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb" Sep 07 16:26:27.625421 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.625371 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb"} err="failed to get container status \"8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb\": rpc error: code = NotFound desc = could not find container \"8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb\": container with ID starting with 8e784d87fabad94177bf22db6a914bf514467e02a4be21f1f7cf0330981f0cbb not found: ID does not exist" Sep 07 16:26:27.628028 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.628006 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 07 16:26:27.628737 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.628670 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 16:26:27.629929 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.629909 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 07 16:26:27.789624 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.789572 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b1aaad7-cff2-429e-ab7e-442978938b90-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.789624 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.789635 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b1aaad7-cff2-429e-ab7e-442978938b90-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.790013 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.789697 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0b1aaad7-cff2-429e-ab7e-442978938b90-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.790013 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.789734 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.790013 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.789764 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.790013 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.789788 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0b1aaad7-cff2-429e-ab7e-442978938b90-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.790013 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.789854 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.790013 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.789883 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.790013 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.789912 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b1aaad7-cff2-429e-ab7e-442978938b90-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.790013 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.789932 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-config\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.790013 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.789960 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b1aaad7-cff2-429e-ab7e-442978938b90-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.790013 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.789978 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-web-config\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.790013 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.789996 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.790013 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.790012 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd8cx\" (UniqueName: \"kubernetes.io/projected/0b1aaad7-cff2-429e-ab7e-442978938b90-kube-api-access-zd8cx\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.790462 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.790054 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.790462 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.790103 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.790462 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.790137 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0b1aaad7-cff2-429e-ab7e-442978938b90-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.790462 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.790176 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0b1aaad7-cff2-429e-ab7e-442978938b90-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.790462 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.790207 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b1aaad7-cff2-429e-ab7e-442978938b90-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.790462 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.790231 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b1aaad7-cff2-429e-ab7e-442978938b90-config-out\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.891175 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.891085 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b1aaad7-cff2-429e-ab7e-442978938b90-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.891175 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.891125 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-config\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.891175 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.891144 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b1aaad7-cff2-429e-ab7e-442978938b90-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.891448 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.891273 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-web-config\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.891448 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.891308 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.891448 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.891330 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd8cx\" (UniqueName: \"kubernetes.io/projected/0b1aaad7-cff2-429e-ab7e-442978938b90-kube-api-access-zd8cx\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.891448 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.891350 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.891685 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.891462 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.891685 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.891486 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0b1aaad7-cff2-429e-ab7e-442978938b90-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.891685 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.891512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0b1aaad7-cff2-429e-ab7e-442978938b90-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.891685 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.891540 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b1aaad7-cff2-429e-ab7e-442978938b90-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.891685 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.891560 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b1aaad7-cff2-429e-ab7e-442978938b90-config-out\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.891685 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.891585 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b1aaad7-cff2-429e-ab7e-442978938b90-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.891685 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.891639 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b1aaad7-cff2-429e-ab7e-442978938b90-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.891685 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.891670 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0b1aaad7-cff2-429e-ab7e-442978938b90-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.892043 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.891691 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.892043 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.891746 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.892043 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.891791 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0b1aaad7-cff2-429e-ab7e-442978938b90-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.892043 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.891848 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.892043 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.891873 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.892043 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.891951 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b1aaad7-cff2-429e-ab7e-442978938b90-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.892043 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.891983 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b1aaad7-cff2-429e-ab7e-442978938b90-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.892479 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.892454 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0b1aaad7-cff2-429e-ab7e-442978938b90-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.895236 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.894338 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-config\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.895236 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.894348 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b1aaad7-cff2-429e-ab7e-442978938b90-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.895236 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.894470 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b1aaad7-cff2-429e-ab7e-442978938b90-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.895236 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.894545 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.895236 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.894697 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.895236 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.894734 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-web-config\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.895236 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.895119 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.895236 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.895121 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0b1aaad7-cff2-429e-ab7e-442978938b90-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.895236 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.895175 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b1aaad7-cff2-429e-ab7e-442978938b90-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.895761 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.895426 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0b1aaad7-cff2-429e-ab7e-442978938b90-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.896351 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.896322 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.896714 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.896689 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.896854 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.896832 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b1aaad7-cff2-429e-ab7e-442978938b90-config-out\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.896938 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.896922 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.897583 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.897564 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0b1aaad7-cff2-429e-ab7e-442978938b90-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.898264 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.898244 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0b1aaad7-cff2-429e-ab7e-442978938b90-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.904589 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.904563 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd8cx\" (UniqueName: \"kubernetes.io/projected/0b1aaad7-cff2-429e-ab7e-442978938b90-kube-api-access-zd8cx\") pod \"prometheus-k8s-0\" (UID: \"0b1aaad7-cff2-429e-ab7e-442978938b90\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:27.932452 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:27.932412 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:26:28.010409 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:28.010369 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2385d54-6d72-4600-9dce-614c8b581328" path="/var/lib/kubelet/pods/f2385d54-6d72-4600-9dce-614c8b581328/volumes" Sep 07 16:26:28.214548 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:28.214365 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 16:26:28.217107 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:26:28.217078 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b1aaad7_cff2_429e_ab7e_442978938b90.slice/crio-577e8fab41700bdb24445db209487cdc44a907da85671b79567a9326f9203a34 WatchSource:0}: Error finding container 577e8fab41700bdb24445db209487cdc44a907da85671b79567a9326f9203a34: Status 404 returned error can't find the container with id 577e8fab41700bdb24445db209487cdc44a907da85671b79567a9326f9203a34 Sep 07 16:26:28.558065 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:28.557966 2561 generic.go:356] "Generic (PLEG): container finished" podID="0b1aaad7-cff2-429e-ab7e-442978938b90" containerID="218188521dcf8ddb711be7d279e05506753f29715c0e83a7c4ea97c4c3bdbe38" exitCode=0 Sep 07 16:26:28.558065 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:28.558052 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b1aaad7-cff2-429e-ab7e-442978938b90","Type":"ContainerDied","Data":"218188521dcf8ddb711be7d279e05506753f29715c0e83a7c4ea97c4c3bdbe38"} Sep 07 16:26:28.558260 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:28.558122 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b1aaad7-cff2-429e-ab7e-442978938b90","Type":"ContainerStarted","Data":"577e8fab41700bdb24445db209487cdc44a907da85671b79567a9326f9203a34"} Sep 07 16:26:29.565187 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:29.565155 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b1aaad7-cff2-429e-ab7e-442978938b90","Type":"ContainerStarted","Data":"cb241001951cd85ee48e97de326177f3281fc01ed52e2a759416729c70b314d7"} Sep 07 16:26:29.565577 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:29.565219 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b1aaad7-cff2-429e-ab7e-442978938b90","Type":"ContainerStarted","Data":"3bd0c53e22b8ffbfb9273e9669a9583c1c29293cf742f12646fe742c54ba09fb"} Sep 07 16:26:29.565577 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:29.565248 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b1aaad7-cff2-429e-ab7e-442978938b90","Type":"ContainerStarted","Data":"6c66e330a0d7f6722c11eac464915357c39bfb25f44d1d38f9bf8c834d81b751"} Sep 07 16:26:29.565577 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:29.565272 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b1aaad7-cff2-429e-ab7e-442978938b90","Type":"ContainerStarted","Data":"fd88fe6704175b5c6ccc7eca407c0513b984c067b18c3b0150b4efb9c3a65f2b"} Sep 07 16:26:29.565577 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:29.565296 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b1aaad7-cff2-429e-ab7e-442978938b90","Type":"ContainerStarted","Data":"f87da7eb50f9c6ca6993445bfa90161be1a357bfe348406d8a2ce5bcb00b9d9e"} Sep 07 16:26:29.565577 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:29.565327 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b1aaad7-cff2-429e-ab7e-442978938b90","Type":"ContainerStarted","Data":"7a3de625db02dacd7da94bcbeff39c8f12cb9b02bbd1cd3775851781bd55dc9b"} Sep 07 16:26:29.591530 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:29.591461 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.569690388 podStartE2EDuration="2.591438347s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.747959ms" isStatefulPod=false podCreationTimestamp="2026-09-07 16:26:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:26:29.590654927 +0000 UTC m=+388.148012459" watchObservedRunningTime="2026-09-07 16:26:29.591438347 +0000 UTC m=+388.148795861" Sep 07 16:26:32.932714 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:26:32.932678 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:27:27.932705 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:27:27.932594 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:27:27.947917 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:27:27.947889 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:27:28.799220 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:27:28.799188 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 16:30:01.934678 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:30:01.934650 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f72gx_279b7732-ff48-482d-b216-0167445c26ab/ovn-acl-logging/0.log" Sep 07 16:30:01.935894 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:30:01.935869 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f72gx_279b7732-ff48-482d-b216-0167445c26ab/ovn-acl-logging/0.log" Sep 07 16:30:15.825037 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:30:15.825005 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj"] Sep 07 16:30:15.827578 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:30:15.827563 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj" Sep 07 16:30:15.829925 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:30:15.829894 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-lnb2k\"/\"openshift-service-ca.crt\"" Sep 07 16:30:15.829925 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:30:15.829905 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-lnb2k\"/\"kube-root-ca.crt\"" Sep 07 16:30:15.830101 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:30:15.829940 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-lnb2k\"/\"default-dockercfg-s925g\"" Sep 07 16:30:15.837924 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:30:15.837895 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj"] Sep 07 16:30:15.928667 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:30:15.928631 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm5ss\" (UniqueName: \"kubernetes.io/projected/5c34aad9-65dc-47f7-94bf-b91261440a61-kube-api-access-fm5ss\") pod \"progression-enabled-node-0-0-ckffj\" (UID: \"5c34aad9-65dc-47f7-94bf-b91261440a61\") " pod="rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj" Sep 07 16:30:16.029298 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:30:16.029260 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm5ss\" (UniqueName: \"kubernetes.io/projected/5c34aad9-65dc-47f7-94bf-b91261440a61-kube-api-access-fm5ss\") pod \"progression-enabled-node-0-0-ckffj\" (UID: \"5c34aad9-65dc-47f7-94bf-b91261440a61\") " pod="rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj" Sep 07 16:30:16.037436 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:30:16.037404 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm5ss\" (UniqueName: \"kubernetes.io/projected/5c34aad9-65dc-47f7-94bf-b91261440a61-kube-api-access-fm5ss\") pod \"progression-enabled-node-0-0-ckffj\" (UID: \"5c34aad9-65dc-47f7-94bf-b91261440a61\") " pod="rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj" Sep 07 16:30:16.138316 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:30:16.138225 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj" Sep 07 16:30:16.409477 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:30:16.409391 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj"] Sep 07 16:30:16.412645 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:30:16.412586 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c34aad9_65dc_47f7_94bf_b91261440a61.slice/crio-89e981bdc2d9955d792e2bfdcd897a3f78972db7e06c48f92e18fa491da4f243 WatchSource:0}: Error finding container 89e981bdc2d9955d792e2bfdcd897a3f78972db7e06c48f92e18fa491da4f243: Status 404 returned error can't find the container with id 89e981bdc2d9955d792e2bfdcd897a3f78972db7e06c48f92e18fa491da4f243 Sep 07 16:30:16.415144 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:30:16.415122 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 16:30:17.379692 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:30:17.379594 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj" event={"ID":"5c34aad9-65dc-47f7-94bf-b91261440a61","Type":"ContainerStarted","Data":"89e981bdc2d9955d792e2bfdcd897a3f78972db7e06c48f92e18fa491da4f243"} Sep 07 16:32:09.837687 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:09.837650 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj" event={"ID":"5c34aad9-65dc-47f7-94bf-b91261440a61","Type":"ContainerStarted","Data":"11e4624c1019e16c6ce98ae12e261079350072ff2fdc40b64cf2c1dd7c77b0ff"} Sep 07 16:32:09.838130 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:09.837754 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj" Sep 07 16:32:09.860281 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:09.860228 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj" podStartSLOduration=2.519654799 podStartE2EDuration="1m54.860211342s" totalImagesPullingTime="1m52.340556543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:30:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:32:09.858555127 +0000 UTC m=+728.415912640" watchObservedRunningTime="2026-09-07 16:32:09.860211342 +0000 UTC m=+728.417568858" Sep 07 16:32:10.840841 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:10.840810 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj" Sep 07 16:32:32.201052 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:32.201010 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj" podUID="5c34aad9-65dc-47f7-94bf-b91261440a61" containerName="node" probeResult="failure" output="Get \"http://10.134.0.15:28080/metrics\": read tcp 10.134.0.2:52642->10.134.0.15:28080: read: connection reset by peer" Sep 07 16:32:32.839007 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:32.838963 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj" podUID="5c34aad9-65dc-47f7-94bf-b91261440a61" containerName="node" probeResult="failure" output="Get \"http://10.134.0.15:28080/metrics\": dial tcp 10.134.0.15:28080: connect: connection refused" Sep 07 16:32:32.839192 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:32.839101 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj" Sep 07 16:32:32.839574 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:32.839540 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj" podUID="5c34aad9-65dc-47f7-94bf-b91261440a61" containerName="node" probeResult="failure" output="Get \"http://10.134.0.15:28080/metrics\": dial tcp 10.134.0.15:28080: connect: connection refused" Sep 07 16:32:32.930526 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:32.930493 2561 generic.go:356] "Generic (PLEG): container finished" podID="5c34aad9-65dc-47f7-94bf-b91261440a61" containerID="11e4624c1019e16c6ce98ae12e261079350072ff2fdc40b64cf2c1dd7c77b0ff" exitCode=0 Sep 07 16:32:32.930723 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:32.930567 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj" event={"ID":"5c34aad9-65dc-47f7-94bf-b91261440a61","Type":"ContainerDied","Data":"11e4624c1019e16c6ce98ae12e261079350072ff2fdc40b64cf2c1dd7c77b0ff"} Sep 07 16:32:34.074318 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:34.074285 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj" Sep 07 16:32:34.111687 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:34.111648 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fm5ss\" (UniqueName: \"kubernetes.io/projected/5c34aad9-65dc-47f7-94bf-b91261440a61-kube-api-access-fm5ss\") pod \"5c34aad9-65dc-47f7-94bf-b91261440a61\" (UID: \"5c34aad9-65dc-47f7-94bf-b91261440a61\") " Sep 07 16:32:34.113863 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:34.113822 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c34aad9-65dc-47f7-94bf-b91261440a61-kube-api-access-fm5ss" (OuterVolumeSpecName: "kube-api-access-fm5ss") pod "5c34aad9-65dc-47f7-94bf-b91261440a61" (UID: "5c34aad9-65dc-47f7-94bf-b91261440a61"). InnerVolumeSpecName "kube-api-access-fm5ss". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 16:32:34.213130 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:34.213037 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fm5ss\" (UniqueName: \"kubernetes.io/projected/5c34aad9-65dc-47f7-94bf-b91261440a61-kube-api-access-fm5ss\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:32:34.939273 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:34.939240 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj" Sep 07 16:32:34.939273 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:34.939251 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj" event={"ID":"5c34aad9-65dc-47f7-94bf-b91261440a61","Type":"ContainerDied","Data":"89e981bdc2d9955d792e2bfdcd897a3f78972db7e06c48f92e18fa491da4f243"} Sep 07 16:32:34.939491 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:34.939300 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89e981bdc2d9955d792e2bfdcd897a3f78972db7e06c48f92e18fa491da4f243" Sep 07 16:32:36.291324 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:36.291290 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27"] Sep 07 16:32:36.291744 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:36.291533 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c34aad9-65dc-47f7-94bf-b91261440a61" containerName="node" Sep 07 16:32:36.291744 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:36.291543 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c34aad9-65dc-47f7-94bf-b91261440a61" containerName="node" Sep 07 16:32:36.291744 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:36.291599 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c34aad9-65dc-47f7-94bf-b91261440a61" containerName="node" Sep 07 16:32:36.313807 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:36.313782 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27" Sep 07 16:32:36.313987 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:36.313774 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27"] Sep 07 16:32:36.316169 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:36.316137 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-lnb2k\"/\"openshift-service-ca.crt\"" Sep 07 16:32:36.316169 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:36.316155 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-lnb2k\"/\"default-dockercfg-s925g\"" Sep 07 16:32:36.316169 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:36.316137 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-lnb2k\"/\"kube-root-ca.crt\"" Sep 07 16:32:36.329572 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:36.329542 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqmsm\" (UniqueName: \"kubernetes.io/projected/2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db-kube-api-access-kqmsm\") pod \"progression-disabled-node-0-0-csw27\" (UID: \"2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db\") " pod="rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27" Sep 07 16:32:36.430871 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:36.430826 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqmsm\" (UniqueName: \"kubernetes.io/projected/2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db-kube-api-access-kqmsm\") pod \"progression-disabled-node-0-0-csw27\" (UID: \"2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db\") " pod="rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27" Sep 07 16:32:36.438558 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:36.438521 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqmsm\" (UniqueName: \"kubernetes.io/projected/2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db-kube-api-access-kqmsm\") pod \"progression-disabled-node-0-0-csw27\" (UID: \"2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db\") " pod="rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27" Sep 07 16:32:36.623156 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:36.623067 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27" Sep 07 16:32:36.919101 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:36.919077 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27"] Sep 07 16:32:36.921539 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:32:36.921507 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f2bc014_1b44_4a4e_b6b6_e9500a4ba3db.slice/crio-5a62b5e2c0e3127f36fa5bdd83ee83f88a2b1a009e9b981ae42d8abc2b0c1f8e WatchSource:0}: Error finding container 5a62b5e2c0e3127f36fa5bdd83ee83f88a2b1a009e9b981ae42d8abc2b0c1f8e: Status 404 returned error can't find the container with id 5a62b5e2c0e3127f36fa5bdd83ee83f88a2b1a009e9b981ae42d8abc2b0c1f8e Sep 07 16:32:36.948271 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:36.948238 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27" event={"ID":"2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db","Type":"ContainerStarted","Data":"5a62b5e2c0e3127f36fa5bdd83ee83f88a2b1a009e9b981ae42d8abc2b0c1f8e"} Sep 07 16:32:37.954954 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:37.954920 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27" event={"ID":"2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db","Type":"ContainerStarted","Data":"994ca2ca91afb32fc188bb45ee5d8c080a48b43f860de50e381004dbc1b91e86"} Sep 07 16:32:37.955311 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:37.955025 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27" Sep 07 16:32:37.975932 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:37.971227 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27" podStartSLOduration=1.971205249 podStartE2EDuration="1.971205249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:32:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:32:37.969749834 +0000 UTC m=+756.527107359" watchObservedRunningTime="2026-09-07 16:32:37.971205249 +0000 UTC m=+756.528562762" Sep 07 16:32:39.961698 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:32:39.961665 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27" Sep 07 16:33:00.325944 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:00.325886 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27" podUID="2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db" containerName="node" probeResult="failure" output="Get \"http://10.134.0.16:28080/metrics\": read tcp 10.134.0.2:53404->10.134.0.16:28080: read: connection reset by peer" Sep 07 16:33:00.959147 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:00.959092 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27" podUID="2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db" containerName="node" probeResult="failure" output="Get \"http://10.134.0.16:28080/metrics\": dial tcp 10.134.0.16:28080: connect: connection refused" Sep 07 16:33:00.959358 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:00.959230 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27" Sep 07 16:33:00.959825 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:00.959793 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27" podUID="2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db" containerName="node" probeResult="failure" output="Get \"http://10.134.0.16:28080/metrics\": dial tcp 10.134.0.16:28080: connect: connection refused" Sep 07 16:33:01.044025 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:01.043984 2561 generic.go:356] "Generic (PLEG): container finished" podID="2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db" containerID="994ca2ca91afb32fc188bb45ee5d8c080a48b43f860de50e381004dbc1b91e86" exitCode=0 Sep 07 16:33:01.044239 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:01.044056 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27" event={"ID":"2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db","Type":"ContainerDied","Data":"994ca2ca91afb32fc188bb45ee5d8c080a48b43f860de50e381004dbc1b91e86"} Sep 07 16:33:02.181090 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:02.181060 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27" Sep 07 16:33:02.254008 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:02.253941 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqmsm\" (UniqueName: \"kubernetes.io/projected/2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db-kube-api-access-kqmsm\") pod \"2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db\" (UID: \"2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db\") " Sep 07 16:33:02.256209 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:02.256178 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db-kube-api-access-kqmsm" (OuterVolumeSpecName: "kube-api-access-kqmsm") pod "2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db" (UID: "2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db"). InnerVolumeSpecName "kube-api-access-kqmsm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 16:33:02.355744 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:02.355638 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqmsm\" (UniqueName: \"kubernetes.io/projected/2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db-kube-api-access-kqmsm\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:33:03.053941 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:03.053905 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27" Sep 07 16:33:03.054214 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:03.053912 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27" event={"ID":"2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db","Type":"ContainerDied","Data":"5a62b5e2c0e3127f36fa5bdd83ee83f88a2b1a009e9b981ae42d8abc2b0c1f8e"} Sep 07 16:33:03.054214 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:03.054026 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a62b5e2c0e3127f36fa5bdd83ee83f88a2b1a009e9b981ae42d8abc2b0c1f8e" Sep 07 16:33:11.291204 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:11.291159 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw"] Sep 07 16:33:11.291771 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:11.291623 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db" containerName="node" Sep 07 16:33:11.291771 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:11.291643 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db" containerName="node" Sep 07 16:33:11.291771 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:11.291733 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db" containerName="node" Sep 07 16:33:11.293885 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:11.293859 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw" Sep 07 16:33:11.296086 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:11.296058 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-lnb2k\"/\"kube-root-ca.crt\"" Sep 07 16:33:11.296262 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:11.296113 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-lnb2k\"/\"default-dockercfg-s925g\"" Sep 07 16:33:11.296262 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:11.296138 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-lnb2k\"/\"openshift-service-ca.crt\"" Sep 07 16:33:11.303405 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:11.303367 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw"] Sep 07 16:33:11.436630 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:11.436574 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrx4n\" (UniqueName: \"kubernetes.io/projected/6b3e27ff-db7b-447c-91ef-4850730440cb-kube-api-access-qrx4n\") pod \"progression-invalid-node-0-0-k7rhw\" (UID: \"6b3e27ff-db7b-447c-91ef-4850730440cb\") " pod="rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw" Sep 07 16:33:11.537499 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:11.537447 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrx4n\" (UniqueName: \"kubernetes.io/projected/6b3e27ff-db7b-447c-91ef-4850730440cb-kube-api-access-qrx4n\") pod \"progression-invalid-node-0-0-k7rhw\" (UID: \"6b3e27ff-db7b-447c-91ef-4850730440cb\") " pod="rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw" Sep 07 16:33:11.545565 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:11.545496 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrx4n\" (UniqueName: \"kubernetes.io/projected/6b3e27ff-db7b-447c-91ef-4850730440cb-kube-api-access-qrx4n\") pod \"progression-invalid-node-0-0-k7rhw\" (UID: \"6b3e27ff-db7b-447c-91ef-4850730440cb\") " pod="rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw" Sep 07 16:33:11.605574 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:11.605518 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw" Sep 07 16:33:11.884844 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:11.884763 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw"] Sep 07 16:33:11.888082 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:33:11.888041 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b3e27ff_db7b_447c_91ef_4850730440cb.slice/crio-9839dc22fbef249b615dc6b99d9553c7842e445b47933fbc46d8f65eaecb8ba0 WatchSource:0}: Error finding container 9839dc22fbef249b615dc6b99d9553c7842e445b47933fbc46d8f65eaecb8ba0: Status 404 returned error can't find the container with id 9839dc22fbef249b615dc6b99d9553c7842e445b47933fbc46d8f65eaecb8ba0 Sep 07 16:33:12.091110 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:12.091067 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw" event={"ID":"6b3e27ff-db7b-447c-91ef-4850730440cb","Type":"ContainerStarted","Data":"ce006262357cacd6cad79957840db9171e01e2e10e82bfa64627311e63c09c53"} Sep 07 16:33:12.091317 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:12.091131 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw" event={"ID":"6b3e27ff-db7b-447c-91ef-4850730440cb","Type":"ContainerStarted","Data":"9839dc22fbef249b615dc6b99d9553c7842e445b47933fbc46d8f65eaecb8ba0"} Sep 07 16:33:12.091317 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:12.091208 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw" Sep 07 16:33:12.105923 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:12.105867 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw" podStartSLOduration=1.105845575 podStartE2EDuration="1.105845575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:33:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:33:12.105222187 +0000 UTC m=+790.662579700" watchObservedRunningTime="2026-09-07 16:33:12.105845575 +0000 UTC m=+790.663203088" Sep 07 16:33:13.094308 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:13.094261 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw" podUID="6b3e27ff-db7b-447c-91ef-4850730440cb" containerName="node" probeResult="failure" output="Get \"http://10.134.0.17:28080/metrics\": dial tcp 10.134.0.17:28080: connect: connection refused" Sep 07 16:33:13.097443 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:13.097401 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw" podUID="6b3e27ff-db7b-447c-91ef-4850730440cb" containerName="node" probeResult="failure" output="Get \"http://10.134.0.17:28080/metrics\": dial tcp 10.134.0.17:28080: connect: connection refused" Sep 07 16:33:14.098736 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:14.098701 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw" Sep 07 16:33:35.446563 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:35.446506 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw" podUID="6b3e27ff-db7b-447c-91ef-4850730440cb" containerName="node" probeResult="failure" output="Get \"http://10.134.0.17:28080/metrics\": read tcp 10.134.0.2:43906->10.134.0.17:28080: read: connection reset by peer" Sep 07 16:33:36.097321 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:36.097266 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw" podUID="6b3e27ff-db7b-447c-91ef-4850730440cb" containerName="node" probeResult="failure" output="Get \"http://10.134.0.17:28080/metrics\": dial tcp 10.134.0.17:28080: connect: connection refused" Sep 07 16:33:36.097551 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:36.097397 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw" Sep 07 16:33:36.098097 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:36.098065 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw" podUID="6b3e27ff-db7b-447c-91ef-4850730440cb" containerName="node" probeResult="failure" output="Get \"http://10.134.0.17:28080/metrics\": dial tcp 10.134.0.17:28080: connect: connection refused" Sep 07 16:33:36.188092 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:36.188057 2561 generic.go:356] "Generic (PLEG): container finished" podID="6b3e27ff-db7b-447c-91ef-4850730440cb" containerID="ce006262357cacd6cad79957840db9171e01e2e10e82bfa64627311e63c09c53" exitCode=0 Sep 07 16:33:36.188283 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:36.188131 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw" event={"ID":"6b3e27ff-db7b-447c-91ef-4850730440cb","Type":"ContainerDied","Data":"ce006262357cacd6cad79957840db9171e01e2e10e82bfa64627311e63c09c53"} Sep 07 16:33:37.317455 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:37.317423 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw" Sep 07 16:33:37.349140 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:37.349102 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrx4n\" (UniqueName: \"kubernetes.io/projected/6b3e27ff-db7b-447c-91ef-4850730440cb-kube-api-access-qrx4n\") pod \"6b3e27ff-db7b-447c-91ef-4850730440cb\" (UID: \"6b3e27ff-db7b-447c-91ef-4850730440cb\") " Sep 07 16:33:37.351283 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:37.351248 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b3e27ff-db7b-447c-91ef-4850730440cb-kube-api-access-qrx4n" (OuterVolumeSpecName: "kube-api-access-qrx4n") pod "6b3e27ff-db7b-447c-91ef-4850730440cb" (UID: "6b3e27ff-db7b-447c-91ef-4850730440cb"). InnerVolumeSpecName "kube-api-access-qrx4n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 16:33:37.450099 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:37.450009 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrx4n\" (UniqueName: \"kubernetes.io/projected/6b3e27ff-db7b-447c-91ef-4850730440cb-kube-api-access-qrx4n\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:33:38.197223 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:38.197188 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw" Sep 07 16:33:38.197223 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:38.197210 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw" event={"ID":"6b3e27ff-db7b-447c-91ef-4850730440cb","Type":"ContainerDied","Data":"9839dc22fbef249b615dc6b99d9553c7842e445b47933fbc46d8f65eaecb8ba0"} Sep 07 16:33:38.197513 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:33:38.197258 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9839dc22fbef249b615dc6b99d9553c7842e445b47933fbc46d8f65eaecb8ba0" Sep 07 16:35:01.958078 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:01.958046 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f72gx_279b7732-ff48-482d-b216-0167445c26ab/ovn-acl-logging/0.log" Sep 07 16:35:01.959939 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:01.959914 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f72gx_279b7732-ff48-482d-b216-0167445c26ab/ovn-acl-logging/0.log" Sep 07 16:35:28.880599 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:28.880557 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-lnb2k/progression-no-metrics-node-0-0-ljwrs"] Sep 07 16:35:28.882308 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:28.880852 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b3e27ff-db7b-447c-91ef-4850730440cb" containerName="node" Sep 07 16:35:28.882308 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:28.880864 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b3e27ff-db7b-447c-91ef-4850730440cb" containerName="node" Sep 07 16:35:28.882308 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:28.880917 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b3e27ff-db7b-447c-91ef-4850730440cb" containerName="node" Sep 07 16:35:28.882770 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:28.882752 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-lnb2k/progression-no-metrics-node-0-0-ljwrs" Sep 07 16:35:28.885158 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:28.885127 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-lnb2k\"/\"openshift-service-ca.crt\"" Sep 07 16:35:28.885158 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:28.885133 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-lnb2k\"/\"default-dockercfg-s925g\"" Sep 07 16:35:28.885808 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:28.885786 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-lnb2k\"/\"kube-root-ca.crt\"" Sep 07 16:35:28.892196 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:28.892159 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-lnb2k/progression-no-metrics-node-0-0-ljwrs"] Sep 07 16:35:29.049783 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:29.049735 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9bbt\" (UniqueName: \"kubernetes.io/projected/0871c178-f8b7-46ec-8e81-e92fc13bcee4-kube-api-access-l9bbt\") pod \"progression-no-metrics-node-0-0-ljwrs\" (UID: \"0871c178-f8b7-46ec-8e81-e92fc13bcee4\") " pod="rhai-e2e-progression-lnb2k/progression-no-metrics-node-0-0-ljwrs" Sep 07 16:35:29.150999 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:29.150904 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9bbt\" (UniqueName: \"kubernetes.io/projected/0871c178-f8b7-46ec-8e81-e92fc13bcee4-kube-api-access-l9bbt\") pod \"progression-no-metrics-node-0-0-ljwrs\" (UID: \"0871c178-f8b7-46ec-8e81-e92fc13bcee4\") " pod="rhai-e2e-progression-lnb2k/progression-no-metrics-node-0-0-ljwrs" Sep 07 16:35:29.158702 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:29.158669 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9bbt\" (UniqueName: \"kubernetes.io/projected/0871c178-f8b7-46ec-8e81-e92fc13bcee4-kube-api-access-l9bbt\") pod \"progression-no-metrics-node-0-0-ljwrs\" (UID: \"0871c178-f8b7-46ec-8e81-e92fc13bcee4\") " pod="rhai-e2e-progression-lnb2k/progression-no-metrics-node-0-0-ljwrs" Sep 07 16:35:29.196642 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:29.196574 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-lnb2k/progression-no-metrics-node-0-0-ljwrs" Sep 07 16:35:29.469717 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:29.469600 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-lnb2k/progression-no-metrics-node-0-0-ljwrs"] Sep 07 16:35:29.472435 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:35:29.472398 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0871c178_f8b7_46ec_8e81_e92fc13bcee4.slice/crio-f3f1ef48015524402bd6ce3fa7d153a37dd7cb2354bc63f36dd33122a1d085c3 WatchSource:0}: Error finding container f3f1ef48015524402bd6ce3fa7d153a37dd7cb2354bc63f36dd33122a1d085c3: Status 404 returned error can't find the container with id f3f1ef48015524402bd6ce3fa7d153a37dd7cb2354bc63f36dd33122a1d085c3 Sep 07 16:35:29.656127 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:29.656091 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-lnb2k/progression-no-metrics-node-0-0-ljwrs" event={"ID":"0871c178-f8b7-46ec-8e81-e92fc13bcee4","Type":"ContainerStarted","Data":"527308df47ea6a01fda33ea675e833f14bbbacdfaa6f9b45aff6e10e439ce907"} Sep 07 16:35:29.656342 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:29.656145 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-lnb2k/progression-no-metrics-node-0-0-ljwrs" event={"ID":"0871c178-f8b7-46ec-8e81-e92fc13bcee4","Type":"ContainerStarted","Data":"f3f1ef48015524402bd6ce3fa7d153a37dd7cb2354bc63f36dd33122a1d085c3"} Sep 07 16:35:29.674148 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:29.674087 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-lnb2k/progression-no-metrics-node-0-0-ljwrs" podStartSLOduration=1.674068719 podStartE2EDuration="1.674068719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:35:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:35:29.672899313 +0000 UTC m=+928.230256845" watchObservedRunningTime="2026-09-07 16:35:29.674068719 +0000 UTC m=+928.231426232" Sep 07 16:35:34.677457 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:34.677419 2561 generic.go:356] "Generic (PLEG): container finished" podID="0871c178-f8b7-46ec-8e81-e92fc13bcee4" containerID="527308df47ea6a01fda33ea675e833f14bbbacdfaa6f9b45aff6e10e439ce907" exitCode=0 Sep 07 16:35:34.677881 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:34.677489 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-lnb2k/progression-no-metrics-node-0-0-ljwrs" event={"ID":"0871c178-f8b7-46ec-8e81-e92fc13bcee4","Type":"ContainerDied","Data":"527308df47ea6a01fda33ea675e833f14bbbacdfaa6f9b45aff6e10e439ce907"} Sep 07 16:35:35.810808 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:35.810773 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-lnb2k/progression-no-metrics-node-0-0-ljwrs" Sep 07 16:35:36.005719 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:36.005687 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9bbt\" (UniqueName: \"kubernetes.io/projected/0871c178-f8b7-46ec-8e81-e92fc13bcee4-kube-api-access-l9bbt\") pod \"0871c178-f8b7-46ec-8e81-e92fc13bcee4\" (UID: \"0871c178-f8b7-46ec-8e81-e92fc13bcee4\") " Sep 07 16:35:36.007898 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:36.007864 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0871c178-f8b7-46ec-8e81-e92fc13bcee4-kube-api-access-l9bbt" (OuterVolumeSpecName: "kube-api-access-l9bbt") pod "0871c178-f8b7-46ec-8e81-e92fc13bcee4" (UID: "0871c178-f8b7-46ec-8e81-e92fc13bcee4"). InnerVolumeSpecName "kube-api-access-l9bbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 16:35:36.106664 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:36.106604 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9bbt\" (UniqueName: \"kubernetes.io/projected/0871c178-f8b7-46ec-8e81-e92fc13bcee4-kube-api-access-l9bbt\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:35:36.686850 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:36.686817 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-lnb2k/progression-no-metrics-node-0-0-ljwrs" Sep 07 16:35:36.686850 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:36.686833 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-lnb2k/progression-no-metrics-node-0-0-ljwrs" event={"ID":"0871c178-f8b7-46ec-8e81-e92fc13bcee4","Type":"ContainerDied","Data":"f3f1ef48015524402bd6ce3fa7d153a37dd7cb2354bc63f36dd33122a1d085c3"} Sep 07 16:35:36.687095 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:36.686921 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3f1ef48015524402bd6ce3fa7d153a37dd7cb2354bc63f36dd33122a1d085c3" Sep 07 16:35:37.601044 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:37.601001 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z58q4/must-gather-qnpj9"] Sep 07 16:35:37.601460 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:37.601306 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0871c178-f8b7-46ec-8e81-e92fc13bcee4" containerName="node" Sep 07 16:35:37.601460 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:37.601331 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0871c178-f8b7-46ec-8e81-e92fc13bcee4" containerName="node" Sep 07 16:35:37.601460 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:37.601400 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0871c178-f8b7-46ec-8e81-e92fc13bcee4" containerName="node" Sep 07 16:35:37.603461 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:37.603436 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z58q4/must-gather-qnpj9" Sep 07 16:35:37.606047 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:37.606021 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z58q4\"/\"kube-root-ca.crt\"" Sep 07 16:35:37.606220 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:37.606057 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z58q4\"/\"openshift-service-ca.crt\"" Sep 07 16:35:37.606726 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:37.606710 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z58q4\"/\"default-dockercfg-t68v8\"" Sep 07 16:35:37.611751 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:37.611724 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z58q4/must-gather-qnpj9"] Sep 07 16:35:37.618870 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:37.618834 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/aa9f5f35-bb6f-4af1-b199-87eef7933b50-must-gather-output\") pod \"must-gather-qnpj9\" (UID: \"aa9f5f35-bb6f-4af1-b199-87eef7933b50\") " pod="openshift-must-gather-z58q4/must-gather-qnpj9" Sep 07 16:35:37.618870 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:37.618874 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9pff\" (UniqueName: \"kubernetes.io/projected/aa9f5f35-bb6f-4af1-b199-87eef7933b50-kube-api-access-n9pff\") pod \"must-gather-qnpj9\" (UID: \"aa9f5f35-bb6f-4af1-b199-87eef7933b50\") " pod="openshift-must-gather-z58q4/must-gather-qnpj9" Sep 07 16:35:37.719886 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:37.719843 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/aa9f5f35-bb6f-4af1-b199-87eef7933b50-must-gather-output\") pod \"must-gather-qnpj9\" (UID: \"aa9f5f35-bb6f-4af1-b199-87eef7933b50\") " pod="openshift-must-gather-z58q4/must-gather-qnpj9" Sep 07 16:35:37.719886 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:37.719886 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9pff\" (UniqueName: \"kubernetes.io/projected/aa9f5f35-bb6f-4af1-b199-87eef7933b50-kube-api-access-n9pff\") pod \"must-gather-qnpj9\" (UID: \"aa9f5f35-bb6f-4af1-b199-87eef7933b50\") " pod="openshift-must-gather-z58q4/must-gather-qnpj9" Sep 07 16:35:37.720214 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:37.720189 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/aa9f5f35-bb6f-4af1-b199-87eef7933b50-must-gather-output\") pod \"must-gather-qnpj9\" (UID: \"aa9f5f35-bb6f-4af1-b199-87eef7933b50\") " pod="openshift-must-gather-z58q4/must-gather-qnpj9" Sep 07 16:35:37.728540 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:37.728508 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9pff\" (UniqueName: \"kubernetes.io/projected/aa9f5f35-bb6f-4af1-b199-87eef7933b50-kube-api-access-n9pff\") pod \"must-gather-qnpj9\" (UID: \"aa9f5f35-bb6f-4af1-b199-87eef7933b50\") " pod="openshift-must-gather-z58q4/must-gather-qnpj9" Sep 07 16:35:37.914464 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:37.914375 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z58q4/must-gather-qnpj9" Sep 07 16:35:38.185384 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:38.185356 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z58q4/must-gather-qnpj9"] Sep 07 16:35:38.188063 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:35:38.188031 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa9f5f35_bb6f_4af1_b199_87eef7933b50.slice/crio-526a62ba78f18521cea3e1ad60aebf10916bc2f861e96d89a725f45629a30206 WatchSource:0}: Error finding container 526a62ba78f18521cea3e1ad60aebf10916bc2f861e96d89a725f45629a30206: Status 404 returned error can't find the container with id 526a62ba78f18521cea3e1ad60aebf10916bc2f861e96d89a725f45629a30206 Sep 07 16:35:38.190141 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:38.190121 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 16:35:38.696238 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:38.696201 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z58q4/must-gather-qnpj9" event={"ID":"aa9f5f35-bb6f-4af1-b199-87eef7933b50","Type":"ContainerStarted","Data":"526a62ba78f18521cea3e1ad60aebf10916bc2f861e96d89a725f45629a30206"} Sep 07 16:35:41.935042 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:41.935000 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27"] Sep 07 16:35:41.938369 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:41.938337 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-lnb2k/progression-disabled-node-0-0-csw27"] Sep 07 16:35:41.943073 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:41.943038 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj"] Sep 07 16:35:41.947023 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:41.946988 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-lnb2k/progression-enabled-node-0-0-ckffj"] Sep 07 16:35:41.951592 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:41.951558 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw"] Sep 07 16:35:41.954889 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:41.954857 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-lnb2k/progression-invalid-node-0-0-k7rhw"] Sep 07 16:35:41.969789 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:41.969750 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-lnb2k/progression-no-metrics-node-0-0-ljwrs"] Sep 07 16:35:41.971878 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:41.971845 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-lnb2k/progression-no-metrics-node-0-0-ljwrs"] Sep 07 16:35:42.016706 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:42.016657 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0871c178-f8b7-46ec-8e81-e92fc13bcee4" path="/var/lib/kubelet/pods/0871c178-f8b7-46ec-8e81-e92fc13bcee4/volumes" Sep 07 16:35:42.017105 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:42.017085 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db" path="/var/lib/kubelet/pods/2f2bc014-1b44-4a4e-b6b6-e9500a4ba3db/volumes" Sep 07 16:35:42.017455 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:42.017437 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c34aad9-65dc-47f7-94bf-b91261440a61" path="/var/lib/kubelet/pods/5c34aad9-65dc-47f7-94bf-b91261440a61/volumes" Sep 07 16:35:42.017833 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:42.017814 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b3e27ff-db7b-447c-91ef-4850730440cb" path="/var/lib/kubelet/pods/6b3e27ff-db7b-447c-91ef-4850730440cb/volumes" Sep 07 16:35:44.730148 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:44.730102 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z58q4/must-gather-qnpj9" event={"ID":"aa9f5f35-bb6f-4af1-b199-87eef7933b50","Type":"ContainerStarted","Data":"2835f479b0dbf08396f235d6db6f87b273d1200f225bbe2a82e99c86649b2521"} Sep 07 16:35:44.730626 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:44.730166 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z58q4/must-gather-qnpj9" event={"ID":"aa9f5f35-bb6f-4af1-b199-87eef7933b50","Type":"ContainerStarted","Data":"bf309883902ad6714d6a043d48308349851da456fee001194f18df7be2cc0b3b"} Sep 07 16:35:44.746635 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:35:44.746546 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z58q4/must-gather-qnpj9" podStartSLOduration=1.5209397770000002 podStartE2EDuration="7.746521605s" totalImagesPullingTime="6.225581828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 16:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:35:44.745229785 +0000 UTC m=+943.302587299" watchObservedRunningTime="2026-09-07 16:35:44.746521605 +0000 UTC m=+943.303879121" Sep 07 16:36:32.956153 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:32.956110 2561 generic.go:356] "Generic (PLEG): container finished" podID="aa9f5f35-bb6f-4af1-b199-87eef7933b50" containerID="bf309883902ad6714d6a043d48308349851da456fee001194f18df7be2cc0b3b" exitCode=0 Sep 07 16:36:32.956647 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:32.956167 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z58q4/must-gather-qnpj9" event={"ID":"aa9f5f35-bb6f-4af1-b199-87eef7933b50","Type":"ContainerDied","Data":"bf309883902ad6714d6a043d48308349851da456fee001194f18df7be2cc0b3b"} Sep 07 16:36:32.956647 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:32.956516 2561 scope.go:117] "RemoveContainer" containerID="bf309883902ad6714d6a043d48308349851da456fee001194f18df7be2cc0b3b" Sep 07 16:36:33.842726 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:33.842689 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-z58q4_must-gather-qnpj9_aa9f5f35-bb6f-4af1-b199-87eef7933b50/gather/0.log" Sep 07 16:36:37.263762 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:37.263725 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ffbmx_e2409fd0-edee-41fb-b5e2-00c59ce4ea59/global-pull-secret-syncer/0.log" Sep 07 16:36:37.401061 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:37.401017 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pc2zg_072a72a7-30ae-4d3a-8dea-5daa1f14823c/konnectivity-agent/0.log" Sep 07 16:36:37.493776 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:37.493736 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-30.ec2.internal_329a346aaabf8018f97c250e4e6fc8a2/haproxy/0.log" Sep 07 16:36:39.171703 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:39.171662 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-z58q4/must-gather-qnpj9"] Sep 07 16:36:39.172298 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:39.171954 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-z58q4/must-gather-qnpj9" podUID="aa9f5f35-bb6f-4af1-b199-87eef7933b50" containerName="copy" containerID="cri-o://2835f479b0dbf08396f235d6db6f87b273d1200f225bbe2a82e99c86649b2521" gracePeriod=2 Sep 07 16:36:39.176377 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:39.176190 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-z58q4/must-gather-qnpj9"] Sep 07 16:36:39.419033 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:39.419007 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-z58q4_must-gather-qnpj9_aa9f5f35-bb6f-4af1-b199-87eef7933b50/copy/0.log" Sep 07 16:36:39.421685 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:39.421661 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z58q4/must-gather-qnpj9" Sep 07 16:36:39.423763 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:36:39.423697 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-qnpj9\" is forbidden: User \"system:node:ip-10-0-141-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-z58q4\": no relationship found between node 'ip-10-0-141-30.ec2.internal' and this object" podUID="aa9f5f35-bb6f-4af1-b199-87eef7933b50" pod="openshift-must-gather-z58q4/must-gather-qnpj9" Sep 07 16:36:39.467305 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:39.467263 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/aa9f5f35-bb6f-4af1-b199-87eef7933b50-must-gather-output\") pod \"aa9f5f35-bb6f-4af1-b199-87eef7933b50\" (UID: \"aa9f5f35-bb6f-4af1-b199-87eef7933b50\") " Sep 07 16:36:39.467485 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:39.467352 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9pff\" (UniqueName: \"kubernetes.io/projected/aa9f5f35-bb6f-4af1-b199-87eef7933b50-kube-api-access-n9pff\") pod \"aa9f5f35-bb6f-4af1-b199-87eef7933b50\" (UID: \"aa9f5f35-bb6f-4af1-b199-87eef7933b50\") " Sep 07 16:36:39.468730 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:39.468688 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa9f5f35-bb6f-4af1-b199-87eef7933b50-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "aa9f5f35-bb6f-4af1-b199-87eef7933b50" (UID: "aa9f5f35-bb6f-4af1-b199-87eef7933b50"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 16:36:39.469700 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:39.469669 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa9f5f35-bb6f-4af1-b199-87eef7933b50-kube-api-access-n9pff" (OuterVolumeSpecName: "kube-api-access-n9pff") pod "aa9f5f35-bb6f-4af1-b199-87eef7933b50" (UID: "aa9f5f35-bb6f-4af1-b199-87eef7933b50"). InnerVolumeSpecName "kube-api-access-n9pff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 16:36:39.568318 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:39.568278 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9pff\" (UniqueName: \"kubernetes.io/projected/aa9f5f35-bb6f-4af1-b199-87eef7933b50-kube-api-access-n9pff\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:36:39.568318 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:39.568310 2561 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/aa9f5f35-bb6f-4af1-b199-87eef7933b50-must-gather-output\") on node \"ip-10-0-141-30.ec2.internal\" DevicePath \"\"" Sep 07 16:36:39.987586 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:39.987555 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-z58q4_must-gather-qnpj9_aa9f5f35-bb6f-4af1-b199-87eef7933b50/copy/0.log" Sep 07 16:36:39.988035 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:39.988010 2561 generic.go:356] "Generic (PLEG): container finished" podID="aa9f5f35-bb6f-4af1-b199-87eef7933b50" containerID="2835f479b0dbf08396f235d6db6f87b273d1200f225bbe2a82e99c86649b2521" exitCode=143 Sep 07 16:36:39.988146 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:39.988065 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z58q4/must-gather-qnpj9" Sep 07 16:36:39.988146 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:39.988082 2561 scope.go:117] "RemoveContainer" containerID="2835f479b0dbf08396f235d6db6f87b273d1200f225bbe2a82e99c86649b2521" Sep 07 16:36:39.990112 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:36:39.990078 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-qnpj9\" is forbidden: User \"system:node:ip-10-0-141-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-z58q4\": no relationship found between node 'ip-10-0-141-30.ec2.internal' and this object" podUID="aa9f5f35-bb6f-4af1-b199-87eef7933b50" pod="openshift-must-gather-z58q4/must-gather-qnpj9" Sep 07 16:36:39.997104 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:39.997076 2561 scope.go:117] "RemoveContainer" containerID="bf309883902ad6714d6a043d48308349851da456fee001194f18df7be2cc0b3b" Sep 07 16:36:39.999046 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:36:39.999015 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-qnpj9\" is forbidden: User \"system:node:ip-10-0-141-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-z58q4\": no relationship found between node 'ip-10-0-141-30.ec2.internal' and this object" podUID="aa9f5f35-bb6f-4af1-b199-87eef7933b50" pod="openshift-must-gather-z58q4/must-gather-qnpj9" Sep 07 16:36:40.009200 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:40.009161 2561 scope.go:117] "RemoveContainer" containerID="2835f479b0dbf08396f235d6db6f87b273d1200f225bbe2a82e99c86649b2521" Sep 07 16:36:40.009471 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:36:40.009450 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2835f479b0dbf08396f235d6db6f87b273d1200f225bbe2a82e99c86649b2521\": container with ID starting with 2835f479b0dbf08396f235d6db6f87b273d1200f225bbe2a82e99c86649b2521 not found: ID does not exist" containerID="2835f479b0dbf08396f235d6db6f87b273d1200f225bbe2a82e99c86649b2521" Sep 07 16:36:40.009546 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:40.009479 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2835f479b0dbf08396f235d6db6f87b273d1200f225bbe2a82e99c86649b2521"} err="failed to get container status \"2835f479b0dbf08396f235d6db6f87b273d1200f225bbe2a82e99c86649b2521\": rpc error: code = NotFound desc = could not find container \"2835f479b0dbf08396f235d6db6f87b273d1200f225bbe2a82e99c86649b2521\": container with ID starting with 2835f479b0dbf08396f235d6db6f87b273d1200f225bbe2a82e99c86649b2521 not found: ID does not exist" Sep 07 16:36:40.009546 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:40.009497 2561 scope.go:117] "RemoveContainer" containerID="bf309883902ad6714d6a043d48308349851da456fee001194f18df7be2cc0b3b" Sep 07 16:36:40.009757 ip-10-0-141-30 kubenswrapper[2561]: E0907 16:36:40.009735 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf309883902ad6714d6a043d48308349851da456fee001194f18df7be2cc0b3b\": container with ID starting with bf309883902ad6714d6a043d48308349851da456fee001194f18df7be2cc0b3b not found: ID does not exist" containerID="bf309883902ad6714d6a043d48308349851da456fee001194f18df7be2cc0b3b" Sep 07 16:36:40.009800 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:40.009763 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf309883902ad6714d6a043d48308349851da456fee001194f18df7be2cc0b3b"} err="failed to get container status \"bf309883902ad6714d6a043d48308349851da456fee001194f18df7be2cc0b3b\": rpc error: code = NotFound desc = could not find container \"bf309883902ad6714d6a043d48308349851da456fee001194f18df7be2cc0b3b\": container with ID starting with bf309883902ad6714d6a043d48308349851da456fee001194f18df7be2cc0b3b not found: ID does not exist" Sep 07 16:36:40.009845 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:40.009826 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa9f5f35-bb6f-4af1-b199-87eef7933b50" path="/var/lib/kubelet/pods/aa9f5f35-bb6f-4af1-b199-87eef7933b50/volumes" Sep 07 16:36:41.480424 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:41.480391 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5r8xm_194addcd-6f3a-4312-b306-cd9f1ff5c6fd/node-exporter/0.log" Sep 07 16:36:41.505292 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:41.505271 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5r8xm_194addcd-6f3a-4312-b306-cd9f1ff5c6fd/kube-rbac-proxy/0.log" Sep 07 16:36:41.529548 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:41.529508 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5r8xm_194addcd-6f3a-4312-b306-cd9f1ff5c6fd/init-textfile/0.log" Sep 07 16:36:41.785676 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:41.785588 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b1aaad7-cff2-429e-ab7e-442978938b90/prometheus/0.log" Sep 07 16:36:41.808054 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:41.808021 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b1aaad7-cff2-429e-ab7e-442978938b90/config-reloader/0.log" Sep 07 16:36:41.831369 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:41.831340 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b1aaad7-cff2-429e-ab7e-442978938b90/thanos-sidecar/0.log" Sep 07 16:36:41.855797 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:41.855767 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b1aaad7-cff2-429e-ab7e-442978938b90/kube-rbac-proxy-web/0.log" Sep 07 16:36:41.881033 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:41.881005 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b1aaad7-cff2-429e-ab7e-442978938b90/kube-rbac-proxy/0.log" Sep 07 16:36:41.903305 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:41.903278 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b1aaad7-cff2-429e-ab7e-442978938b90/kube-rbac-proxy-thanos/0.log" Sep 07 16:36:41.928570 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:41.928545 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b1aaad7-cff2-429e-ab7e-442978938b90/init-config-reloader/0.log" Sep 07 16:36:41.954569 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:41.954536 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-hkjvl_1e057836-5665-41b9-99ca-a0307af1dfaa/prometheus-operator/0.log" Sep 07 16:36:41.974169 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:41.974142 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-hkjvl_1e057836-5665-41b9-99ca-a0307af1dfaa/kube-rbac-proxy/0.log" Sep 07 16:36:44.915107 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:44.915066 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8"] Sep 07 16:36:44.915518 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:44.915337 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa9f5f35-bb6f-4af1-b199-87eef7933b50" containerName="gather" Sep 07 16:36:44.915518 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:44.915348 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa9f5f35-bb6f-4af1-b199-87eef7933b50" containerName="gather" Sep 07 16:36:44.915518 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:44.915358 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa9f5f35-bb6f-4af1-b199-87eef7933b50" containerName="copy" Sep 07 16:36:44.915518 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:44.915363 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa9f5f35-bb6f-4af1-b199-87eef7933b50" containerName="copy" Sep 07 16:36:44.915518 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:44.915411 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa9f5f35-bb6f-4af1-b199-87eef7933b50" containerName="copy" Sep 07 16:36:44.915518 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:44.915423 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa9f5f35-bb6f-4af1-b199-87eef7933b50" containerName="gather" Sep 07 16:36:44.920541 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:44.920512 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8" Sep 07 16:36:44.923053 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:44.923026 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dbtf6\"/\"kube-root-ca.crt\"" Sep 07 16:36:44.923778 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:44.923762 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dbtf6\"/\"openshift-service-ca.crt\"" Sep 07 16:36:44.923839 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:44.923761 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dbtf6\"/\"default-dockercfg-tl7zc\"" Sep 07 16:36:44.929659 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:44.929630 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8"] Sep 07 16:36:45.007594 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:45.007557 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/33ef3b48-60d4-4710-8499-d0b0b77f3294-podres\") pod \"perf-node-gather-daemonset-2jbs8\" (UID: \"33ef3b48-60d4-4710-8499-d0b0b77f3294\") " pod="openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8" Sep 07 16:36:45.007814 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:45.007638 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2hsl\" (UniqueName: \"kubernetes.io/projected/33ef3b48-60d4-4710-8499-d0b0b77f3294-kube-api-access-h2hsl\") pod \"perf-node-gather-daemonset-2jbs8\" (UID: \"33ef3b48-60d4-4710-8499-d0b0b77f3294\") " pod="openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8" Sep 07 16:36:45.007814 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:45.007705 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/33ef3b48-60d4-4710-8499-d0b0b77f3294-proc\") pod \"perf-node-gather-daemonset-2jbs8\" (UID: \"33ef3b48-60d4-4710-8499-d0b0b77f3294\") " pod="openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8" Sep 07 16:36:45.007814 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:45.007765 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/33ef3b48-60d4-4710-8499-d0b0b77f3294-lib-modules\") pod \"perf-node-gather-daemonset-2jbs8\" (UID: \"33ef3b48-60d4-4710-8499-d0b0b77f3294\") " pod="openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8" Sep 07 16:36:45.007814 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:45.007793 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33ef3b48-60d4-4710-8499-d0b0b77f3294-sys\") pod \"perf-node-gather-daemonset-2jbs8\" (UID: \"33ef3b48-60d4-4710-8499-d0b0b77f3294\") " pod="openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8" Sep 07 16:36:45.108372 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:45.108331 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/33ef3b48-60d4-4710-8499-d0b0b77f3294-lib-modules\") pod \"perf-node-gather-daemonset-2jbs8\" (UID: \"33ef3b48-60d4-4710-8499-d0b0b77f3294\") " pod="openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8" Sep 07 16:36:45.108372 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:45.108377 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33ef3b48-60d4-4710-8499-d0b0b77f3294-sys\") pod \"perf-node-gather-daemonset-2jbs8\" (UID: \"33ef3b48-60d4-4710-8499-d0b0b77f3294\") " pod="openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8" Sep 07 16:36:45.108643 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:45.108481 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/33ef3b48-60d4-4710-8499-d0b0b77f3294-podres\") pod \"perf-node-gather-daemonset-2jbs8\" (UID: \"33ef3b48-60d4-4710-8499-d0b0b77f3294\") " pod="openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8" Sep 07 16:36:45.108643 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:45.108519 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2hsl\" (UniqueName: \"kubernetes.io/projected/33ef3b48-60d4-4710-8499-d0b0b77f3294-kube-api-access-h2hsl\") pod \"perf-node-gather-daemonset-2jbs8\" (UID: \"33ef3b48-60d4-4710-8499-d0b0b77f3294\") " pod="openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8" Sep 07 16:36:45.108643 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:45.108553 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/33ef3b48-60d4-4710-8499-d0b0b77f3294-proc\") pod \"perf-node-gather-daemonset-2jbs8\" (UID: \"33ef3b48-60d4-4710-8499-d0b0b77f3294\") " pod="openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8" Sep 07 16:36:45.108643 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:45.108549 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/33ef3b48-60d4-4710-8499-d0b0b77f3294-lib-modules\") pod \"perf-node-gather-daemonset-2jbs8\" (UID: \"33ef3b48-60d4-4710-8499-d0b0b77f3294\") " pod="openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8" Sep 07 16:36:45.108643 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:45.108603 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33ef3b48-60d4-4710-8499-d0b0b77f3294-sys\") pod \"perf-node-gather-daemonset-2jbs8\" (UID: \"33ef3b48-60d4-4710-8499-d0b0b77f3294\") " pod="openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8" Sep 07 16:36:45.108936 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:45.108656 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/33ef3b48-60d4-4710-8499-d0b0b77f3294-proc\") pod \"perf-node-gather-daemonset-2jbs8\" (UID: \"33ef3b48-60d4-4710-8499-d0b0b77f3294\") " pod="openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8" Sep 07 16:36:45.108936 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:45.108656 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/33ef3b48-60d4-4710-8499-d0b0b77f3294-podres\") pod \"perf-node-gather-daemonset-2jbs8\" (UID: \"33ef3b48-60d4-4710-8499-d0b0b77f3294\") " pod="openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8" Sep 07 16:36:45.116174 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:45.116140 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2hsl\" (UniqueName: \"kubernetes.io/projected/33ef3b48-60d4-4710-8499-d0b0b77f3294-kube-api-access-h2hsl\") pod \"perf-node-gather-daemonset-2jbs8\" (UID: \"33ef3b48-60d4-4710-8499-d0b0b77f3294\") " pod="openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8" Sep 07 16:36:45.231566 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:45.231533 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8" Sep 07 16:36:45.505633 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:45.505505 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8"] Sep 07 16:36:45.508401 ip-10-0-141-30 kubenswrapper[2561]: W0907 16:36:45.508368 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod33ef3b48_60d4_4710_8499_d0b0b77f3294.slice/crio-e32a60a7039e788965965ba8af64084def7f156b9276d434ad08bc22b59e3d80 WatchSource:0}: Error finding container e32a60a7039e788965965ba8af64084def7f156b9276d434ad08bc22b59e3d80: Status 404 returned error can't find the container with id e32a60a7039e788965965ba8af64084def7f156b9276d434ad08bc22b59e3d80 Sep 07 16:36:45.721897 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:45.721863 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hg9mt_af773224-6d75-4aef-aaf6-445513ce226f/dns/0.log" Sep 07 16:36:45.740231 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:45.740202 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hg9mt_af773224-6d75-4aef-aaf6-445513ce226f/kube-rbac-proxy/0.log" Sep 07 16:36:45.804420 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:45.804330 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9hdjp_7536adc5-f824-4a34-ab2f-9505253e1409/dns-node-resolver/0.log" Sep 07 16:36:46.015422 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:46.015380 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8" event={"ID":"33ef3b48-60d4-4710-8499-d0b0b77f3294","Type":"ContainerStarted","Data":"c34e6f49c2c503cac12c528024ad69e160c35dccbf555f646ea87688ba0f4a21"} Sep 07 16:36:46.015885 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:46.015443 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8" event={"ID":"33ef3b48-60d4-4710-8499-d0b0b77f3294","Type":"ContainerStarted","Data":"e32a60a7039e788965965ba8af64084def7f156b9276d434ad08bc22b59e3d80"} Sep 07 16:36:46.015885 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:46.015551 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8" Sep 07 16:36:46.030272 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:46.030215 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8" podStartSLOduration=2.03019633 podStartE2EDuration="2.03019633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 16:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 16:36:46.030181516 +0000 UTC m=+1004.587539053" watchObservedRunningTime="2026-09-07 16:36:46.03019633 +0000 UTC m=+1004.587553843" Sep 07 16:36:46.239152 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:46.239120 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6cbd4dd8-5szcm_442d3ce0-b47d-4e50-9271-aef27cf7b33c/registry/0.log" Sep 07 16:36:46.279670 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:46.279633 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l9j65_81813711-9d30-4e49-88fb-051b60f3061f/node-ca/0.log" Sep 07 16:36:47.234404 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:47.234373 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-54jsp_e50c82f0-242a-44e6-8f95-b99991f6a6fa/serve-healthcheck-canary/0.log" Sep 07 16:36:47.604506 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:47.604422 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6v52m_d4b52d58-79e7-48ce-bcaa-cdc38323e992/kube-rbac-proxy/0.log" Sep 07 16:36:47.622520 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:47.622492 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6v52m_d4b52d58-79e7-48ce-bcaa-cdc38323e992/exporter/0.log" Sep 07 16:36:47.641716 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:47.641687 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6v52m_d4b52d58-79e7-48ce-bcaa-cdc38323e992/extractor/0.log" Sep 07 16:36:52.029761 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:52.029725 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dbtf6/perf-node-gather-daemonset-2jbs8" Sep 07 16:36:53.676991 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:53.676959 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g68wd_5747be07-7029-4273-a7e3-8024ddaedc17/kube-multus-additional-cni-plugins/0.log" Sep 07 16:36:53.701901 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:53.701866 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g68wd_5747be07-7029-4273-a7e3-8024ddaedc17/egress-router-binary-copy/0.log" Sep 07 16:36:53.725482 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:53.725441 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g68wd_5747be07-7029-4273-a7e3-8024ddaedc17/cni-plugins/0.log" Sep 07 16:36:53.746084 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:53.746049 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g68wd_5747be07-7029-4273-a7e3-8024ddaedc17/bond-cni-plugin/0.log" Sep 07 16:36:53.766580 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:53.766546 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g68wd_5747be07-7029-4273-a7e3-8024ddaedc17/routeoverride-cni/0.log" Sep 07 16:36:53.790052 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:53.790022 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g68wd_5747be07-7029-4273-a7e3-8024ddaedc17/whereabouts-cni-bincopy/0.log" Sep 07 16:36:53.812038 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:53.812003 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g68wd_5747be07-7029-4273-a7e3-8024ddaedc17/whereabouts-cni/0.log" Sep 07 16:36:53.869212 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:53.869126 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jbxz9_75bdb20d-73ea-4cf8-b12a-643fc1b7f0fe/kube-multus/0.log" Sep 07 16:36:53.923964 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:53.923934 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-87hv9_ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc/network-metrics-daemon/0.log" Sep 07 16:36:53.947748 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:53.947724 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-87hv9_ab4d0800-7e1c-4f30-9e9c-b8bee24cc9dc/kube-rbac-proxy/0.log" Sep 07 16:36:54.806375 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:54.806342 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f72gx_279b7732-ff48-482d-b216-0167445c26ab/ovn-controller/0.log" Sep 07 16:36:54.823515 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:54.823487 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f72gx_279b7732-ff48-482d-b216-0167445c26ab/ovn-acl-logging/1.log" Sep 07 16:36:54.823714 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:54.823592 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f72gx_279b7732-ff48-482d-b216-0167445c26ab/ovn-acl-logging/0.log" Sep 07 16:36:54.844784 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:54.844700 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f72gx_279b7732-ff48-482d-b216-0167445c26ab/kube-rbac-proxy-node/0.log" Sep 07 16:36:54.865872 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:54.865841 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f72gx_279b7732-ff48-482d-b216-0167445c26ab/kube-rbac-proxy-ovn-metrics/0.log" Sep 07 16:36:54.880169 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:54.880136 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f72gx_279b7732-ff48-482d-b216-0167445c26ab/northd/0.log" Sep 07 16:36:54.899335 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:54.899307 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f72gx_279b7732-ff48-482d-b216-0167445c26ab/nbdb/0.log" Sep 07 16:36:54.920076 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:54.920032 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f72gx_279b7732-ff48-482d-b216-0167445c26ab/sbdb/0.log" Sep 07 16:36:54.952644 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:54.952595 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f72gx_279b7732-ff48-482d-b216-0167445c26ab/ovnkube-controller/0.log" Sep 07 16:36:56.299164 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:56.299135 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-8fkc9_f565ccb2-4d11-476a-bda4-8e203cf7be65/network-check-target-container/0.log" Sep 07 16:36:57.157291 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:57.157260 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-kjfgl_1e9d4b4f-193a-4824-b5b1-4f53e01ddfbe/iptables-alerter/0.log" Sep 07 16:36:57.762902 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:36:57.762870 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-2rrvq_64bb7a70-195f-4d59-aa6b-7fcb7a59a446/tuned/0.log" Sep 07 16:37:00.687754 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:37:00.687718 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-75d99c484-4nrmz_e4d65bed-a47e-4fc6-acd0-a71338a8dcb4/service-ca-controller/0.log" Sep 07 16:37:01.010556 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:37:01.010517 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-68d8g_87a64fe5-87f1-443a-9958-70142ebd8a03/csi-driver/0.log" Sep 07 16:37:01.029986 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:37:01.029961 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-68d8g_87a64fe5-87f1-443a-9958-70142ebd8a03/csi-node-driver-registrar/0.log" Sep 07 16:37:01.052365 ip-10-0-141-30 kubenswrapper[2561]: I0907 16:37:01.052334 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-68d8g_87a64fe5-87f1-443a-9958-70142ebd8a03/csi-liveness-probe/0.log"