W0417 18:40:04.186214 1 cmd.go:257] Using insecure, self-signed certificates I0417 18:40:04.533684 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0417 18:40:04.534019 1 observer_polling.go:159] Starting file observer I0417 18:40:05.025681 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0417 18:40:05.025955 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0417 18:40:05.026709 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0417 18:40:05.026919 1 secure_serving.go:57] Forcing use of http/1.1 only W0417 18:40:05.026946 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0417 18:40:05.026956 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0417 18:40:05.026962 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0417 18:40:05.026966 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0417 18:40:05.026969 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0417 18:40:05.026973 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0417 18:40:05.037939 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0417 18:40:05.038009 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"e75b09bf-ee33-4760-a8d8-075997b8af25", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0417 18:40:05.041777 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0417 18:40:05.041800 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0417 18:40:05.041856 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0417 18:40:05.041866 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0417 18:40:05.041879 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0417 18:40:05.041883 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0417 18:40:05.042152 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-4140577865/tls.crt::/tmp/serving-cert-4140577865/tls.key" I0417 18:40:05.042464 1 secure_serving.go:213] Serving securely on [::]:8443 I0417 18:40:05.042494 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0417 18:40:05.058825 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0417 18:40:05.058862 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0417 18:40:05.059013 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0417 18:40:05.076194 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0417 18:40:05.076227 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0417 18:40:05.084170 1 secretconfigobserver.go:119] support secret does not exist I0417 18:40:05.092536 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0417 18:40:05.099984 1 secretconfigobserver.go:119] support secret does not exist I0417 18:40:05.101244 1 recorder.go:176] Pruning old reports every 4h59m45s, max age is 288h0m0s I0417 18:40:05.106832 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0417 18:40:05.106852 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0417 18:40:05.106834 1 periodic.go:216] Running clusterconfig gatherer I0417 18:40:05.106891 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0417 18:40:05.106897 1 tasks_processing.go:45] number of workers: 64 I0417 18:40:05.106903 1 insightsreport.go:296] Starting report retriever I0417 18:40:05.106911 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0417 18:40:05.106923 1 tasks_processing.go:69] worker 12 listening for tasks. I0417 18:40:05.106926 1 tasks_processing.go:69] worker 8 listening for tasks. I0417 18:40:05.106926 1 tasks_processing.go:69] worker 3 listening for tasks. I0417 18:40:05.106929 1 tasks_processing.go:69] worker 9 listening for tasks. I0417 18:40:05.106934 1 tasks_processing.go:69] worker 10 listening for tasks. I0417 18:40:05.106936 1 tasks_processing.go:69] worker 0 listening for tasks. I0417 18:40:05.106943 1 tasks_processing.go:69] worker 1 listening for tasks. I0417 18:40:05.106951 1 tasks_processing.go:69] worker 6 listening for tasks. I0417 18:40:05.106953 1 tasks_processing.go:71] worker 1 working on ceph_cluster task. I0417 18:40:05.106955 1 tasks_processing.go:69] worker 2 listening for tasks. I0417 18:40:05.106957 1 tasks_processing.go:71] worker 6 working on aggregated_monitoring_cr_names task. I0417 18:40:05.106959 1 tasks_processing.go:69] worker 5 listening for tasks. I0417 18:40:05.106960 1 tasks_processing.go:69] worker 4 listening for tasks. I0417 18:40:05.106961 1 tasks_processing.go:69] worker 11 listening for tasks. I0417 18:40:05.106971 1 tasks_processing.go:69] worker 55 listening for tasks. I0417 18:40:05.106965 1 tasks_processing.go:69] worker 41 listening for tasks. I0417 18:40:05.106979 1 tasks_processing.go:69] worker 48 listening for tasks. I0417 18:40:05.106972 1 tasks_processing.go:69] worker 13 listening for tasks. I0417 18:40:05.106978 1 tasks_processing.go:69] worker 7 listening for tasks. I0417 18:40:05.106988 1 tasks_processing.go:69] worker 45 listening for tasks. I0417 18:40:05.106973 1 tasks_processing.go:69] worker 62 listening for tasks. I0417 18:40:05.106988 1 tasks_processing.go:69] worker 15 listening for tasks. I0417 18:40:05.106998 1 tasks_processing.go:69] worker 46 listening for tasks. I0417 18:40:05.106981 1 tasks_processing.go:69] worker 56 listening for tasks. I0417 18:40:05.106986 1 tasks_processing.go:69] worker 49 listening for tasks. I0417 18:40:05.107007 1 tasks_processing.go:69] worker 59 listening for tasks. I0417 18:40:05.107009 1 tasks_processing.go:69] worker 35 listening for tasks. I0417 18:40:05.107007 1 tasks_processing.go:69] worker 42 listening for tasks. I0417 18:40:05.107016 1 tasks_processing.go:69] worker 53 listening for tasks. I0417 18:40:05.107018 1 tasks_processing.go:69] worker 47 listening for tasks. I0417 18:40:05.107022 1 tasks_processing.go:69] worker 37 listening for tasks. I0417 18:40:05.107007 1 tasks_processing.go:69] worker 30 listening for tasks. I0417 18:40:05.107026 1 tasks_processing.go:69] worker 54 listening for tasks. I0417 18:40:05.107029 1 tasks_processing.go:69] worker 16 listening for tasks. I0417 18:40:05.107032 1 tasks_processing.go:69] worker 40 listening for tasks. I0417 18:40:05.107034 1 tasks_processing.go:69] worker 38 listening for tasks. I0417 18:40:05.107038 1 tasks_processing.go:71] worker 3 working on machine_autoscalers task. I0417 18:40:05.107039 1 tasks_processing.go:69] worker 17 listening for tasks. I0417 18:40:05.107042 1 tasks_processing.go:69] worker 26 listening for tasks. I0417 18:40:05.107045 1 tasks_processing.go:69] worker 27 listening for tasks. I0417 18:40:05.107046 1 tasks_processing.go:69] worker 34 listening for tasks. I0417 18:40:05.107049 1 tasks_processing.go:69] worker 18 listening for tasks. I0417 18:40:05.107050 1 tasks_processing.go:69] worker 20 listening for tasks. I0417 18:40:05.107054 1 tasks_processing.go:71] worker 0 working on infrastructures task. I0417 18:40:05.107048 1 tasks_processing.go:69] worker 39 listening for tasks. I0417 18:40:05.107060 1 tasks_processing.go:69] worker 63 listening for tasks. I0417 18:40:05.107053 1 tasks_processing.go:71] worker 8 working on openshift_machine_api_events task. I0417 18:40:05.107074 1 tasks_processing.go:69] worker 24 listening for tasks. I0417 18:40:05.107028 1 tasks_processing.go:69] worker 60 listening for tasks. I0417 18:40:05.106997 1 tasks_processing.go:69] worker 29 listening for tasks. I0417 18:40:05.106996 1 tasks_processing.go:69] worker 44 listening for tasks. I0417 18:40:05.106980 1 tasks_processing.go:69] worker 14 listening for tasks. I0417 18:40:05.107000 1 tasks_processing.go:69] worker 58 listening for tasks. I0417 18:40:05.107002 1 tasks_processing.go:69] worker 51 listening for tasks. I0417 18:40:05.106991 1 tasks_processing.go:69] worker 57 listening for tasks. I0417 18:40:05.107010 1 tasks_processing.go:69] worker 52 listening for tasks. I0417 18:40:05.107015 1 tasks_processing.go:69] worker 36 listening for tasks. I0417 18:40:05.107132 1 tasks_processing.go:71] worker 4 working on install_plans task. I0417 18:40:05.107135 1 tasks_processing.go:71] worker 11 working on networks task. I0417 18:40:05.107137 1 tasks_processing.go:71] worker 16 working on dvo_metrics task. I0417 18:40:05.107021 1 tasks_processing.go:69] worker 31 listening for tasks. I0417 18:40:05.107143 1 tasks_processing.go:71] worker 38 working on image_pruners task. I0417 18:40:05.107146 1 tasks_processing.go:71] worker 31 working on pdbs task. I0417 18:40:05.107019 1 tasks_processing.go:69] worker 61 listening for tasks. I0417 18:40:05.107192 1 tasks_processing.go:71] worker 17 working on monitoring_persistent_volumes task. I0417 18:40:05.107025 1 tasks_processing.go:69] worker 43 listening for tasks. I0417 18:40:05.107201 1 tasks_processing.go:71] worker 14 working on crds task. I0417 18:40:05.107203 1 tasks_processing.go:71] worker 58 working on service_accounts task. I0417 18:40:05.106992 1 tasks_processing.go:69] worker 50 listening for tasks. I0417 18:40:05.107029 1 tasks_processing.go:69] worker 22 listening for tasks. I0417 18:40:05.107035 1 tasks_processing.go:69] worker 25 listening for tasks. I0417 18:40:05.107250 1 tasks_processing.go:71] worker 5 working on cost_management_metrics_configs task. I0417 18:40:05.107259 1 tasks_processing.go:71] worker 34 working on image task. I0417 18:40:05.107266 1 tasks_processing.go:71] worker 43 working on storage_classes task. I0417 18:40:05.107276 1 tasks_processing.go:71] worker 29 working on tsdb_status task. I0417 18:40:05.107314 1 tasks_processing.go:71] worker 44 working on nodenetworkstates task. I0417 18:40:05.107364 1 tasks_processing.go:71] worker 30 working on metrics task. I0417 18:40:05.107036 1 tasks_processing.go:69] worker 33 listening for tasks. I0417 18:40:05.107040 1 tasks_processing.go:71] worker 10 working on qemu_kubevirt_launcher_logs task. I0417 18:40:05.107450 1 tasks_processing.go:71] worker 33 working on nodenetworkconfigurationpolicies task. I0417 18:40:05.107462 1 tasks_processing.go:71] worker 22 working on openshift_logging task. I0417 18:40:05.107509 1 tasks_processing.go:71] worker 50 working on ingress task. I0417 18:40:05.107515 1 tasks_processing.go:71] worker 25 working on node_features task. I0417 18:40:05.107311 1 tasks_processing.go:71] worker 55 working on machine_healthchecks task. W0417 18:40:05.107449 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0417 18:40:05.107045 1 tasks_processing.go:69] worker 23 listening for tasks. I0417 18:40:05.107669 1 tasks_processing.go:71] worker 30 working on authentication task. I0417 18:40:05.107054 1 tasks_processing.go:71] worker 12 working on container_images task. I0417 18:40:05.107676 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 267.391µs to process 0 records I0417 18:40:05.107725 1 tasks_processing.go:71] worker 23 working on silenced_alerts task. W0417 18:40:05.107756 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0417 18:40:05.107053 1 tasks_processing.go:69] worker 19 listening for tasks. I0417 18:40:05.107055 1 tasks_processing.go:69] worker 21 listening for tasks. I0417 18:40:05.107129 1 tasks_processing.go:71] worker 41 working on nodes task. I0417 18:40:05.107782 1 tasks_processing.go:71] worker 21 working on validating_webhook_configurations task. I0417 18:40:05.107779 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 28.71µs to process 0 records I0417 18:40:05.107136 1 tasks_processing.go:71] worker 52 working on node_logs task. I0417 18:40:05.107137 1 tasks_processing.go:71] worker 36 working on clusterroles task. I0417 18:40:05.107140 1 tasks_processing.go:71] worker 40 working on ingress_certificates task. I0417 18:40:05.107188 1 tasks_processing.go:71] worker 63 working on openstack_version task. I0417 18:40:05.107196 1 tasks_processing.go:71] worker 61 working on machine_configs task. I0417 18:40:05.107198 1 tasks_processing.go:71] worker 24 working on proxies task. I0417 18:40:05.107243 1 tasks_processing.go:71] worker 2 working on container_runtime_configs task. W0417 18:40:05.107314 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0417 18:40:05.107324 1 tasks_processing.go:71] worker 49 working on oauths task. I0417 18:40:05.108170 1 tasks_processing.go:71] worker 39 working on machines task. I0417 18:40:05.107327 1 tasks_processing.go:71] worker 26 working on overlapping_namespace_uids task. I0417 18:40:05.107328 1 tasks_processing.go:71] worker 48 working on pod_network_connectivity_checks task. I0417 18:40:05.108439 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 838.862µs to process 0 records I0417 18:40:05.107334 1 tasks_processing.go:71] worker 62 working on openstack_controlplanes task. I0417 18:40:05.107336 1 tasks_processing.go:71] worker 15 working on lokistack task. I0417 18:40:05.107339 1 tasks_processing.go:71] worker 13 working on machine_sets task. I0417 18:40:05.107340 1 tasks_processing.go:71] worker 46 working on mutating_webhook_configurations task. I0417 18:40:05.107012 1 tasks_processing.go:69] worker 28 listening for tasks. I0417 18:40:05.107344 1 tasks_processing.go:71] worker 7 working on sap_config task. I0417 18:40:05.108591 1 tasks_processing.go:71] worker 28 working on operators_pods_and_events task. I0417 18:40:05.107344 1 tasks_processing.go:71] worker 56 working on cluster_apiserver task. I0417 18:40:05.107342 1 tasks_processing.go:71] worker 60 working on support_secret task. I0417 18:40:05.107349 1 tasks_processing.go:71] worker 45 working on openstack_dataplanedeployments task. I0417 18:40:05.107350 1 tasks_processing.go:71] worker 27 working on feature_gates task. I0417 18:40:05.107355 1 tasks_processing.go:71] worker 53 working on sap_datahubs task. I0417 18:40:05.107355 1 tasks_processing.go:71] worker 18 working on sap_pods task. I0417 18:40:05.107357 1 tasks_processing.go:71] worker 37 working on openstack_dataplanenodesets task. I0417 18:40:05.107359 1 tasks_processing.go:71] worker 59 working on image_registries task. I0417 18:40:05.107028 1 tasks_processing.go:69] worker 32 listening for tasks. I0417 18:40:05.109679 1 tasks_processing.go:74] worker 32 stopped. I0417 18:40:05.107360 1 tasks_processing.go:71] worker 47 working on machine_config_pools task. I0417 18:40:05.107362 1 tasks_processing.go:71] worker 35 working on active_alerts task. W0417 18:40:05.109837 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0417 18:40:05.109854 1 tasks_processing.go:74] worker 35 stopped. I0417 18:40:05.109866 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 33.872µs to process 0 records I0417 18:40:05.107363 1 tasks_processing.go:71] worker 42 working on jaegers task. I0417 18:40:05.107367 1 tasks_processing.go:71] worker 51 working on schedulers task. I0417 18:40:05.107369 1 tasks_processing.go:71] worker 54 working on config_maps task. I0417 18:40:05.107369 1 tasks_processing.go:71] worker 57 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0417 18:40:05.107369 1 tasks_processing.go:71] worker 20 working on certificate_signing_requests task. I0417 18:40:05.107045 1 tasks_processing.go:71] worker 9 working on storage_cluster task. I0417 18:40:05.107767 1 tasks_processing.go:71] worker 23 working on operators task. I0417 18:40:05.107776 1 tasks_processing.go:71] worker 19 working on olm_operators task. I0417 18:40:05.108451 1 tasks_processing.go:71] worker 29 working on version task. I0417 18:40:05.114735 1 tasks_processing.go:74] worker 44 stopped. I0417 18:40:05.114749 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 7.359192ms to process 0 records I0417 18:40:05.115588 1 tasks_processing.go:74] worker 1 stopped. I0417 18:40:05.115600 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 8.623527ms to process 0 records I0417 18:40:05.115941 1 tasks_processing.go:74] worker 3 stopped. I0417 18:40:05.115951 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 8.892969ms to process 0 records I0417 18:40:05.116131 1 tasks_processing.go:74] worker 5 stopped. I0417 18:40:05.116140 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 8.869508ms to process 0 records I0417 18:40:05.119805 1 tasks_processing.go:74] worker 0 stopped. I0417 18:40:05.120331 1 recorder.go:75] Recording config/infrastructure with fingerprint=4c4a97e679bb44cff7a8a9273c4b2743f909567f629c7e1961297bb6d8bd8c72 I0417 18:40:05.120347 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 12.737317ms to process 1 records I0417 18:40:05.120436 1 tasks_processing.go:74] worker 38 stopped. I0417 18:40:05.120534 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=a61238d2a0f5718cd4bac0dbb390b10256e0bb2e6cd97360bc13544629086a45 I0417 18:40:05.120544 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 12.736134ms to process 1 records I0417 18:40:05.122764 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0417 18:40:05.122781 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0417 18:40:05.122785 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0417 18:40:05.122788 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0417 18:40:05.122804 1 controller.go:531] The operator is still being initialized I0417 18:40:05.122812 1 controller.go:554] The operator is healthy I0417 18:40:05.127826 1 tasks_processing.go:74] worker 34 stopped. I0417 18:40:05.127912 1 recorder.go:75] Recording config/image with fingerprint=5123899f2e30e46490857fda1ed519e93d28fb7d3ee9a0277f882f503809abdb I0417 18:40:05.127925 1 gather.go:177] gatherer "clusterconfig" function "image" took 20.553225ms to process 1 records I0417 18:40:05.128430 1 tasks_processing.go:74] worker 50 stopped. I0417 18:40:05.128579 1 recorder.go:75] Recording config/ingress with fingerprint=42eac93580f8ab782e6dd4e78bd2e3842c29a694315eba4e8826f2742cd9d2ba I0417 18:40:05.128592 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 20.901808ms to process 1 records I0417 18:40:05.128682 1 tasks_processing.go:74] worker 11 stopped. I0417 18:40:05.128738 1 recorder.go:75] Recording config/network with fingerprint=f7cab76bef68415e5b676d721fc396bd416db5b2c6f74ad06225bc69bb585a5b I0417 18:40:05.128751 1 gather.go:177] gatherer "clusterconfig" function "networks" took 21.362315ms to process 1 records I0417 18:40:05.128823 1 tasks_processing.go:74] worker 31 stopped. I0417 18:40:05.128904 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=327e050a9d53c525dcadb404de38f15781411432e122d0a4ab693a082a69b46b I0417 18:40:05.128923 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=086af7c1421d4ea3c7e505d43b34f2f79a1e4fa86f5b7cfa11ccca9e3a935f4c I0417 18:40:05.128939 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=984f10b5ff17cffedf9854f47ece6b7a11775eb6539df4e85494e08dae3192cd I0417 18:40:05.128946 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 21.665536ms to process 3 records I0417 18:40:05.141924 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0417 18:40:05.141939 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 34.855528ms to process 0 records I0417 18:40:05.141948 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 34.471517ms to process 0 records I0417 18:40:05.141930 1 tasks_processing.go:74] worker 8 stopped. I0417 18:40:05.141954 1 tasks_processing.go:74] worker 33 stopped. E0417 18:40:05.141952 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0417 18:40:05.141964 1 tasks_processing.go:74] worker 25 stopped. I0417 18:40:05.141963 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0417 18:40:05.141974 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 34.437613ms to process 0 records I0417 18:40:05.141979 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0417 18:40:05.141984 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 34.104232ms to process 0 records I0417 18:40:05.141992 1 tasks_processing.go:74] worker 63 stopped. I0417 18:40:05.142180 1 tasks_processing.go:74] worker 55 stopped. E0417 18:40:05.142194 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0417 18:40:05.142202 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 34.553589ms to process 0 records I0417 18:40:05.146592 1 tasks_processing.go:74] worker 48 stopped. E0417 18:40:05.146607 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0417 18:40:05.146618 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 38.143826ms to process 0 records I0417 18:40:05.146722 1 tasks_processing.go:74] worker 45 stopped. I0417 18:40:05.146735 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 38.003289ms to process 0 records I0417 18:40:05.146745 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 39.258452ms to process 0 records I0417 18:40:05.146751 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 37.92048ms to process 0 records I0417 18:40:05.146755 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 38.227425ms to process 0 records I0417 18:40:05.146759 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 38.197161ms to process 0 records I0417 18:40:05.146762 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 38.285458ms to process 0 records I0417 18:40:05.146768 1 tasks_processing.go:74] worker 62 stopped. I0417 18:40:05.146772 1 tasks_processing.go:74] worker 22 stopped. I0417 18:40:05.146776 1 tasks_processing.go:74] worker 53 stopped. I0417 18:40:05.146779 1 tasks_processing.go:74] worker 15 stopped. I0417 18:40:05.146787 1 tasks_processing.go:74] worker 13 stopped. I0417 18:40:05.146830 1 tasks_processing.go:74] worker 2 stopped. I0417 18:40:05.146840 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 38.751495ms to process 0 records I0417 18:40:05.146857 1 tasks_processing.go:74] worker 24 stopped. I0417 18:40:05.146949 1 recorder.go:75] Recording config/proxy with fingerprint=00ecfbcf865f87bbe1080f6577e560d3d93f702ab6ac92736f89583d6bd9c961 I0417 18:40:05.146968 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 38.809697ms to process 1 records E0417 18:40:05.146979 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0417 18:40:05.146989 1 gather.go:177] gatherer "clusterconfig" function "machines" took 38.692989ms to process 0 records I0417 18:40:05.146997 1 tasks_processing.go:74] worker 39 stopped. I0417 18:40:05.147089 1 tasks_processing.go:74] worker 9 stopped. I0417 18:40:05.147096 1 gather_logs.go:145] no pods in namespace were found I0417 18:40:05.147107 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 36.723281ms to process 0 records I0417 18:40:05.147127 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 39.683074ms to process 0 records I0417 18:40:05.147137 1 tasks_processing.go:74] worker 10 stopped. I0417 18:40:05.147353 1 tasks_processing.go:74] worker 49 stopped. I0417 18:40:05.147575 1 recorder.go:75] Recording config/oauth with fingerprint=a6da43fa9d0cf8837ba934f547379cf2a939fccf48d1f4e83e0b7f8eb1029407 I0417 18:40:05.147590 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 39.215461ms to process 1 records I0417 18:40:05.159715 1 base_controller.go:82] Caches are synced for ConfigController I0417 18:40:05.159727 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0417 18:40:05.178017 1 tasks_processing.go:74] worker 7 stopped. I0417 18:40:05.178038 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 69.413312ms to process 0 records I0417 18:40:05.178049 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 68.950788ms to process 0 records I0417 18:40:05.178055 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 68.661004ms to process 0 records I0417 18:40:05.178062 1 tasks_processing.go:74] worker 37 stopped. I0417 18:40:05.178066 1 tasks_processing.go:74] worker 18 stopped. I0417 18:40:05.178103 1 tasks_processing.go:74] worker 47 stopped. I0417 18:40:05.178115 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 68.394249ms to process 0 records I0417 18:40:05.178139 1 tasks_processing.go:74] worker 42 stopped. I0417 18:40:05.178153 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 68.256591ms to process 0 records I0417 18:40:05.178272 1 tasks_processing.go:74] worker 30 stopped. I0417 18:40:05.178479 1 recorder.go:75] Recording config/authentication with fingerprint=faa809e3a5c05ba4164557e775901123304e6b495cf2f8d56f96cc4ad7c58a24 I0417 18:40:05.178497 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 70.592927ms to process 1 records I0417 18:40:05.178508 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 71.211733ms to process 0 records I0417 18:40:05.178514 1 tasks_processing.go:74] worker 17 stopped. I0417 18:40:05.180619 1 tasks_processing.go:74] worker 52 stopped. I0417 18:40:05.180637 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 72.808963ms to process 0 records I0417 18:40:05.180865 1 tasks_processing.go:74] worker 56 stopped. I0417 18:40:05.181000 1 recorder.go:75] Recording config/apiserver with fingerprint=b838c87152dce835fe05e3e6b32e1ba210baaee9ae50fe4d9d41b7354add132f I0417 18:40:05.181014 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 72.186759ms to process 1 records I0417 18:40:05.181357 1 tasks_processing.go:74] worker 61 stopped. E0417 18:40:05.181367 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0417 18:40:05.181398 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0417 18:40:05.181417 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 73.384167ms to process 1 records I0417 18:40:05.181545 1 tasks_processing.go:74] worker 21 stopped. I0417 18:40:05.182290 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=ef2efa4a423f312ba9a87e4062e31c31a2760dc3411228ef9fd92c27c939c687 I0417 18:40:05.182748 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=e53687caaecb31289e3072e33950eac2b92620fedb58fb291415a1a35f929850 I0417 18:40:05.182866 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=9aa04f889d9505d07195cb5506a11d789e6e65d729e38501c6d7774ca03fbcb5 I0417 18:40:05.182928 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=9fc48824d016c16374b3953c1a17fe252e10175c4a8eb216121852a256316ce3 I0417 18:40:05.183038 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=6a3f6b7b135538f842f4d136e5368d293d055a4f8913f2a50ee818e11d7b7965 I0417 18:40:05.183095 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=cb2ebd933d6b9b156e4164b5d866b49c191ca02bfe203103ed73377f410ec4d8 I0417 18:40:05.183156 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=461aefa61135fa07149ee65f81643809adb462db14ee90e5f020127413298d09 I0417 18:40:05.183230 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=d680a653018f7cb7faaf9ed9a15cfd45f8a510e84167ec0faf1b7e5c341973ba I0417 18:40:05.183349 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=22336274a4c5e7adfd4f26620b482d089c81fbd5a76fed7927eb7811bb42d083 I0417 18:40:05.183536 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=43b5db9243eca20749117b3c2151ce4467566f14d6b89fa3b7db4732d1428a72 I0417 18:40:05.183960 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=168afbb43035d699ea4ffb3ecd5d92e86bf69ece45ced7e61a19e8cc2ba18911 I0417 18:40:05.183980 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 73.755822ms to process 11 records E0417 18:40:05.184000 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0417 18:40:05.184007 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 72.956644ms to process 0 records I0417 18:40:05.184072 1 tasks_processing.go:74] worker 60 stopped. I0417 18:40:05.184150 1 tasks_processing.go:74] worker 41 stopped. I0417 18:40:05.184317 1 recorder.go:75] Recording config/node/ip-10-0-0-216.ec2.internal with fingerprint=ccc25a5ac74fb2d6ad43040c97abe7aa8279e8a2160704abfb0257eb3811010c I0417 18:40:05.184385 1 recorder.go:75] Recording config/node/ip-10-0-1-68.ec2.internal with fingerprint=cf15541464247e661f2a5b2007dcdceb7e10486362f0cc0a0b0390b17ab6f6f2 I0417 18:40:05.184443 1 recorder.go:75] Recording config/node/ip-10-0-2-177.ec2.internal with fingerprint=fcb282a5d709758cace3f10b75bc2b5d0af82258187b5fa6a26859922dda0354 I0417 18:40:05.184452 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 74.665449ms to process 3 records I0417 18:40:05.184541 1 tasks_processing.go:74] worker 26 stopped. I0417 18:40:05.184575 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0417 18:40:05.184596 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 76.333351ms to process 1 records I0417 18:40:05.187727 1 tasks_processing.go:74] worker 46 stopped. I0417 18:40:05.187883 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=7a33fcdc8855329af737665d2a1af03b6e5f0d93899e391b2f58990809b5d937 I0417 18:40:05.187923 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=59592a77b455fb8d91c098d6adfde6e0c34eef3026395dea638a6c52cfc07f67 I0417 18:40:05.187947 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=2894dad8365d83ed5c046e00f193c2d76fe77b67efd49fd0c79917dfa9e4e7cf I0417 18:40:05.187955 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 79.151543ms to process 3 records W0417 18:40:05.188684 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0417 18:40:05.198607 1 tasks_processing.go:74] worker 27 stopped. I0417 18:40:05.198743 1 recorder.go:75] Recording config/featuregate with fingerprint=9ffb4ef954125996f84aab590b24b84df463c42908c9ea774bbd5ffeb1222a32 I0417 18:40:05.198757 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 89.806507ms to process 1 records I0417 18:40:05.200559 1 tasks_processing.go:74] worker 43 stopped. I0417 18:40:05.200646 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=92f4f0dafdd7ce61522ca34f73d1b716464c288a33880eaa61997381ac21b953 I0417 18:40:05.200662 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=bd159552668aa27859e2462858d8a357765c29b1b906f9a7ed90a9d4e2d1b3ba I0417 18:40:05.200669 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 93.274376ms to process 2 records I0417 18:40:05.209816 1 tasks_processing.go:74] worker 59 stopped. I0417 18:40:05.210197 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=c4e55b5da45715de6826ae5a30fe4ebc02edd1eefb43cfc52ed049997df537f4 I0417 18:40:05.210211 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 100.269407ms to process 1 records I0417 18:40:05.210265 1 recorder.go:75] Recording config/running_containers with fingerprint=03397779f1e79e0a7c622059adcf00d70176cd449ca973600749d92ef199a26c I0417 18:40:05.210273 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 102.463311ms to process 1 records I0417 18:40:05.210279 1 tasks_processing.go:74] worker 12 stopped. I0417 18:40:05.214751 1 tasks_processing.go:74] worker 51 stopped. I0417 18:40:05.214816 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=304b2d255b14c922f8b81d6c8299c502a296c98a8cac40bb7e7be6c6ec99de15 I0417 18:40:05.214829 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 104.750322ms to process 1 records I0417 18:40:05.214888 1 tasks_processing.go:74] worker 14 stopped. I0417 18:40:05.215081 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0417 18:40:05.215105 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0417 18:40:05.215232 1 operator.go:328] started I0417 18:40:05.215253 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0417 18:40:05.215455 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=61c107934b59e69f9bfa8230e124436f4751674c08af690c8bc4ac0451e46d08 I0417 18:40:05.215658 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=cc2e8b4f3b0226088d0baa1cda677e1b5a99ba430e83ad14dbea27bb0bc2e5fb I0417 18:40:05.215667 1 gather.go:177] gatherer "clusterconfig" function "crds" took 107.672996ms to process 2 records I0417 18:40:05.215856 1 configmapobserver.go:84] configmaps "insights-config" not found I0417 18:40:05.216236 1 tasks_processing.go:74] worker 57 stopped. I0417 18:40:05.216251 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 105.993595ms to process 0 records I0417 18:40:05.217062 1 tasks_processing.go:74] worker 36 stopped. I0417 18:40:05.217259 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=7ba70d7ffc9c4ff21c212a21e747924cae66f0aa248998bf79d306f6f4190f18 I0417 18:40:05.217342 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=1f373e0075f81c915a670f94ec8e136a6f7a1e51fc68551b5ebd44f05d187bff I0417 18:40:05.217351 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 109.228197ms to process 2 records I0417 18:40:05.217357 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 106.618042ms to process 0 records I0417 18:40:05.217364 1 tasks_processing.go:74] worker 19 stopped. I0417 18:40:05.218337 1 tasks_processing.go:74] worker 6 stopped. I0417 18:40:05.218357 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 111.364425ms to process 0 records I0417 18:40:05.218660 1 tasks_processing.go:74] worker 20 stopped. I0417 18:40:05.218672 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 108.384418ms to process 0 records I0417 18:40:05.234043 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0417 18:40:05.234060 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0417 18:40:05.234065 1 controller.go:254] Source scaController *sca.Controller is not ready I0417 18:40:05.234068 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0417 18:40:05.234071 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0417 18:40:05.234088 1 controller.go:531] The operator is still being initialized I0417 18:40:05.234094 1 controller.go:554] The operator is healthy I0417 18:40:05.236765 1 prometheus_rules.go:88] Prometheus rules successfully created E0417 18:40:05.238731 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%272c9c1877-c703-48cd-a66a-5bc683f3d846%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:49537->172.30.0.10:53: read: connection refused I0417 18:40:05.238745 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%272c9c1877-c703-48cd-a66a-5bc683f3d846%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:49537->172.30.0.10:53: read: connection refused I0417 18:40:05.246921 1 tasks_processing.go:74] worker 29 stopped. I0417 18:40:05.247179 1 recorder.go:75] Recording config/version with fingerprint=d05f8401dc00bb6de6b9bb21364d7e32642c3962d73e465def6876c2345102df I0417 18:40:05.247191 1 recorder.go:75] Recording config/id with fingerprint=3043f62a22c6cc9490fce4299d1a2789917b1e05b3d14f84a9eaf5bcc6112002 I0417 18:40:05.247198 1 gather.go:177] gatherer "clusterconfig" function "version" took 136.359055ms to process 2 records I0417 18:40:05.259958 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0417 18:40:05.263971 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:42213->172.30.0.10:53: read: connection refused I0417 18:40:05.263987 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:42213->172.30.0.10:53: read: connection refused I0417 18:40:05.266847 1 tasks_processing.go:74] worker 54 stopped. E0417 18:40:05.266863 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0417 18:40:05.266871 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0417 18:40:05.266876 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0417 18:40:05.266891 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0417 18:40:05.266938 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0417 18:40:05.266950 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0417 18:40:05.266957 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0417 18:40:05.266964 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0417 18:40:05.267029 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0417 18:40:05.267042 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0417 18:40:05.267053 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 156.761158ms to process 7 records I0417 18:40:05.315755 1 base_controller.go:82] Caches are synced for LoggingSyncer I0417 18:40:05.315771 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0417 18:40:05.331823 1 tasks_processing.go:74] worker 40 stopped. E0417 18:40:05.331844 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0417 18:40:05.331853 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2po2q8b3ubd89mbta5n7l49aiaaqqcse-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2po2q8b3ubd89mbta5n7l49aiaaqqcse-primary-cert-bundle-secret" not found I0417 18:40:05.331942 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=2da06e4854ca1c17c339150b7390b2c8e422519ca0187f139505caeeddd71bab I0417 18:40:05.331961 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 223.966084ms to process 1 records I0417 18:40:05.615851 1 gather_cluster_operator_pods_and_events.go:121] Found 14 pods with 15 containers I0417 18:40:05.615868 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1677721 bytes I0417 18:40:05.616371 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-gtn7z pod in namespace openshift-dns (previous: false). I0417 18:40:05.815430 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-gtn7z pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-gtn7z\" is waiting to start: ContainerCreating" I0417 18:40:05.815450 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-gtn7z\" is waiting to start: ContainerCreating" I0417 18:40:05.815461 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-gtn7z pod in namespace openshift-dns (previous: false). I0417 18:40:06.015059 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-gtn7z pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-gtn7z\" is waiting to start: ContainerCreating" I0417 18:40:06.015079 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-gtn7z\" is waiting to start: ContainerCreating" I0417 18:40:06.015089 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-8r92h pod in namespace openshift-dns (previous: false). W0417 18:40:06.188733 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0417 18:40:06.215051 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0417 18:40:06.215073 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-hvhsl pod in namespace openshift-dns (previous: false). I0417 18:40:06.438507 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for node-resolver-hvhsl pod in namespace openshift-dns for failing operator dns-node-resolver (previous: false): "container \"dns-node-resolver\" in pod \"node-resolver-hvhsl\" is waiting to start: ContainerCreating" I0417 18:40:06.438529 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns-node-resolver\" in pod \"node-resolver-hvhsl\" is waiting to start: ContainerCreating" I0417 18:40:06.438546 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-xqwll pod in namespace openshift-dns (previous: false). I0417 18:40:06.636464 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0417 18:40:06.639301 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for node-resolver-xqwll pod in namespace openshift-dns for failing operator dns-node-resolver (previous: false): "container \"dns-node-resolver\" in pod \"node-resolver-xqwll\" is waiting to start: ContainerCreating" I0417 18:40:06.639322 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns-node-resolver\" in pod \"node-resolver-xqwll\" is waiting to start: ContainerCreating" I0417 18:40:06.639332 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6dc58774f6-v5hvv pod in namespace openshift-image-registry (previous: false). I0417 18:40:06.810273 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0417 18:40:06.810295 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-759bcd5579-cvhl5 pod in namespace openshift-image-registry (previous: false). I0417 18:40:07.011154 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0417 18:40:07.011175 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-759bcd5579-sn6lt pod in namespace openshift-image-registry (previous: false). I0417 18:40:07.038489 1 tasks_processing.go:74] worker 23 stopped. I0417 18:40:07.038545 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=13a14d61b60c03f4a6bafed53b10c688fe3c0d3a6552e713f0ae41293b9cacb4 I0417 18:40:07.038599 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=e1b224d716646cecd48e4a8bf8532fe3f03ac014bcf0361259403b4a225ebf32 I0417 18:40:07.038634 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0417 18:40:07.038661 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=34487cd89aec2530154baeac536ec18ed64776379bbe38454ddbfa25f5d3c399 I0417 18:40:07.038680 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0417 18:40:07.038718 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=72e96938eee53d976ec6e593dd4d77620ef4180929e75a4841f5203baeade23d I0417 18:40:07.038772 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=254d40ea953bed5686669d19e90e376cdc1dde02c970bd12dbcb8f6ec47c9d5b I0417 18:40:07.038795 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=43e017d04e3bbf64d40a72e21537d46434377e20db1bc4b85a7564dc721eb9ef I0417 18:40:07.038811 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=bb35c050442efd6be53122ae19cec3484d3376d433a8d78f616892b611087df4 I0417 18:40:07.038828 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=391353e57f7d59a383da540765ed2b4be03a46c649cc9099d694510439af5fe0 I0417 18:40:07.038837 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0417 18:40:07.038855 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=e227c7cdfa58412258fe097cd7dfd43a38968432bb0d4917f4b02a4f9a8d59b7 I0417 18:40:07.038866 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0417 18:40:07.038881 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=0859005efbd8f9432508071dab33a3d76efe509529c01cb0a70bfea55484ba89 I0417 18:40:07.038890 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0417 18:40:07.038904 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=2e25575f5dce62ea8a08207fba7142a8ce1c1cb6619e44a2f6140523215c6d02 I0417 18:40:07.038915 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0417 18:40:07.038930 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=3cba2d8f56d2b4164cbba17e6265589c18c88d5384a70d1d816952bbc7c8159c I0417 18:40:07.039061 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=e40ad5e398d88a53ed410eac317e570c0d59e0f55888a94f8edf3e1bd683de91 I0417 18:40:07.039073 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0417 18:40:07.039080 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0417 18:40:07.039113 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0417 18:40:07.039144 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=4ab7429fbf6243a9c75946c3205c2cc53f55e1ee3ca32337e12fbcdeb4b72649 I0417 18:40:07.039167 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=643fc1e43177f9c88ead39cb08ddd72a473f93754c88a1ec2503712d1f4cab2e I0417 18:40:07.039177 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0417 18:40:07.039192 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=c3c8b41d86bae4ba2a41218bce475ee4defc9407300e257e1e9bffd857d61ae8 I0417 18:40:07.039200 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0417 18:40:07.039212 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=713c2104933cb3b9be10e507f5e0e274385ca831915f83420424a291e6edb8b5 I0417 18:40:07.039226 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=eb4f07eeea268e634062fb6706095d14393d1227088cc0450192eec3479eb556 I0417 18:40:07.039240 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=72014ed0c9dedcc97e2db9fae5950f0cce23b81ec0574773a4117f7b2f00d643 I0417 18:40:07.039255 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=fd01cd12f3081c61854ae7749cd5e78ce11208a1e6f402c1cb7847c22ccd1ed0 I0417 18:40:07.039266 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=39e8f9756c5fdf69ec70aa113e2d36f9dc9b9ebb67f66369de90cbea8426f3b6 I0417 18:40:07.039291 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=1c7ce01ba956e93176851749d3517374a94e5a1db419d2fdb7fbd338c43705da I0417 18:40:07.039308 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0417 18:40:07.039316 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0417 18:40:07.039323 1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.928015079s to process 35 records W0417 18:40:07.188341 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0417 18:40:07.218396 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-759bcd5579-sn6lt pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-759bcd5579-sn6lt\" is waiting to start: ContainerCreating" I0417 18:40:07.218416 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-759bcd5579-sn6lt\" is waiting to start: ContainerCreating" I0417 18:40:07.218427 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-h8mjh pod in namespace openshift-image-registry (previous: false). I0417 18:40:07.415912 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for node-ca-h8mjh pod in namespace openshift-image-registry for failing operator node-ca (previous: false): "container \"node-ca\" in pod \"node-ca-h8mjh\" is waiting to start: ContainerCreating" I0417 18:40:07.415931 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"node-ca\" in pod \"node-ca-h8mjh\" is waiting to start: ContainerCreating" I0417 18:40:07.415945 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-p5mwh pod in namespace openshift-image-registry (previous: false). I0417 18:40:07.615447 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0417 18:40:07.615467 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-tbsdk pod in namespace openshift-image-registry (previous: false). I0417 18:40:07.838120 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0417 18:40:07.838139 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-759fbb4fcf-xt7hr pod in namespace openshift-ingress (previous: false). I0417 18:40:08.016221 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-759fbb4fcf-xt7hr pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-759fbb4fcf-xt7hr\" is waiting to start: ContainerCreating" I0417 18:40:08.016244 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-759fbb4fcf-xt7hr\" is waiting to start: ContainerCreating" I0417 18:40:08.016264 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7797cc64cd-5kqr8 pod in namespace openshift-ingress (previous: false). W0417 18:40:08.208603 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0417 18:40:08.214774 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-7797cc64cd-5kqr8 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-7797cc64cd-5kqr8\" is waiting to start: ContainerCreating" I0417 18:40:08.214796 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-7797cc64cd-5kqr8\" is waiting to start: ContainerCreating" I0417 18:40:08.214811 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7797cc64cd-nfd69 pod in namespace openshift-ingress (previous: false). I0417 18:40:08.411348 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0417 18:40:08.411367 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-h88sq pod in namespace openshift-ingress-canary (previous: false). I0417 18:40:08.615731 1 tasks_processing.go:74] worker 28 stopped. I0417 18:40:08.615829 1 recorder.go:75] Recording events/openshift-dns with fingerprint=19652586dc3c80cf640e599e144beeea746d3b5644a666a68b0f1e434ce700b6 I0417 18:40:08.615923 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=a202a8bf152e326a438591728c6cf2d0c16a8d5a65409c0a317e882f7e0e7db3 I0417 18:40:08.615952 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=dd499bd021f050f974a06ee9681ad7590f5a36a1d2dd87d9de2038f61abb496a I0417 18:40:08.615999 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=124e73b9f50afd460c622b9302823a05e6f4a97564f25311248f9ab9685d494f I0417 18:40:08.616021 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=be1b98bb4fb6985c9c13ab7ba10016703b3a220743cc9281f20e85a58f2192e2 I0417 18:40:08.616028 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-h88sq/serve-healthcheck-canary_current.log with fingerprint=d1afe0af47cb7587e0d4dde41c9baf51e66fb83bfbc6694586bffd57a6948529 I0417 18:40:08.616036 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 3.507120432s to process 6 records W0417 18:40:09.188103 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0417 18:40:09.742139 1 configmapobserver.go:84] configmaps "insights-config" not found W0417 18:40:10.188177 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0417 18:40:10.188212 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0417 18:40:10.188228 1 tasks_processing.go:74] worker 16 stopped. E0417 18:40:10.188239 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0417 18:40:10.188251 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0417 18:40:10.188268 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0417 18:40:10.188277 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.081078626s to process 1 records I0417 18:40:17.588926 1 tasks_processing.go:74] worker 4 stopped. I0417 18:40:17.588969 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0417 18:40:17.588984 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.481774966s to process 1 records I0417 18:40:18.313726 1 tasks_processing.go:74] worker 58 stopped. I0417 18:40:18.314027 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=7c1a3e3c431de69ce4ee6fb33aad2158a3d38446a91ec5899ca71ceaf725097e I0417 18:40:18.314046 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.206505426s to process 1 records E0417 18:40:18.314105 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.207s with: function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"machine_configs\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0417 18:40:18.315217 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "machine_configs" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0417 18:40:18.315232 1 periodic.go:216] Running workloads gatherer I0417 18:40:18.315251 1 tasks_processing.go:45] number of workers: 2 I0417 18:40:18.315266 1 tasks_processing.go:69] worker 1 listening for tasks. I0417 18:40:18.315271 1 tasks_processing.go:71] worker 1 working on workload_info task. I0417 18:40:18.315278 1 tasks_processing.go:69] worker 0 listening for tasks. I0417 18:40:18.315294 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0417 18:40:18.340196 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 21s for image data I0417 18:40:18.342773 1 tasks_processing.go:74] worker 0 stopped. I0417 18:40:18.342791 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 27.458324ms to process 0 records I0417 18:40:18.348199 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (9ms) I0417 18:40:18.356074 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (8ms) I0417 18:40:18.363645 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (8ms) I0417 18:40:18.370963 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (7ms) I0417 18:40:18.378309 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (7ms) I0417 18:40:18.385783 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (7ms) I0417 18:40:18.393251 1 gather_workloads_info.go:387] No image sha256:d3e4d4d3324f94a97ce5110eb207cf23299ed7c5f1e8d369a6583552efd87f47 (7ms) I0417 18:40:18.400533 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (7ms) I0417 18:40:18.407846 1 gather_workloads_info.go:387] No image sha256:90a8ffd9643ebb16a6a8c04bb38cf9ed58903e9d3bf836c68f399193db5edaf6 (7ms) I0417 18:40:18.415099 1 gather_workloads_info.go:387] No image sha256:d9ed66918db4dfba8bd354c9ede4d676449fa0eccef649b3d8945cc1da1c60e3 (7ms) I0417 18:40:18.448843 1 gather_workloads_info.go:387] No image sha256:ce138e8cf5b96557b1864ef6f27c2608bdca59be2611804366cef7169c36291e (34ms) I0417 18:40:18.549209 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (100ms) I0417 18:40:18.659309 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (110ms) I0417 18:40:18.759160 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (100ms) I0417 18:40:18.852169 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (93ms) I0417 18:40:18.949341 1 gather_workloads_info.go:387] No image sha256:5ff204630794311b0b37fa7b197b933ad85d76a481bf7cdb3bcbada08f0cdcbf (97ms) I0417 18:40:19.041800 1 configmapobserver.go:84] configmaps "insights-config" not found I0417 18:40:19.052160 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (103ms) I0417 18:40:19.150918 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (99ms) I0417 18:40:19.243516 1 configmapobserver.go:84] configmaps "insights-config" not found I0417 18:40:19.248177 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (97ms) I0417 18:40:19.349218 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (101ms) I0417 18:40:19.449222 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (100ms) I0417 18:40:19.548457 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (99ms) I0417 18:40:19.648770 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (100ms) I0417 18:40:19.748654 1 gather_workloads_info.go:387] No image sha256:4733236617781e3469ffffb15e4daaa1f14ea8e1c52b426a3787a4f1f2945424 (100ms) I0417 18:40:19.848168 1 gather_workloads_info.go:387] No image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (99ms) I0417 18:40:19.949121 1 gather_workloads_info.go:387] No image sha256:e3732e356ae2324565c74cae57d5d016917314fa293ddaa3a68ee9ae030c6f07 (101ms) I0417 18:40:20.048414 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (99ms) I0417 18:40:20.148204 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (100ms) I0417 18:40:20.249614 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (101ms) I0417 18:40:20.349303 1 gather_workloads_info.go:387] No image sha256:d6fbe0075cbb12bfd287c973704fadf97154c7f73e370733d976a40835e9155a (100ms) I0417 18:40:20.449712 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (100ms) I0417 18:40:20.549470 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (100ms) I0417 18:40:20.648785 1 gather_workloads_info.go:387] No image sha256:f4115eca8ea784ac6037602a303fac7fb808d98f4b5120a27bee140df60c3664 (99ms) I0417 18:40:20.748358 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (100ms) I0417 18:40:20.848454 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (100ms) I0417 18:40:20.949114 1 gather_workloads_info.go:387] No image sha256:4b748615a43be416d52c33df03e2cdec89ededded1d6a2ade167c5a955d56e5f (101ms) I0417 18:40:21.048594 1 gather_workloads_info.go:387] No image sha256:8f881f6f0498eaba860d711dc8e9dc066db8728f22abedb82e1dc9a8e1c30046 (99ms) I0417 18:40:21.148757 1 gather_workloads_info.go:387] No image sha256:e1ba458cf6f0b3606c90880da72db8ab99cd11040bae84baebe3ff2e0d1ea075 (100ms) I0417 18:40:21.148790 1 tasks_processing.go:74] worker 1 stopped. E0417 18:40:21.148800 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0417 18:40:21.149066 1 recorder.go:75] Recording config/workload_info with fingerprint=fb0e81698b92809d6cd14ff4cddecc69d19560905f2035ea5d2891cd27ae4c37 I0417 18:40:21.149083 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.833512365s to process 1 records E0417 18:40:21.149109 1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.833s with: function \"workload_info\" failed with an error" I0417 18:40:21.150214 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0417 18:40:21.150228 1 periodic.go:216] Running conditional gatherer I0417 18:40:21.156199 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0417 18:40:21.163073 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.12:48933->172.30.0.10:53: read: connection refused E0417 18:40:21.163332 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0417 18:40:21.163392 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0417 18:40:21.169550 1 conditional_gatherer.go:392] cluster version is '4.21.9' E0417 18:40:21.169566 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0417 18:40:21.169572 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0417 18:40:21.169575 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0417 18:40:21.169579 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0417 18:40:21.169582 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0417 18:40:21.169605 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0417 18:40:21.169612 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0417 18:40:21.169615 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0417 18:40:21.169618 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0417 18:40:21.169633 1 tasks_processing.go:45] number of workers: 3 I0417 18:40:21.169646 1 tasks_processing.go:69] worker 2 listening for tasks. I0417 18:40:21.169650 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0417 18:40:21.169656 1 tasks_processing.go:69] worker 0 listening for tasks. I0417 18:40:21.169669 1 tasks_processing.go:69] worker 1 listening for tasks. I0417 18:40:21.169675 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0417 18:40:21.169682 1 tasks_processing.go:74] worker 1 stopped. I0417 18:40:21.169671 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0417 18:40:21.169765 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0417 18:40:21.169777 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 861ns to process 1 records I0417 18:40:21.169807 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0417 18:40:21.169815 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.201µs to process 1 records I0417 18:40:21.169820 1 tasks_processing.go:74] worker 0 stopped. I0417 18:40:21.169937 1 tasks_processing.go:74] worker 2 stopped. I0417 18:40:21.169949 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 253.29µs to process 0 records I0417 18:40:21.169969 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.12:48933->172.30.0.10:53: read: connection refused I0417 18:40:21.169987 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0417 18:40:21.196106 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=de4f9e0bfa103a250f526be305ef808d6322944b44a7c614d21199db547ecd92 I0417 18:40:21.196249 1 diskrecorder.go:70] Writing 99 records to /var/lib/insights-operator/insights-2026-04-17-184021.tar.gz I0417 18:40:21.202089 1 diskrecorder.go:51] Wrote 99 records to disk in 5ms I0417 18:40:21.202130 1 periodic.go:285] Gathering cluster info every 2h0m0s I0417 18:40:21.202149 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0417 18:40:30.532517 1 configmapobserver.go:84] configmaps "insights-config" not found I0417 18:41:19.534809 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="3ce8642959baa69a0b74bd53ed8d00b586a230f3deeaea4b4cb807ba17196354") W0417 18:41:19.534845 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0417 18:41:19.534892 1 periodic.go:177] Shutting down I0417 18:41:19.534906 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="c24d80a562b1ca1b20430df7048bef81810eb6238e3477708452e69c8f43136f") I0417 18:41:19.534922 1 base_controller.go:181] Shutting down LoggingSyncer ... I0417 18:41:19.534937 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0417 18:41:19.534963 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0417 18:41:19.534979 1 genericapiserver.go:651] "[graceful-termination] not going to wait for active watch request(s) to drain" I0417 18:41:19.534977 1 base_controller.go:181] Shutting down ConfigController ... I0417 18:41:19.534997 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0417 18:41:19.535005 1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0417 18:41:19.535014 1 requestheader_controller.go:194] Shutting down RequestHeaderAuthRequestController