W0425 02:56:23.591677 1 cmd.go:257] Using insecure, self-signed certificates I0425 02:56:24.141689 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0425 02:56:24.141979 1 observer_polling.go:159] Starting file observer I0425 02:56:24.859633 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0425 02:56:24.859832 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0425 02:56:24.860397 1 secure_serving.go:57] Forcing use of http/1.1 only W0425 02:56:24.860419 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0425 02:56:24.860423 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0425 02:56:24.860427 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0425 02:56:24.860430 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0425 02:56:24.860433 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0425 02:56:24.860435 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0425 02:56:24.860470 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0425 02:56:24.864574 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0425 02:56:24.864599 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"c57c5d9a-b8cb-4785-804c-9471c3c4dd9d", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0425 02:56:24.866221 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0425 02:56:24.866235 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0425 02:56:24.866243 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0425 02:56:24.866273 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0425 02:56:24.866244 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0425 02:56:24.866287 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0425 02:56:24.866534 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-1610864682/tls.crt::/tmp/serving-cert-1610864682/tls.key" I0425 02:56:24.866794 1 secure_serving.go:213] Serving securely on [::]:8443 I0425 02:56:24.866822 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0425 02:56:24.874582 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0425 02:56:24.874618 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0425 02:56:24.874738 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0425 02:56:24.880213 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0425 02:56:24.880242 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0425 02:56:24.886425 1 secretconfigobserver.go:119] support secret does not exist I0425 02:56:24.891322 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0425 02:56:24.896461 1 secretconfigobserver.go:119] support secret does not exist I0425 02:56:24.902447 1 recorder.go:176] Pruning old reports every 6h53m3s, max age is 288h0m0s I0425 02:56:24.907762 1 periodic.go:216] Running clusterconfig gatherer I0425 02:56:24.907762 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0425 02:56:24.907786 1 insightsreport.go:296] Starting report retriever I0425 02:56:24.907793 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0425 02:56:24.907762 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0425 02:56:24.907814 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0425 02:56:24.907817 1 tasks_processing.go:45] number of workers: 64 I0425 02:56:24.907831 1 tasks_processing.go:69] worker 1 listening for tasks. I0425 02:56:24.907836 1 tasks_processing.go:69] worker 0 listening for tasks. I0425 02:56:24.907843 1 tasks_processing.go:69] worker 13 listening for tasks. I0425 02:56:24.907848 1 tasks_processing.go:69] worker 2 listening for tasks. I0425 02:56:24.907859 1 tasks_processing.go:69] worker 3 listening for tasks. I0425 02:56:24.907861 1 tasks_processing.go:69] worker 8 listening for tasks. I0425 02:56:24.907865 1 tasks_processing.go:69] worker 9 listening for tasks. I0425 02:56:24.907866 1 tasks_processing.go:71] worker 3 working on jaegers task. I0425 02:56:24.907872 1 tasks_processing.go:69] worker 41 listening for tasks. I0425 02:56:24.907873 1 tasks_processing.go:71] worker 9 working on cluster_apiserver task. I0425 02:56:24.907877 1 tasks_processing.go:71] worker 41 working on container_runtime_configs task. I0425 02:56:24.907881 1 tasks_processing.go:69] worker 40 listening for tasks. I0425 02:56:24.907895 1 tasks_processing.go:69] worker 27 listening for tasks. I0425 02:56:24.907905 1 tasks_processing.go:69] worker 28 listening for tasks. I0425 02:56:24.907900 1 tasks_processing.go:69] worker 26 listening for tasks. I0425 02:56:24.907914 1 tasks_processing.go:69] worker 29 listening for tasks. I0425 02:56:24.907918 1 tasks_processing.go:69] worker 14 listening for tasks. I0425 02:56:24.907923 1 tasks_processing.go:69] worker 30 listening for tasks. I0425 02:56:24.907926 1 tasks_processing.go:69] worker 15 listening for tasks. I0425 02:56:24.907931 1 tasks_processing.go:69] worker 31 listening for tasks. I0425 02:56:24.907869 1 tasks_processing.go:71] worker 8 working on overlapping_namespace_uids task. I0425 02:56:24.907931 1 tasks_processing.go:69] worker 16 listening for tasks. I0425 02:56:24.907931 1 tasks_processing.go:69] worker 5 listening for tasks. I0425 02:56:24.907941 1 tasks_processing.go:69] worker 4 listening for tasks. I0425 02:56:24.907949 1 tasks_processing.go:69] worker 42 listening for tasks. I0425 02:56:24.907946 1 tasks_processing.go:69] worker 19 listening for tasks. I0425 02:56:24.907958 1 tasks_processing.go:71] worker 42 working on image task. I0425 02:56:24.907961 1 tasks_processing.go:69] worker 43 listening for tasks. I0425 02:56:24.907962 1 tasks_processing.go:71] worker 19 working on openshift_logging task. I0425 02:56:24.907959 1 tasks_processing.go:69] worker 35 listening for tasks. I0425 02:56:24.907970 1 tasks_processing.go:69] worker 38 listening for tasks. I0425 02:56:24.907973 1 tasks_processing.go:69] worker 23 listening for tasks. I0425 02:56:24.907971 1 tasks_processing.go:69] worker 44 listening for tasks. I0425 02:56:24.907982 1 tasks_processing.go:69] worker 39 listening for tasks. I0425 02:56:24.907980 1 tasks_processing.go:69] worker 32 listening for tasks. I0425 02:56:24.907966 1 tasks_processing.go:69] worker 22 listening for tasks. I0425 02:56:24.907941 1 tasks_processing.go:69] worker 18 listening for tasks. I0425 02:56:24.907989 1 tasks_processing.go:69] worker 24 listening for tasks. I0425 02:56:24.907951 1 tasks_processing.go:71] worker 5 working on sap_datahubs task. I0425 02:56:24.907997 1 tasks_processing.go:69] worker 34 listening for tasks. I0425 02:56:24.908001 1 tasks_processing.go:69] worker 12 listening for tasks. I0425 02:56:24.908000 1 tasks_processing.go:69] worker 10 listening for tasks. I0425 02:56:24.908008 1 tasks_processing.go:71] worker 1 working on pdbs task. I0425 02:56:24.908011 1 tasks_processing.go:69] worker 52 listening for tasks. I0425 02:56:24.908004 1 tasks_processing.go:69] worker 63 listening for tasks. I0425 02:56:24.907941 1 tasks_processing.go:71] worker 31 working on config_maps task. I0425 02:56:24.908018 1 tasks_processing.go:69] worker 46 listening for tasks. I0425 02:56:24.907951 1 tasks_processing.go:69] worker 36 listening for tasks. I0425 02:56:24.907979 1 tasks_processing.go:69] worker 45 listening for tasks. I0425 02:56:24.907988 1 tasks_processing.go:69] worker 61 listening for tasks. I0425 02:56:24.907991 1 tasks_processing.go:69] worker 33 listening for tasks. I0425 02:56:24.908032 1 tasks_processing.go:69] worker 53 listening for tasks. I0425 02:56:24.908034 1 tasks_processing.go:69] worker 51 listening for tasks. I0425 02:56:24.907988 1 tasks_processing.go:69] worker 11 listening for tasks. I0425 02:56:24.907943 1 tasks_processing.go:71] worker 16 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0425 02:56:24.908044 1 tasks_processing.go:69] worker 54 listening for tasks. I0425 02:56:24.908045 1 tasks_processing.go:69] worker 47 listening for tasks. I0425 02:56:24.908053 1 tasks_processing.go:69] worker 55 listening for tasks. I0425 02:56:24.908051 1 tasks_processing.go:69] worker 25 listening for tasks. I0425 02:56:24.907951 1 tasks_processing.go:69] worker 20 listening for tasks. I0425 02:56:24.908062 1 tasks_processing.go:69] worker 59 listening for tasks. I0425 02:56:24.908062 1 tasks_processing.go:69] worker 56 listening for tasks. I0425 02:56:24.908070 1 tasks_processing.go:69] worker 6 listening for tasks. I0425 02:56:24.908053 1 tasks_processing.go:69] worker 58 listening for tasks. I0425 02:56:24.908005 1 tasks_processing.go:71] worker 27 working on operators task. I0425 02:56:24.908080 1 tasks_processing.go:71] worker 0 working on oauths task. I0425 02:56:24.908077 1 tasks_processing.go:71] worker 13 working on pod_network_connectivity_checks task. I0425 02:56:24.908085 1 tasks_processing.go:71] worker 58 working on clusterroles task. I0425 02:56:24.908097 1 tasks_processing.go:71] worker 29 working on ingress_certificates task. I0425 02:56:24.908141 1 tasks_processing.go:71] worker 28 working on schedulers task. I0425 02:56:24.908167 1 tasks_processing.go:71] worker 43 working on service_accounts task. I0425 02:56:24.907961 1 tasks_processing.go:69] worker 37 listening for tasks. I0425 02:56:24.908180 1 tasks_processing.go:71] worker 37 working on container_images task. I0425 02:56:24.908203 1 tasks_processing.go:71] worker 35 working on tsdb_status task. I0425 02:56:24.908020 1 tasks_processing.go:69] worker 49 listening for tasks. I0425 02:56:24.908027 1 tasks_processing.go:69] worker 50 listening for tasks. I0425 02:56:24.908028 1 tasks_processing.go:69] worker 48 listening for tasks. I0425 02:56:24.908046 1 tasks_processing.go:69] worker 57 listening for tasks. I0425 02:56:24.908219 1 tasks_processing.go:71] worker 2 working on machines task. I0425 02:56:24.908223 1 tasks_processing.go:71] worker 57 working on proxies task. I0425 02:56:24.908228 1 tasks_processing.go:71] worker 50 working on image_pruners task. I0425 02:56:24.908235 1 tasks_processing.go:71] worker 38 working on dvo_metrics task. I0425 02:56:24.908252 1 tasks_processing.go:71] worker 4 working on support_secret task. I0425 02:56:24.908282 1 tasks_processing.go:71] worker 40 working on monitoring_persistent_volumes task. I0425 02:56:24.908344 1 tasks_processing.go:71] worker 22 working on crds task. I0425 02:56:24.908415 1 tasks_processing.go:71] worker 14 working on openshift_machine_api_events task. I0425 02:56:24.908220 1 tasks_processing.go:71] worker 48 working on nodes task. I0425 02:56:24.907956 1 tasks_processing.go:69] worker 21 listening for tasks. I0425 02:56:24.908363 1 tasks_processing.go:71] worker 54 working on silenced_alerts task. I0425 02:56:24.908690 1 tasks_processing.go:71] worker 21 working on mutating_webhook_configurations task. W0425 02:56:24.908716 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0425 02:56:24.908739 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 37.601µs to process 0 records I0425 02:56:24.908295 1 tasks_processing.go:71] worker 26 working on machine_configs task. I0425 02:56:24.907936 1 tasks_processing.go:69] worker 17 listening for tasks. I0425 02:56:24.907998 1 tasks_processing.go:69] worker 60 listening for tasks. I0425 02:56:24.908315 1 tasks_processing.go:71] worker 36 working on feature_gates task. W0425 02:56:24.908225 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0425 02:56:24.908861 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 647.457µs to process 0 records I0425 02:56:24.908327 1 tasks_processing.go:71] worker 44 working on openstack_version task. I0425 02:56:24.908062 1 tasks_processing.go:69] worker 7 listening for tasks. I0425 02:56:24.908338 1 tasks_processing.go:71] worker 32 working on authentication task. I0425 02:56:24.909063 1 tasks_processing.go:71] worker 7 working on image_registries task. I0425 02:56:24.909094 1 tasks_processing.go:71] worker 17 working on machine_sets task. I0425 02:56:24.907994 1 tasks_processing.go:69] worker 62 listening for tasks. I0425 02:56:24.909135 1 tasks_processing.go:71] worker 54 working on storage_classes task. I0425 02:56:24.909159 1 tasks_processing.go:71] worker 60 working on nodenetworkstates task. I0425 02:56:24.909162 1 tasks_processing.go:71] worker 35 working on lokistack task. I0425 02:56:24.908368 1 tasks_processing.go:71] worker 45 working on node_features task. I0425 02:56:24.908373 1 tasks_processing.go:71] worker 61 working on openstack_dataplanedeployments task. I0425 02:56:24.908322 1 tasks_processing.go:71] worker 23 working on validating_webhook_configurations task. I0425 02:56:24.908378 1 tasks_processing.go:71] worker 33 working on certificate_signing_requests task. I0425 02:56:24.908382 1 tasks_processing.go:71] worker 53 working on machine_autoscalers task. I0425 02:56:24.908378 1 tasks_processing.go:71] worker 12 working on openstack_dataplanenodesets task. I0425 02:56:24.908224 1 tasks_processing.go:71] worker 49 working on ingress task. I0425 02:56:24.908383 1 tasks_processing.go:71] worker 18 working on sap_config task. I0425 02:56:24.908389 1 tasks_processing.go:71] worker 24 working on storage_cluster task. I0425 02:56:24.908395 1 tasks_processing.go:71] worker 11 working on machine_config_pools task. I0425 02:56:24.909850 1 tasks_processing.go:71] worker 62 working on aggregated_monitoring_cr_names task. I0425 02:56:24.908404 1 tasks_processing.go:71] worker 52 working on install_plans task. I0425 02:56:24.908409 1 tasks_processing.go:71] worker 30 working on qemu_kubevirt_launcher_logs task. I0425 02:56:24.908387 1 tasks_processing.go:71] worker 51 working on operators_pods_and_events task. I0425 02:56:24.908409 1 tasks_processing.go:71] worker 10 working on sap_pods task. I0425 02:56:24.908421 1 tasks_processing.go:71] worker 63 working on nodenetworkconfigurationpolicies task. I0425 02:56:24.908459 1 tasks_processing.go:71] worker 20 working on ceph_cluster task. I0425 02:56:24.908456 1 tasks_processing.go:71] worker 46 working on machine_healthchecks task. I0425 02:56:24.908464 1 tasks_processing.go:71] worker 47 working on active_alerts task. I0425 02:56:24.908467 1 tasks_processing.go:71] worker 55 working on olm_operators task. I0425 02:56:24.908445 1 tasks_processing.go:71] worker 15 working on openstack_controlplanes task. I0425 02:56:24.908393 1 tasks_processing.go:71] worker 34 working on node_logs task. I0425 02:56:24.908478 1 tasks_processing.go:71] worker 6 working on metrics task. I0425 02:56:24.908480 1 tasks_processing.go:71] worker 59 working on networks task. I0425 02:56:24.908333 1 tasks_processing.go:71] worker 39 working on infrastructures task. I0425 02:56:24.908469 1 tasks_processing.go:71] worker 25 working on version task. I0425 02:56:24.908478 1 tasks_processing.go:71] worker 56 working on cost_management_metrics_configs task. W0425 02:56:24.911502 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0425 02:56:24.911533 1 tasks_processing.go:74] worker 47 stopped. I0425 02:56:24.911546 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.440728ms to process 0 records W0425 02:56:24.912178 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0425 02:56:24.912206 1 tasks_processing.go:74] worker 6 stopped. I0425 02:56:24.912219 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 2.057319ms to process 0 records I0425 02:56:24.913538 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0425 02:56:24.913556 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0425 02:56:24.913561 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0425 02:56:24.913564 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0425 02:56:24.913580 1 controller.go:531] The operator is still being initialized I0425 02:56:24.913586 1 controller.go:554] The operator is healthy I0425 02:56:24.914600 1 tasks_processing.go:74] worker 17 stopped. I0425 02:56:24.914613 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 5.496102ms to process 0 records I0425 02:56:24.914636 1 tasks_processing.go:74] worker 61 stopped. I0425 02:56:24.914649 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 5.234621ms to process 0 records I0425 02:56:24.914655 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 6.66098ms to process 0 records I0425 02:56:24.914660 1 tasks_processing.go:74] worker 19 stopped. I0425 02:56:24.924752 1 tasks_processing.go:74] worker 60 stopped. I0425 02:56:24.924778 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 15.582274ms to process 0 records I0425 02:56:24.924791 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 15.596308ms to process 0 records I0425 02:56:24.924799 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 15.89556ms to process 0 records I0425 02:56:24.924807 1 tasks_processing.go:74] worker 44 stopped. I0425 02:56:24.924813 1 tasks_processing.go:74] worker 35 stopped. I0425 02:56:24.924897 1 tasks_processing.go:74] worker 41 stopped. E0425 02:56:24.924908 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0425 02:56:24.924914 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 17.010687ms to process 0 records E0425 02:56:24.924925 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0425 02:56:24.924933 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 16.807263ms to process 0 records I0425 02:56:24.924939 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 15.743464ms to process 0 records I0425 02:56:24.924944 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 16.924556ms to process 0 records I0425 02:56:24.924951 1 tasks_processing.go:74] worker 5 stopped. I0425 02:56:24.924955 1 tasks_processing.go:74] worker 13 stopped. I0425 02:56:24.924959 1 tasks_processing.go:74] worker 45 stopped. I0425 02:56:24.925014 1 tasks_processing.go:74] worker 63 stopped. I0425 02:56:24.925029 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 14.935277ms to process 0 records E0425 02:56:24.925042 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0425 02:56:24.925053 1 gather.go:177] gatherer "clusterconfig" function "machines" took 16.792057ms to process 0 records E0425 02:56:24.925063 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0425 02:56:24.925069 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 14.962839ms to process 0 records I0425 02:56:24.925070 1 tasks_processing.go:74] worker 2 stopped. I0425 02:56:24.925076 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 14.993244ms to process 0 records I0425 02:56:24.925084 1 tasks_processing.go:74] worker 46 stopped. I0425 02:56:24.925080 1 tasks_processing.go:74] worker 10 stopped. I0425 02:56:24.925097 1 tasks_processing.go:74] worker 12 stopped. I0425 02:56:24.925135 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 15.447758ms to process 0 records E0425 02:56:24.925156 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0425 02:56:24.925165 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 16.836102ms to process 0 records I0425 02:56:24.925175 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 15.258012ms to process 0 records I0425 02:56:24.925183 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 15.312788ms to process 0 records I0425 02:56:24.925191 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 17.271598ms to process 0 records I0425 02:56:24.925199 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 15.462437ms to process 0 records I0425 02:56:24.925206 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 15.056292ms to process 0 records I0425 02:56:24.925214 1 tasks_processing.go:74] worker 15 stopped. I0425 02:56:24.925220 1 tasks_processing.go:74] worker 4 stopped. I0425 02:56:24.925227 1 tasks_processing.go:74] worker 18 stopped. I0425 02:56:24.925227 1 tasks_processing.go:74] worker 3 stopped. I0425 02:56:24.925230 1 tasks_processing.go:74] worker 11 stopped. I0425 02:56:24.925226 1 tasks_processing.go:74] worker 24 stopped. I0425 02:56:24.925247 1 tasks_processing.go:74] worker 9 stopped. I0425 02:56:24.925494 1 recorder.go:75] Recording config/apiserver with fingerprint=bba5ec440c1e97bff1ba561c8a6dfb48bdcc716174ca09929c38db4713c4de2c I0425 02:56:24.925515 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 17.363051ms to process 1 records I0425 02:56:24.925529 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 15.639963ms to process 0 records I0425 02:56:24.925600 1 tasks_processing.go:74] worker 53 stopped. I0425 02:56:24.925619 1 recorder.go:75] Recording config/image with fingerprint=e2878bddcf82dd522128b638f49a99fff465186eb8f050de26f43a9d73805f1f I0425 02:56:24.925628 1 gather.go:177] gatherer "clusterconfig" function "image" took 17.428693ms to process 1 records I0425 02:56:24.925672 1 tasks_processing.go:74] worker 42 stopped. I0425 02:56:24.925695 1 recorder.go:75] Recording config/proxy with fingerprint=06eb1eef1f09eae5c5a034d14a68d5beb3a73af89eff80bfb372964934b3f2c5 I0425 02:56:24.925706 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 17.197289ms to process 1 records I0425 02:56:24.925713 1 tasks_processing.go:74] worker 57 stopped. I0425 02:56:24.925940 1 tasks_processing.go:74] worker 7 stopped. I0425 02:56:24.926377 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=561181432f5857cb010dad54fd026564d3236ce9e2a9df166ed618aaaa0c96d3 I0425 02:56:24.926391 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 16.86295ms to process 1 records I0425 02:56:24.934930 1 tasks_processing.go:74] worker 20 stopped. I0425 02:56:24.934954 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 24.842832ms to process 0 records I0425 02:56:24.935000 1 tasks_processing.go:74] worker 56 stopped. I0425 02:56:24.935012 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 24.773216ms to process 0 records I0425 02:56:24.935149 1 tasks_processing.go:74] worker 49 stopped. I0425 02:56:24.935403 1 recorder.go:75] Recording config/ingress with fingerprint=39a970e1c0231ab4f122fd7668dfdec67974e239d3bb43bf8575a7d96facfe87 I0425 02:56:24.935423 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 25.468373ms to process 1 records I0425 02:56:24.935524 1 tasks_processing.go:74] worker 50 stopped. I0425 02:56:24.935544 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=7adaf41275bd9a6ba7fffa77c26849d9c1c42760954bbca764fb4a2df1770b52 I0425 02:56:24.935560 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 26.919114ms to process 1 records I0425 02:56:24.935665 1 tasks_processing.go:74] worker 0 stopped. I0425 02:56:24.935732 1 recorder.go:75] Recording config/oauth with fingerprint=8df9a5a75ecbd881f402ba1dd51ac3c4c123a41ebf90d00ab14aeee88cdb9c8f I0425 02:56:24.935741 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 27.140024ms to process 1 records I0425 02:56:24.935791 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=ca4151bd01795b9439cd4d6cec1cfbdb91bce226391b2706ab6b5c196fbac296 I0425 02:56:24.935798 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 27.095611ms to process 1 records I0425 02:56:24.935830 1 tasks_processing.go:74] worker 28 stopped. I0425 02:56:24.935900 1 tasks_processing.go:74] worker 59 stopped. I0425 02:56:24.935914 1 recorder.go:75] Recording config/network with fingerprint=34b1865c8661c933277304d8c1742b25820a849164d7ad269b7718d3189d2826 I0425 02:56:24.935923 1 gather.go:177] gatherer "clusterconfig" function "networks" took 25.201808ms to process 1 records I0425 02:56:24.936010 1 tasks_processing.go:74] worker 39 stopped. I0425 02:56:24.936394 1 recorder.go:75] Recording config/infrastructure with fingerprint=6b8a6ad4a8161968519c30c819cd79547048fcd1ae565c79093a73dafca33788 I0425 02:56:24.936403 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 25.231527ms to process 1 records I0425 02:56:24.936448 1 gather_logs.go:145] no pods in namespace were found I0425 02:56:24.936500 1 tasks_processing.go:74] worker 32 stopped. I0425 02:56:24.936541 1 recorder.go:75] Recording config/authentication with fingerprint=e39e533314d217f3bb0ae47d293ebd77151bcc3ec29a61ac1905a98da366b4c4 I0425 02:56:24.936549 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 26.484878ms to process 1 records I0425 02:56:24.936653 1 tasks_processing.go:74] worker 48 stopped. I0425 02:56:24.936807 1 recorder.go:75] Recording config/node/ip-10-0-0-192.ec2.internal with fingerprint=5f98880b34f29b968e446a86abaed1dc5994bc6e590465f59e2d6e81962842ec I0425 02:56:24.936883 1 recorder.go:75] Recording config/node/ip-10-0-1-179.ec2.internal with fingerprint=b0e8f1792b1c33580c5c7589435a55dc3a7e2a5f56dc540816944c2cf344527d I0425 02:56:24.936981 1 recorder.go:75] Recording config/node/ip-10-0-2-178.ec2.internal with fingerprint=99a9936839302bb815c920a69af6b3b8278ffde3c9b501d9669bdb3cd9258d0d I0425 02:56:24.936992 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 26.891761ms to process 3 records I0425 02:56:24.937070 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=368d277f47a18220dfce47a395d6f11fd8f0fe203317244c52932a9af983a369 I0425 02:56:24.937070 1 tasks_processing.go:74] worker 1 stopped. I0425 02:56:24.937093 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=3f13d5cb601c9aa8c985ce8c90a3bc4c58ade868970707624c05669fbfd1f5b1 I0425 02:56:24.937110 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=37cca48d3624e83b3e19ba8e4e16fd650aed56fd1604dc9648bde26d77d6d150 I0425 02:56:24.937135 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 27.630491ms to process 3 records I0425 02:56:24.937145 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 26.452058ms to process 0 records I0425 02:56:24.937149 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 28.196472ms to process 0 records I0425 02:56:24.937159 1 tasks_processing.go:74] worker 40 stopped. I0425 02:56:24.937162 1 tasks_processing.go:74] worker 30 stopped. I0425 02:56:24.939423 1 tasks_processing.go:74] worker 34 stopped. I0425 02:56:24.939447 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 29.312912ms to process 0 records I0425 02:56:24.940200 1 tasks_processing.go:74] worker 54 stopped. I0425 02:56:24.940471 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=a4bc441b56b28f4a4724b4ca54649093f648d989d7939c7fbf51d951b939afa8 I0425 02:56:24.940685 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=58d85b242a5e0f4a60069550317e2a909aacd6a61f3dbe266050a2f7ff613082 I0425 02:56:24.940752 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 31.044885ms to process 2 records I0425 02:56:24.940897 1 tasks_processing.go:74] worker 21 stopped. I0425 02:56:24.941091 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=5eead6de6d08213cfc4059503961173a685d7f9a0b106f618c7b7f1c8625c776 I0425 02:56:24.941218 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=b39ae807d0518a38815e90236cf79a6a32bcde7ebac395a8fc21ab45e1129ce9 I0425 02:56:24.941298 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=80dbffd43d3c6cbe99320ca501de5dfa5ba156e00674ec896980398da3139323 I0425 02:56:24.941328 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 31.705985ms to process 3 records I0425 02:56:24.941627 1 tasks_processing.go:74] worker 36 stopped. I0425 02:56:24.941868 1 recorder.go:75] Recording config/featuregate with fingerprint=fa711fabd3c29849bf6fa8035d2a665c22f9d0f52dc9cf3e287f6c3c5a3692bd I0425 02:56:24.942003 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 32.81739ms to process 1 records E0425 02:56:24.942066 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0425 02:56:24.942102 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0425 02:56:24.942263 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 32.979188ms to process 1 records I0425 02:56:24.942225 1 tasks_processing.go:74] worker 26 stopped. I0425 02:56:24.942285 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 33.548186ms to process 0 records I0425 02:56:24.942294 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 32.165124ms to process 0 records I0425 02:56:24.942304 1 tasks_processing.go:74] worker 55 stopped. I0425 02:56:24.942318 1 tasks_processing.go:74] worker 14 stopped. W0425 02:56:24.943226 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0425 02:56:24.943348 1 tasks_processing.go:74] worker 58 stopped. I0425 02:56:24.943358 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0425 02:56:24.943377 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0425 02:56:24.943506 1 operator.go:328] started I0425 02:56:24.943540 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0425 02:56:24.943624 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=94488824a1f1bfe5cb6f86b0d6aee2e546f762334b3978a7a7b28484d395b813 I0425 02:56:24.943783 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=ed542817091edb4539f5f3d329743e0b19cc18ef96d7d31b82a27859fab9a503 I0425 02:56:24.943798 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 35.251497ms to process 2 records I0425 02:56:24.943859 1 tasks_processing.go:74] worker 23 stopped. I0425 02:56:24.943970 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=a64762e3268136adddf30f14dd91acd73ffd45f66f69119c40334302f4c41920 I0425 02:56:24.944029 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=6c041c8a14eb8b91c9d7a741a5eaf21c255c3bd027b4f744eb841984b7387b0f I0425 02:56:24.944049 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=5023ea4f8b955005b3337e0018fc34e117dc95f812c058049bc045dd075377d8 I0425 02:56:24.944083 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=2a7af10930caa9ca8d523f460c638d05b39cdb0f6f3d3951d010f579644f2d3a I0425 02:56:24.944107 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=a2cfe310659f0cecd4da74eb05e68ee6efc9a0e2f79e030f6283a23124143dc5 I0425 02:56:24.944150 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=42dc5d059f6bb7228043d29e4d7fca0a100e5af8883645031c89935b451c4c23 I0425 02:56:24.944174 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=1d555e0fc3f3b99972354ddc702f2d981a98d454582ae526b54db0e9f20c53c6 I0425 02:56:24.944205 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=d7ed1720f6a7f0b236b03b21393a984fbab66fd679467e2a368a3b8f73a00270 I0425 02:56:24.944229 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=5ad7561973a04a769e50496937000988c865495ad4b713a4275bd15b0e3de68a I0425 02:56:24.944268 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=beb63be59582d7bb2593e6d25dc7f7b01be69eb40349e9268defac7460156500 I0425 02:56:24.944292 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=8238c0a09ae3b6e5a8a8add57581e86e2ba0d566df06b81381878a4671e3eabc I0425 02:56:24.944300 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 34.4234ms to process 11 records I0425 02:56:24.944317 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0425 02:56:24.944324 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 36.28346ms to process 1 records I0425 02:56:24.944330 1 tasks_processing.go:74] worker 8 stopped. I0425 02:56:24.945401 1 tasks_processing.go:74] worker 33 stopped. I0425 02:56:24.945414 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 35.896652ms to process 0 records I0425 02:56:24.952702 1 tasks_processing.go:74] worker 62 stopped. I0425 02:56:24.952724 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 42.831065ms to process 0 records I0425 02:56:24.952860 1 tasks_processing.go:74] worker 22 stopped. I0425 02:56:24.952932 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0425 02:56:24.952950 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0425 02:56:24.952954 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0425 02:56:24.952960 1 controller.go:254] Source scaController *sca.Controller is not ready I0425 02:56:24.952975 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0425 02:56:24.953002 1 controller.go:531] The operator is still being initialized I0425 02:56:24.953014 1 controller.go:554] The operator is healthy I0425 02:56:24.953461 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=f1a1bbf9a07d2e5c79b5e1ffcb6d67e35d424a9db504ca302baa70d8261f313d I0425 02:56:24.953668 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=028cfbe60794f93c9c61cc19ff453dd98498540c7dee2e86f465e644939f8e27 I0425 02:56:24.953678 1 gather.go:177] gatherer "clusterconfig" function "crds" took 44.427869ms to process 2 records I0425 02:56:24.953700 1 tasks_processing.go:74] worker 37 stopped. I0425 02:56:24.956712 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-66dbbb6468-mbhkb with fingerprint=c2c80c8f99c19973112b5bec681f4878c72872642bab2a0cba592a2fefcfd6af I0425 02:56:24.956815 1 recorder.go:75] Recording config/running_containers with fingerprint=ffb9c85e375c167a4cd80891f9c689887bbd96e895bc09f33e3c5273d9d4ffcb I0425 02:56:24.956831 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 45.504279ms to process 2 records I0425 02:56:24.956846 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 47.25114ms to process 0 records I0425 02:56:24.956862 1 tasks_processing.go:74] worker 16 stopped. I0425 02:56:24.957784 1 prometheus_rules.go:88] Prometheus rules successfully created E0425 02:56:24.965169 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2768fdb819-4c8f-4dc9-b67d-922f2ab53580%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.8:59207->172.30.0.10:53: read: connection refused I0425 02:56:24.965183 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2768fdb819-4c8f-4dc9-b67d-922f2ab53580%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.8:59207->172.30.0.10:53: read: connection refused I0425 02:56:24.967213 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0425 02:56:24.967220 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0425 02:56:24.967232 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0425 02:56:24.971364 1 tasks_processing.go:74] worker 29 stopped. E0425 02:56:24.971379 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0425 02:56:24.971386 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pstnblpfvopedep638n6fq8493r2vv0-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pstnblpfvopedep638n6fq8493r2vv0-primary-cert-bundle-secret" not found I0425 02:56:24.971447 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=64a9ee72ca46e931b07da98c90fecfe9ad6b134670dd6418847094558d362cf0 I0425 02:56:24.971462 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 63.249481ms to process 1 records I0425 02:56:24.971850 1 tasks_processing.go:74] worker 31 stopped. E0425 02:56:24.971865 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0425 02:56:24.971871 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0425 02:56:24.971875 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0425 02:56:24.971885 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0425 02:56:24.971910 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=2b7e7d968c1ca0e033f2ae1514829fefa6008cf7d89addbe266d351cfb9cca19 I0425 02:56:24.971917 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0425 02:56:24.971921 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0425 02:56:24.971925 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0425 02:56:24.971964 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0425 02:56:24.971971 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0425 02:56:24.971977 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 63.815367ms to process 7 records I0425 02:56:24.974841 1 base_controller.go:82] Caches are synced for ConfigController I0425 02:56:24.974851 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0425 02:56:24.979642 1 configmapobserver.go:84] configmaps "insights-config" not found I0425 02:56:25.030270 1 tasks_processing.go:74] worker 25 stopped. I0425 02:56:25.030544 1 recorder.go:75] Recording config/version with fingerprint=a1c4fbefb2664b6ea87600aefdc476b11b2ec10d1ee8aee1910f6ee26374119e I0425 02:56:25.030561 1 recorder.go:75] Recording config/id with fingerprint=5fa784f36840890777d9ed0a0dc5c4160e0e9bf363390d8faef2aae1b139c4da I0425 02:56:25.030569 1 gather.go:177] gatherer "clusterconfig" function "version" took 120.044524ms to process 2 records I0425 02:56:25.034011 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0425 02:56:25.037511 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.8:56562->172.30.0.10:53: read: connection refused I0425 02:56:25.037528 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.8:56562->172.30.0.10:53: read: connection refused I0425 02:56:25.044469 1 base_controller.go:82] Caches are synced for LoggingSyncer I0425 02:56:25.044485 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... W0425 02:56:25.941491 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0425 02:56:26.150406 1 gather_cluster_operator_pods_and_events.go:121] Found 20 pods with 24 containers I0425 02:56:26.150425 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1048576 bytes I0425 02:56:26.151102 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-2jdtw pod in namespace openshift-dns (previous: false). I0425 02:56:26.366449 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0425 02:56:26.382240 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-2jdtw pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-2jdtw\" is waiting to start: ContainerCreating" I0425 02:56:26.382260 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-2jdtw\" is waiting to start: ContainerCreating" I0425 02:56:26.382270 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-2jdtw pod in namespace openshift-dns (previous: false). I0425 02:56:26.561293 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-2jdtw pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-2jdtw\" is waiting to start: ContainerCreating" I0425 02:56:26.561313 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-2jdtw\" is waiting to start: ContainerCreating" I0425 02:56:26.561328 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-hstpr pod in namespace openshift-dns (previous: false). I0425 02:56:26.771194 1 tasks_processing.go:74] worker 27 stopped. I0425 02:56:26.771253 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=55c03e5bd6c46c98e144f37eb27fe4791275868af4c715b7493ff715ba94f484 I0425 02:56:26.771290 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=2a4d64778bedd32c401982460851495474134d804fd9ef6138466a6b4eda4529 I0425 02:56:26.771318 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0425 02:56:26.771347 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=9c2372ae9919a242676fb57b9dbe3d4a0fb0a07b97317c90e78330a7d1a6b252 I0425 02:56:26.771365 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0425 02:56:26.771402 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=70741d664575a3afa90287e5320193d74f026c2748d6f2f8448a6a17410ec3e9 I0425 02:56:26.771442 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=b1f1ae9ad3e3fcaf36f08c75e66dda1ba313111b382c9aaaf2e2789d1afd759a I0425 02:56:26.771466 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=9008092ad1c028703b6fdce53b024c6fe1b9fc6c9834077ebd6854679adf3e0f I0425 02:56:26.771481 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=a9f0b712facac436f83c549d4bf6ecd6fd7f94a89c066859c53b5da8283c6f41 I0425 02:56:26.771497 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=cbed40e519244956a5569fc128b2801a31c15332859fecff0edabbb01660345a I0425 02:56:26.771506 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0425 02:56:26.771523 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=749de4907b26ce623bf906c050e0e2e70d9611dcf0d2abf143220837502f580b I0425 02:56:26.771531 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0425 02:56:26.771546 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=1453ff650b041a3d442d35f7b7807a34d476cb96130f508774d84e4c60707c21 I0425 02:56:26.771556 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0425 02:56:26.771575 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=0cd9a442563809082f3b47da7874cec4325c8342ec1a00feea24e6cae4c6860e I0425 02:56:26.771585 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0425 02:56:26.771600 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=382fc4e71a9cd08d9d5c9a508863d110978264842b127a86104cd118160b9243 I0425 02:56:26.771720 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=44c6d31bcd3d96d7170259ba50269df21c289a23928b03be5070328488a95cb4 I0425 02:56:26.771730 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0425 02:56:26.771737 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0425 02:56:26.771757 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0425 02:56:26.771781 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=2933fa3c9457104960c3e94b7f7006185869471541add6cf0f4ae76008a15995 I0425 02:56:26.771804 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=044d6047c9295fc91249c9429d5d17069e0ab57eb447c86b872f4e9fc69f8b3c I0425 02:56:26.771814 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0425 02:56:26.771830 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=25dd3dc3543924b20f77cd3f6794304c09d022b98aa4b0cd8e8f7bbe63cf5d1e I0425 02:56:26.771846 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0425 02:56:26.771862 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=7578fdd1b9487dbeaa33c998a4d347beb8d9ad1cbe8b0d187111bcbf5fbb3b9d I0425 02:56:26.771879 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=4aa93f6f4dca33f9dbd385b588248eff3f2c2e0bce6f908b93177a819f6a6cad I0425 02:56:26.771893 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=0caab5e36e2755be702bccd0995e0dda928a3c7dbf0bf4cacf3a9283dc885d40 I0425 02:56:26.771910 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=3e51ce3e280071c0d710932a9b5e0a2b8baa8618287a6b6d145ff1203fc5a6d2 I0425 02:56:26.771923 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=9c13c13e508160d05993bf49a7503ddde67996ab2344fb9f0e4ff4e546782d04 I0425 02:56:26.771946 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=db5780283777058da21eaf90ca25ffbcdc317e5a8a9aee92add0138b7bc2aa48 I0425 02:56:26.771962 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0425 02:56:26.771971 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0425 02:56:26.771978 1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.863098881s to process 35 records I0425 02:56:26.778395 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-hstpr pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-hstpr\" is waiting to start: ContainerCreating" I0425 02:56:26.778413 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-hstpr\" is waiting to start: ContainerCreating" I0425 02:56:26.778422 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-hstpr pod in namespace openshift-dns (previous: false). W0425 02:56:26.940318 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0425 02:56:26.957838 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-hstpr pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-hstpr\" is waiting to start: ContainerCreating" I0425 02:56:26.957862 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-hstpr\" is waiting to start: ContainerCreating" I0425 02:56:26.957872 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-pmdxq pod in namespace openshift-dns (previous: false). I0425 02:56:27.156680 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-pmdxq pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-pmdxq\" is waiting to start: ContainerCreating" I0425 02:56:27.156703 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-pmdxq\" is waiting to start: ContainerCreating" I0425 02:56:27.156712 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-pmdxq pod in namespace openshift-dns (previous: false). I0425 02:56:27.355368 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-pmdxq pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-pmdxq\" is waiting to start: ContainerCreating" I0425 02:56:27.355389 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-pmdxq\" is waiting to start: ContainerCreating" I0425 02:56:27.355400 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-bvj85 pod in namespace openshift-dns (previous: false). I0425 02:56:27.563760 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0425 02:56:27.563783 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-psfcl pod in namespace openshift-dns (previous: false). I0425 02:56:27.754651 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0425 02:56:27.754672 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-qwfrj pod in namespace openshift-dns (previous: false). W0425 02:56:27.940580 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0425 02:56:27.957445 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0425 02:56:27.957466 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5c4d6565bf-tcwsq pod in namespace openshift-image-registry (previous: false). I0425 02:56:28.155868 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5c4d6565bf-tcwsq pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5c4d6565bf-tcwsq\" is waiting to start: ContainerCreating" I0425 02:56:28.155893 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5c4d6565bf-tcwsq\" is waiting to start: ContainerCreating" I0425 02:56:28.155905 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5c4d6565bf-zg2m5 pod in namespace openshift-image-registry (previous: false). I0425 02:56:28.357159 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5c4d6565bf-zg2m5 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5c4d6565bf-zg2m5\" is waiting to start: ContainerCreating" I0425 02:56:28.357180 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5c4d6565bf-zg2m5\" is waiting to start: ContainerCreating" I0425 02:56:28.357191 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7b764bbf98-z2l7j pod in namespace openshift-image-registry (previous: false). I0425 02:56:28.556724 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7b764bbf98-z2l7j pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7b764bbf98-z2l7j\" is waiting to start: ContainerCreating" I0425 02:56:28.556747 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7b764bbf98-z2l7j\" is waiting to start: ContainerCreating" I0425 02:56:28.556759 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-4szr5 pod in namespace openshift-image-registry (previous: false). I0425 02:56:28.756323 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0425 02:56:28.756345 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-4z2kg pod in namespace openshift-image-registry (previous: false). W0425 02:56:28.940318 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0425 02:56:28.955839 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0425 02:56:28.955863 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-vft6z pod in namespace openshift-image-registry (previous: false). I0425 02:56:29.156881 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0425 02:56:29.156902 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-688d565d4f-4sh6x pod in namespace openshift-ingress (previous: false). I0425 02:56:29.356546 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-688d565d4f-4sh6x pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-688d565d4f-4sh6x\" is waiting to start: ContainerCreating" I0425 02:56:29.356567 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-688d565d4f-4sh6x\" is waiting to start: ContainerCreating" I0425 02:56:29.356579 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-688d565d4f-k9d8g pod in namespace openshift-ingress (previous: false). I0425 02:56:29.556461 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-688d565d4f-k9d8g pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-688d565d4f-k9d8g\" is waiting to start: ContainerCreating" I0425 02:56:29.556484 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-688d565d4f-k9d8g\" is waiting to start: ContainerCreating" I0425 02:56:29.556495 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-78949f69fc-p7g7q pod in namespace openshift-ingress (previous: false). I0425 02:56:29.756192 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-78949f69fc-p7g7q pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-78949f69fc-p7g7q\" is waiting to start: ContainerCreating" I0425 02:56:29.756214 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-78949f69fc-p7g7q\" is waiting to start: ContainerCreating" I0425 02:56:29.756227 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-qs8bl pod in namespace openshift-ingress-canary (previous: false). W0425 02:56:29.940867 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0425 02:56:29.940898 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0425 02:56:29.940916 1 tasks_processing.go:74] worker 38 stopped. E0425 02:56:29.940926 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0425 02:56:29.940939 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0425 02:56:29.940953 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0425 02:56:29.940964 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.032668703s to process 1 records I0425 02:56:29.959369 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-vbg5n pod in namespace openshift-ingress-canary (previous: false). I0425 02:56:30.156053 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-wwmqt pod in namespace openshift-ingress-canary (previous: false). I0425 02:56:30.357355 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-846d9b8bdc-j8l6w pod in namespace openshift-kube-storage-version-migrator (previous: false). I0425 02:56:30.556560 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-846d9b8bdc-j8l6w pod in namespace openshift-kube-storage-version-migrator (previous: false). I0425 02:56:30.755714 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-74478b59c6-c7v6d pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). I0425 02:56:30.956966 1 tasks_processing.go:74] worker 51 stopped. I0425 02:56:30.957181 1 recorder.go:75] Recording events/openshift-dns with fingerprint=ae6d2c40118edd534393a24e5319911b2fa3fcbc1ecb39724989a18640074930 I0425 02:56:30.957348 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=40af74523f0fd6a7a0663c83d806a8bc4ef3ee5326013ffc0d49bff487c391af I0425 02:56:30.957393 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=aa926bf18842ce8df2532392bb0505e3ec2007c09c1ac7aa5b47c6d456456cec I0425 02:56:30.957472 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=b3252b306361196050f8af3ccb0604a00056a42dd172ff4630091d7dc4c503be I0425 02:56:30.957538 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=f0d4e028737b1784a378906f17d835d940c288755a01861cf3c8efcbd09b2a0f I0425 02:56:30.957562 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator with fingerprint=dd17a3b8adaa0891b214c026beea89d5a28ecdce22be3992581ce5a74bf51eda I0425 02:56:30.957641 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=e15abe469a9f9b83b4d8e9f53341dd7217de85d08477c6120751c665c39b01bb I0425 02:56:30.957652 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-qs8bl/serve-healthcheck-canary_current.log with fingerprint=c7d2221288ed9451cb3513f7609b85daaac7c4eb76c4d7942c6a9c546cd46be3 I0425 02:56:30.957660 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-vbg5n/serve-healthcheck-canary_current.log with fingerprint=feff80e4513b9cded4bd7e10bc48477ae6167abd124641256b7a7100a6be6ea1 I0425 02:56:30.957666 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-wwmqt/serve-healthcheck-canary_current.log with fingerprint=70d97f656625c3e2c004ed0f68d15a3d82fac93ad7ca9f5c5f1d6597bf7fb00f I0425 02:56:30.957690 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-846d9b8bdc-j8l6w/migrator_current.log with fingerprint=ac5070f54b694224582e363ebc8b74ac85ddf5efcdbaa5c92ace13f872a4e5ad I0425 02:56:30.957700 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-846d9b8bdc-j8l6w/graceful-termination_current.log with fingerprint=87b5ff0bc03a38283d70a66050f5b3dfac23b839c66d1085916a95969bac6a0d I0425 02:56:30.957856 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-74478b59c6-c7v6d/kube-storage-version-migrator-operator_current.log with fingerprint=6207b15fc36fd01ae974f17d91a8386fce5aea1c9b942a462af1607e3c7cabfb I0425 02:56:30.957870 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 6.046889144s to process 13 records I0425 02:56:37.550860 1 tasks_processing.go:74] worker 52 stopped. I0425 02:56:37.550902 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0425 02:56:37.550915 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.640866866s to process 1 records I0425 02:56:37.584404 1 configmapobserver.go:84] configmaps "insights-config" not found I0425 02:56:38.316651 1 tasks_processing.go:74] worker 43 stopped. I0425 02:56:38.316934 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=37b78a794211255319f797e3e69a22df8f5a828f029dbfa0f940236c6e12eaab I0425 02:56:38.316952 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.408463015s to process 1 records E0425 02:56:38.317022 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.409s with: function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"machine_configs\" failed with an error, function \"ingress_certificates\" failed with an error, function \"config_maps\" failed with an error, function \"dvo_metrics\" failed with an error" I0425 02:56:38.318152 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error, function "dvo_metrics" failed with an error I0425 02:56:38.318171 1 periodic.go:216] Running workloads gatherer I0425 02:56:38.318196 1 tasks_processing.go:45] number of workers: 2 I0425 02:56:38.318214 1 tasks_processing.go:69] worker 1 listening for tasks. I0425 02:56:38.318221 1 tasks_processing.go:71] worker 1 working on workload_info task. I0425 02:56:38.318227 1 tasks_processing.go:69] worker 0 listening for tasks. I0425 02:56:38.318242 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0425 02:56:38.345687 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 21s for image data I0425 02:56:38.349571 1 tasks_processing.go:74] worker 0 stopped. I0425 02:56:38.349587 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 31.315763ms to process 0 records I0425 02:56:38.354607 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (10ms) I0425 02:56:38.363784 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (9ms) I0425 02:56:38.372539 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (9ms) I0425 02:56:38.381242 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (9ms) I0425 02:56:38.389786 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (9ms) I0425 02:56:38.399593 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (10ms) I0425 02:56:38.408257 1 gather_workloads_info.go:387] No image sha256:0092742d8c2f3e9241f8f87d6f1da2a063627c140c491dc9c5e97526f760101a (9ms) I0425 02:56:38.419718 1 gather_workloads_info.go:387] No image sha256:4733236617781e3469ffffb15e4daaa1f14ea8e1c52b426a3787a4f1f2945424 (11ms) I0425 02:56:38.428019 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (8ms) I0425 02:56:38.436711 1 gather_workloads_info.go:387] No image sha256:295fdda3bdb8bc5a12a5b038d087001f9e37481cf6f1b3a6d80d39dfabe17af9 (9ms) I0425 02:56:38.454770 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (18ms) I0425 02:56:38.554840 1 gather_workloads_info.go:387] No image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (100ms) I0425 02:56:38.668679 1 gather_workloads_info.go:387] No image sha256:d6fbe0075cbb12bfd287c973704fadf97154c7f73e370733d976a40835e9155a (114ms) I0425 02:56:38.762771 1 gather_workloads_info.go:387] No image sha256:b958e39c1643d98648b20ff8b6ec38a51c9c6606f2eecff4044d41ac993e1878 (94ms) I0425 02:56:38.856271 1 gather_workloads_info.go:387] No image sha256:e1ba458cf6f0b3606c90880da72db8ab99cd11040bae84baebe3ff2e0d1ea075 (93ms) I0425 02:56:38.954629 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (98ms) I0425 02:56:39.056888 1 gather_workloads_info.go:387] No image sha256:e3732e356ae2324565c74cae57d5d016917314fa293ddaa3a68ee9ae030c6f07 (102ms) I0425 02:56:39.155468 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (99ms) I0425 02:56:39.256039 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (101ms) I0425 02:56:39.355371 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (99ms) I0425 02:56:39.454948 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (100ms) I0425 02:56:39.555060 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (100ms) I0425 02:56:39.658821 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (104ms) I0425 02:56:39.755214 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (96ms) I0425 02:56:39.826017 1 configmapobserver.go:84] configmaps "insights-config" not found I0425 02:56:39.856312 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (101ms) I0425 02:56:39.954900 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (99ms) I0425 02:56:40.026769 1 configmapobserver.go:84] configmaps "insights-config" not found I0425 02:56:40.056337 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (101ms) I0425 02:56:40.155672 1 gather_workloads_info.go:387] No image sha256:90a8ffd9643ebb16a6a8c04bb38cf9ed58903e9d3bf836c68f399193db5edaf6 (99ms) I0425 02:56:40.255933 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (100ms) I0425 02:56:40.355780 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (100ms) I0425 02:56:40.454872 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (99ms) I0425 02:56:40.555835 1 gather_workloads_info.go:387] No image sha256:e8b96d9318b3b8c9ed0afe4e6381f635c6b0c2f20772044ac68001ed49af2c87 (101ms) I0425 02:56:40.657231 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (101ms) I0425 02:56:40.763148 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (106ms) I0425 02:56:40.855418 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (92ms) I0425 02:56:40.855453 1 tasks_processing.go:74] worker 1 stopped. E0425 02:56:40.855463 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0425 02:56:40.855759 1 recorder.go:75] Recording config/workload_info with fingerprint=ee81b4aa488a037d002920b2e6fa9dd2e8c5abc843b5d2c955a0cbe9f3b7e93c I0425 02:56:40.855776 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.537222886s to process 1 records E0425 02:56:40.855803 1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.537s with: function \"workload_info\" failed with an error" I0425 02:56:40.856910 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0425 02:56:40.856924 1 periodic.go:216] Running conditional gatherer I0425 02:56:40.863372 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0425 02:56:40.870357 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.8:42080->172.30.0.10:53: read: connection refused E0425 02:56:40.870677 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0425 02:56:40.870737 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0425 02:56:40.877684 1 conditional_gatherer.go:392] cluster version is '4.21.9' E0425 02:56:40.877703 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 02:56:40.877709 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 02:56:40.877714 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 02:56:40.877717 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 02:56:40.877720 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 02:56:40.877724 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 02:56:40.877727 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 02:56:40.877729 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 02:56:40.877732 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0425 02:56:40.877748 1 tasks_processing.go:45] number of workers: 3 I0425 02:56:40.877773 1 tasks_processing.go:69] worker 2 listening for tasks. I0425 02:56:40.877772 1 tasks_processing.go:69] worker 0 listening for tasks. I0425 02:56:40.877782 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0425 02:56:40.877787 1 tasks_processing.go:71] worker 0 working on rapid_container_logs task. I0425 02:56:40.877793 1 tasks_processing.go:69] worker 1 listening for tasks. I0425 02:56:40.877805 1 tasks_processing.go:74] worker 1 stopped. I0425 02:56:40.877824 1 tasks_processing.go:71] worker 2 working on remote_configuration task. I0425 02:56:40.877890 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0425 02:56:40.877906 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.342µs to process 1 records I0425 02:56:40.877940 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0425 02:56:40.877948 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.669µs to process 1 records I0425 02:56:40.877953 1 tasks_processing.go:74] worker 2 stopped. I0425 02:56:40.878054 1 tasks_processing.go:74] worker 0 stopped. I0425 02:56:40.878066 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 258.85µs to process 0 records I0425 02:56:40.878094 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.8:42080->172.30.0.10:53: read: connection refused I0425 02:56:40.878129 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0425 02:56:40.907511 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=616bcd81d25f721a2b48680a3b871ad0be79f17834666a52253f2a7531bb175d I0425 02:56:40.907674 1 diskrecorder.go:70] Writing 107 records to /var/lib/insights-operator/insights-2026-04-25-025640.tar.gz I0425 02:56:40.914552 1 diskrecorder.go:51] Wrote 107 records to disk in 6ms I0425 02:56:40.914592 1 periodic.go:285] Gathering cluster info every 2h0m0s I0425 02:56:40.914608 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0425 02:56:50.640345 1 configmapobserver.go:84] configmaps "insights-config" not found I0425 02:57:49.142955 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="a7a5373032a4ee69dd0f728680d1e35ead744a3891a58443cfe202844af3bb37") W0425 02:57:49.142993 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0425 02:57:49.143039 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="990bed9c4ab0864aab30604febab51c45c16b81d2e1dfa3b64f03b1f9d6ee661") I0425 02:57:49.143077 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated"