W0507 13:02:15.852325 1 cmd.go:257] Using insecure, self-signed certificates I0507 13:02:16.422548 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 13:02:16.422933 1 observer_polling.go:159] Starting file observer I0507 13:02:17.133898 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0507 13:02:17.134192 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0507 13:02:17.134630 1 secure_serving.go:57] Forcing use of http/1.1 only W0507 13:02:17.134649 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0507 13:02:17.134653 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0507 13:02:17.134658 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0507 13:02:17.134661 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0507 13:02:17.134663 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0507 13:02:17.134666 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0507 13:02:17.135153 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0507 13:02:17.139469 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0507 13:02:17.139497 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"c753ecbe-bf2f-43d3-8707-ee74e66215fb", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0507 13:02:17.140329 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0507 13:02:17.140344 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0507 13:02:17.140509 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0507 13:02:17.140662 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0507 13:02:17.141121 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0507 13:02:17.141515 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0507 13:02:17.141535 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-2258902072/tls.crt::/tmp/serving-cert-2258902072/tls.key" I0507 13:02:17.141835 1 secure_serving.go:213] Serving securely on [::]:8443 I0507 13:02:17.141866 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0507 13:02:17.145429 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0507 13:02:17.145455 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0507 13:02:17.145561 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0507 13:02:17.153041 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 13:02:17.153058 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0507 13:02:17.158259 1 secretconfigobserver.go:119] support secret does not exist I0507 13:02:17.164026 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 13:02:17.169321 1 secretconfigobserver.go:119] support secret does not exist I0507 13:02:17.173898 1 recorder.go:161] Pruning old reports every 8h25m56s, max age is 288h0m0s I0507 13:02:17.179249 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0507 13:02:17.179263 1 periodic.go:209] Running clusterconfig gatherer I0507 13:02:17.179264 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0507 13:02:17.179270 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0507 13:02:17.179276 1 insightsreport.go:296] Starting report retriever I0507 13:02:17.179284 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0507 13:02:17.179314 1 tasks_processing.go:45] number of workers: 64 I0507 13:02:17.179350 1 tasks_processing.go:69] worker 3 listening for tasks. I0507 13:02:17.179371 1 tasks_processing.go:69] worker 5 listening for tasks. I0507 13:02:17.179378 1 tasks_processing.go:69] worker 11 listening for tasks. I0507 13:02:17.179382 1 tasks_processing.go:69] worker 19 listening for tasks. I0507 13:02:17.179388 1 tasks_processing.go:69] worker 6 listening for tasks. I0507 13:02:17.179391 1 tasks_processing.go:69] worker 44 listening for tasks. I0507 13:02:17.179394 1 tasks_processing.go:69] worker 12 listening for tasks. I0507 13:02:17.179392 1 tasks_processing.go:69] worker 1 listening for tasks. I0507 13:02:17.179401 1 tasks_processing.go:69] worker 30 listening for tasks. I0507 13:02:17.179401 1 tasks_processing.go:69] worker 29 listening for tasks. I0507 13:02:17.179410 1 tasks_processing.go:69] worker 13 listening for tasks. I0507 13:02:17.179411 1 tasks_processing.go:69] worker 15 listening for tasks. I0507 13:02:17.179418 1 tasks_processing.go:69] worker 32 listening for tasks. I0507 13:02:17.179371 1 tasks_processing.go:69] worker 40 listening for tasks. I0507 13:02:17.179435 1 tasks_processing.go:69] worker 22 listening for tasks. I0507 13:02:17.179435 1 tasks_processing.go:69] worker 14 listening for tasks. I0507 13:02:17.179388 1 tasks_processing.go:71] worker 11 working on nodenetworkstates task. I0507 13:02:17.179443 1 tasks_processing.go:69] worker 47 listening for tasks. I0507 13:02:17.179444 1 tasks_processing.go:69] worker 23 listening for tasks. I0507 13:02:17.179443 1 tasks_processing.go:69] worker 20 listening for tasks. I0507 13:02:17.179384 1 tasks_processing.go:71] worker 5 working on operators task. I0507 13:02:17.179451 1 tasks_processing.go:71] worker 40 working on openstack_version task. I0507 13:02:17.179455 1 tasks_processing.go:69] worker 35 listening for tasks. I0507 13:02:17.179410 1 tasks_processing.go:69] worker 7 listening for tasks. I0507 13:02:17.179458 1 tasks_processing.go:69] worker 26 listening for tasks. I0507 13:02:17.179457 1 tasks_processing.go:69] worker 37 listening for tasks. I0507 13:02:17.179418 1 tasks_processing.go:69] worker 8 listening for tasks. I0507 13:02:17.179434 1 tasks_processing.go:69] worker 21 listening for tasks. I0507 13:02:17.179472 1 tasks_processing.go:69] worker 36 listening for tasks. I0507 13:02:17.179469 1 tasks_processing.go:71] worker 44 working on machine_healthchecks task. I0507 13:02:17.179485 1 tasks_processing.go:69] worker 52 listening for tasks. I0507 13:02:17.179487 1 tasks_processing.go:71] worker 36 working on dvo_metrics task. I0507 13:02:17.179492 1 tasks_processing.go:71] worker 52 working on cluster_apiserver task. I0507 13:02:17.179506 1 tasks_processing.go:71] worker 35 working on infrastructures task. I0507 13:02:17.179538 1 tasks_processing.go:71] worker 37 working on openshift_machine_api_events task. I0507 13:02:17.179602 1 tasks_processing.go:69] worker 28 listening for tasks. I0507 13:02:17.179358 1 tasks_processing.go:69] worker 63 listening for tasks. I0507 13:02:17.179362 1 tasks_processing.go:69] worker 4 listening for tasks. I0507 13:02:17.179366 1 tasks_processing.go:69] worker 41 listening for tasks. I0507 13:02:17.179374 1 tasks_processing.go:71] worker 3 working on machine_autoscalers task. I0507 13:02:17.179455 1 tasks_processing.go:69] worker 39 listening for tasks. I0507 13:02:17.179401 1 tasks_processing.go:71] worker 12 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0507 13:02:17.179644 1 tasks_processing.go:71] worker 26 working on tsdb_status task. W0507 13:02:17.180099 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 13:02:17.180148 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 141.24µs to process 0 records I0507 13:02:17.179401 1 tasks_processing.go:69] worker 16 listening for tasks. I0507 13:02:17.179648 1 tasks_processing.go:71] worker 47 working on cost_management_metrics_configs task. I0507 13:02:17.180235 1 tasks_processing.go:71] worker 23 working on machine_configs task. I0507 13:02:17.180353 1 tasks_processing.go:71] worker 20 working on storage_cluster task. I0507 13:02:17.180426 1 tasks_processing.go:69] worker 54 listening for tasks. I0507 13:02:17.179390 1 tasks_processing.go:71] worker 19 working on sap_datahubs task. I0507 13:02:17.180458 1 tasks_processing.go:69] worker 55 listening for tasks. I0507 13:02:17.179396 1 tasks_processing.go:71] worker 6 working on openstack_dataplanenodesets task. I0507 13:02:17.180611 1 tasks_processing.go:69] worker 60 listening for tasks. I0507 13:02:17.180666 1 tasks_processing.go:69] worker 57 listening for tasks. I0507 13:02:17.180677 1 tasks_processing.go:69] worker 61 listening for tasks. I0507 13:02:17.180683 1 tasks_processing.go:69] worker 56 listening for tasks. I0507 13:02:17.180692 1 tasks_processing.go:71] worker 22 working on config_maps task. I0507 13:02:17.180867 1 tasks_processing.go:71] worker 14 working on node_logs task. I0507 13:02:17.179401 1 tasks_processing.go:69] worker 2 listening for tasks. I0507 13:02:17.179356 1 tasks_processing.go:69] worker 18 listening for tasks. I0507 13:02:17.179402 1 tasks_processing.go:71] worker 1 working on validating_webhook_configurations task. I0507 13:02:17.181431 1 tasks_processing.go:71] worker 8 working on machine_sets task. I0507 13:02:17.181527 1 tasks_processing.go:69] worker 51 listening for tasks. I0507 13:02:17.181545 1 tasks_processing.go:69] worker 50 listening for tasks. I0507 13:02:17.181623 1 tasks_processing.go:71] worker 21 working on olm_operators task. I0507 13:02:17.181641 1 tasks_processing.go:71] worker 50 working on jaegers task. I0507 13:02:17.179411 1 tasks_processing.go:69] worker 31 listening for tasks. I0507 13:02:17.181670 1 tasks_processing.go:71] worker 31 working on silenced_alerts task. W0507 13:02:17.181704 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 13:02:17.181722 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 32.761µs to process 0 records I0507 13:02:17.179412 1 tasks_processing.go:71] worker 29 working on clusterroles task. I0507 13:02:17.181910 1 tasks_processing.go:71] worker 54 working on nodenetworkconfigurationpolicies task. I0507 13:02:17.181921 1 tasks_processing.go:71] worker 55 working on ceph_cluster task. I0507 13:02:17.182037 1 tasks_processing.go:71] worker 41 working on nodes task. I0507 13:02:17.179384 1 tasks_processing.go:69] worker 0 listening for tasks. I0507 13:02:17.179420 1 tasks_processing.go:69] worker 45 listening for tasks. I0507 13:02:17.182055 1 tasks_processing.go:69] worker 53 listening for tasks. I0507 13:02:17.182160 1 tasks_processing.go:71] worker 53 working on lokistack task. I0507 13:02:17.182224 1 tasks_processing.go:71] worker 61 working on proxies task. I0507 13:02:17.182242 1 tasks_processing.go:71] worker 26 working on sap_pods task. I0507 13:02:17.182254 1 tasks_processing.go:71] worker 16 working on networks task. I0507 13:02:17.182263 1 tasks_processing.go:71] worker 63 working on image task. I0507 13:02:17.182336 1 tasks_processing.go:71] worker 2 working on container_runtime_configs task. I0507 13:02:17.182341 1 tasks_processing.go:71] worker 60 working on operators_pods_and_events task. I0507 13:02:17.182367 1 tasks_processing.go:71] worker 18 working on version task. I0507 13:02:17.182501 1 tasks_processing.go:71] worker 39 working on qemu_kubevirt_launcher_logs task. I0507 13:02:17.182367 1 tasks_processing.go:71] worker 4 working on support_secret task. I0507 13:02:17.179421 1 tasks_processing.go:71] worker 15 working on certificate_signing_requests task. I0507 13:02:17.179428 1 tasks_processing.go:69] worker 24 listening for tasks. I0507 13:02:17.179428 1 tasks_processing.go:71] worker 32 working on crds task. I0507 13:02:17.183116 1 tasks_processing.go:71] worker 24 working on oauths task. I0507 13:02:17.179431 1 tasks_processing.go:69] worker 9 listening for tasks. I0507 13:02:17.183181 1 tasks_processing.go:71] worker 9 working on mutating_webhook_configurations task. I0507 13:02:17.179435 1 tasks_processing.go:69] worker 46 listening for tasks. I0507 13:02:17.179436 1 tasks_processing.go:69] worker 33 listening for tasks. I0507 13:02:17.179438 1 tasks_processing.go:69] worker 10 listening for tasks. I0507 13:02:17.179447 1 tasks_processing.go:69] worker 38 listening for tasks. I0507 13:02:17.179442 1 tasks_processing.go:69] worker 17 listening for tasks. I0507 13:02:17.179451 1 tasks_processing.go:69] worker 27 listening for tasks. I0507 13:02:17.179452 1 tasks_processing.go:69] worker 48 listening for tasks. I0507 13:02:17.179458 1 tasks_processing.go:69] worker 49 listening for tasks. I0507 13:02:17.179457 1 tasks_processing.go:69] worker 34 listening for tasks. I0507 13:02:17.179471 1 tasks_processing.go:69] worker 58 listening for tasks. I0507 13:02:17.179384 1 tasks_processing.go:69] worker 43 listening for tasks. I0507 13:02:17.179639 1 tasks_processing.go:71] worker 7 working on machine_config_pools task. I0507 13:02:17.179376 1 tasks_processing.go:69] worker 42 listening for tasks. I0507 13:02:17.179935 1 tasks_processing.go:69] worker 62 listening for tasks. I0507 13:02:17.179951 1 tasks_processing.go:69] worker 59 listening for tasks. I0507 13:02:17.179963 1 tasks_processing.go:69] worker 25 listening for tasks. I0507 13:02:17.179410 1 tasks_processing.go:71] worker 30 working on openshift_logging task. I0507 13:02:17.182123 1 tasks_processing.go:71] worker 45 working on container_images task. I0507 13:02:17.183547 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 3.349983ms to process 0 records I0507 13:02:17.183632 1 tasks_processing.go:74] worker 47 stopped. I0507 13:02:17.182132 1 tasks_processing.go:71] worker 31 working on monitoring_persistent_volumes task. I0507 13:02:17.184069 1 tasks_processing.go:71] worker 38 working on pod_network_connectivity_checks task. I0507 13:02:17.184089 1 tasks_processing.go:71] worker 27 working on metrics task. W0507 13:02:17.184126 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 13:02:17.184131 1 tasks_processing.go:71] worker 58 working on image_pruners task. I0507 13:02:17.184140 1 tasks_processing.go:74] worker 27 stopped. I0507 13:02:17.184151 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 41.575µs to process 0 records I0507 13:02:17.182067 1 tasks_processing.go:71] worker 56 working on openstack_controlplanes task. I0507 13:02:17.184307 1 tasks_processing.go:74] worker 25 stopped. I0507 13:02:17.184320 1 tasks_processing.go:71] worker 17 working on active_alerts task. I0507 13:02:17.184329 1 tasks_processing.go:71] worker 49 working on storage_classes task. I0507 13:02:17.184324 1 tasks_processing.go:71] worker 46 working on overlapping_namespace_uids task. W0507 13:02:17.184349 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 13:02:17.184359 1 tasks_processing.go:74] worker 17 stopped. I0507 13:02:17.182147 1 tasks_processing.go:71] worker 57 working on pdbs task. I0507 13:02:17.184368 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 27.795µs to process 0 records I0507 13:02:17.182138 1 tasks_processing.go:71] worker 0 working on machines task. I0507 13:02:17.184388 1 tasks_processing.go:74] worker 19 stopped. I0507 13:02:17.182371 1 tasks_processing.go:71] worker 28 working on image_registries task. I0507 13:02:17.184392 1 tasks_processing.go:71] worker 34 working on openstack_dataplanedeployments task. I0507 13:02:17.182462 1 tasks_processing.go:71] worker 51 working on install_plans task. I0507 13:02:17.184437 1 tasks_processing.go:71] worker 43 working on sap_config task. I0507 13:02:17.179419 1 tasks_processing.go:71] worker 13 working on aggregated_monitoring_cr_names task. I0507 13:02:17.184518 1 tasks_processing.go:71] worker 48 working on schedulers task. I0507 13:02:17.184583 1 tasks_processing.go:71] worker 10 working on ingress task. I0507 13:02:17.184381 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 3.89575ms to process 0 records I0507 13:02:17.184620 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 4.020759ms to process 0 records I0507 13:02:17.184629 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 5.053162ms to process 0 records I0507 13:02:17.184634 1 tasks_processing.go:71] worker 42 working on service_accounts task. I0507 13:02:17.184638 1 tasks_processing.go:74] worker 40 stopped. I0507 13:02:17.184642 1 tasks_processing.go:74] worker 6 stopped. I0507 13:02:17.184652 1 tasks_processing.go:71] worker 33 working on authentication task. I0507 13:02:17.184721 1 tasks_processing.go:71] worker 62 working on feature_gates task. I0507 13:02:17.184753 1 tasks_processing.go:71] worker 59 working on ingress_certificates task. I0507 13:02:17.185224 1 tasks_processing.go:74] worker 20 stopped. I0507 13:02:17.185233 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 4.856935ms to process 0 records I0507 13:02:17.185770 1 tasks_processing.go:74] worker 54 stopped. I0507 13:02:17.185786 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 3.840415ms to process 0 records I0507 13:02:17.185799 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 6.323666ms to process 0 records I0507 13:02:17.185806 1 tasks_processing.go:74] worker 11 stopped. I0507 13:02:17.186901 1 tasks_processing.go:74] worker 44 stopped. E0507 13:02:17.186914 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0507 13:02:17.186921 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 7.407149ms to process 0 records I0507 13:02:17.186936 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0507 13:02:17.186950 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0507 13:02:17.186953 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0507 13:02:17.186956 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0507 13:02:17.186974 1 controller.go:489] The operator is still being initialized I0507 13:02:17.186987 1 controller.go:512] The operator is healthy I0507 13:02:17.198215 1 tasks_processing.go:74] worker 37 stopped. I0507 13:02:17.198232 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 18.657354ms to process 0 records I0507 13:02:17.198271 1 tasks_processing.go:74] worker 3 stopped. I0507 13:02:17.198283 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 18.639697ms to process 0 records I0507 13:02:17.198291 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 16.63118ms to process 0 records I0507 13:02:17.198299 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 16.836063ms to process 0 records I0507 13:02:17.198305 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 15.952252ms to process 0 records I0507 13:02:17.198312 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 16.137123ms to process 0 records I0507 13:02:17.198312 1 tasks_processing.go:74] worker 50 stopped. I0507 13:02:17.198319 1 tasks_processing.go:74] worker 53 stopped. I0507 13:02:17.198325 1 tasks_processing.go:74] worker 8 stopped. I0507 13:02:17.198331 1 tasks_processing.go:74] worker 2 stopped. I0507 13:02:17.198348 1 tasks_processing.go:74] worker 55 stopped. I0507 13:02:17.198370 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 16.417897ms to process 0 records I0507 13:02:17.198578 1 tasks_processing.go:74] worker 35 stopped. I0507 13:02:17.199314 1 recorder.go:75] Recording config/infrastructure with fingerprint=d94c804c0c0bc1cafd06df980bb503419a1bf281bd9ab250692ef5c5fac4b94b I0507 13:02:17.199331 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 19.052901ms to process 1 records I0507 13:02:17.199343 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 15.320566ms to process 0 records I0507 13:02:17.199347 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 16.442429ms to process 0 records I0507 13:02:17.199361 1 tasks_processing.go:74] worker 7 stopped. I0507 13:02:17.199374 1 tasks_processing.go:74] worker 26 stopped. I0507 13:02:17.199408 1 recorder.go:75] Recording config/proxy with fingerprint=8e11d1918bfc2cd5aba97f780a430ae43bfdef542908f2620b17b3f7b466f6ac I0507 13:02:17.199418 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 16.479695ms to process 1 records I0507 13:02:17.199439 1 tasks_processing.go:74] worker 61 stopped. I0507 13:02:17.199508 1 tasks_processing.go:74] worker 24 stopped. I0507 13:02:17.199588 1 recorder.go:75] Recording config/oauth with fingerprint=446533312cba34f11186e7356c995f42fed14bc75d0e2be82e2d2652a3147ac2 I0507 13:02:17.199598 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 15.640804ms to process 1 records I0507 13:02:17.199682 1 tasks_processing.go:74] worker 1 stopped. I0507 13:02:17.199765 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=b964b99f51a4ef5fd48b6e827e97cd09adf4393d9cc89be3a666a5ceeb412107 I0507 13:02:17.199841 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=0cfa32137bfb5c79b06338280b8f4c1222657ee17b9362500a1d8997a3139fd7 I0507 13:02:17.199861 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=e697fd3830c8f5ea6a771255298c7dcc0bf48243cde126b780816f7cae5fd805 I0507 13:02:17.199883 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=cfe8e414dc5538ae9e82a9002423ef50565e02b19614fc57bc6d0db09fe62e31 I0507 13:02:17.199907 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=9ee6fa169feeeb5f0f604091550ca8a3164c5c939a46e67cb9d17b2d07f743a3 I0507 13:02:17.199929 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=695531e6e430a8e37a8f22d48488725c9772459632b869b0139f19eb1352a68e I0507 13:02:17.199954 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=db20a69008a975eb1ab4c3f1b3dc13bd6f9d610358f5a12ddd98506383b00dad I0507 13:02:17.199986 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=469efc87cc120d1f7e0aa2c06fba15a01ce90c84ab8c730d381e2bdac5c9e2e9 I0507 13:02:17.200008 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=b89dc249e5c1f8b43b03d312884f4b8e2cf2cbc05180bc960a91bf9dfb921a9c I0507 13:02:17.200031 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=5158bbea1e676bd8192dc93b3d66b31a3c0774326f46ca7bcc67ac9ea0e139b5 I0507 13:02:17.200054 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=e4fd9cc207fb798530019fed060b5c5379ec6490de11c5da06f1194692ec475e I0507 13:02:17.200061 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 17.788173ms to process 11 records I0507 13:02:17.200147 1 tasks_processing.go:74] worker 16 stopped. I0507 13:02:17.200181 1 recorder.go:75] Recording config/network with fingerprint=6d6cfcac2bcebb9378c4d042fb1d4c6ac347a5f9923babc9ea4e6c0f7400c8a3 I0507 13:02:17.200189 1 gather.go:177] gatherer "clusterconfig" function "networks" took 16.750155ms to process 1 records I0507 13:02:17.200272 1 tasks_processing.go:74] worker 52 stopped. I0507 13:02:17.200300 1 recorder.go:75] Recording config/apiserver with fingerprint=6f74f308bc6fcd8c1be5ed900c2734bfb10ff4146e60eeee21daec11d285f9cc I0507 13:02:17.200309 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 19.646064ms to process 1 records I0507 13:02:17.205581 1 tasks_processing.go:74] worker 56 stopped. I0507 13:02:17.205598 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 21.335601ms to process 0 records E0507 13:02:17.205612 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0507 13:02:17.205621 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 21.501465ms to process 0 records I0507 13:02:17.205627 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 22.091205ms to process 0 records I0507 13:02:17.205630 1 tasks_processing.go:74] worker 38 stopped. I0507 13:02:17.205633 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 21.188482ms to process 0 records I0507 13:02:17.205637 1 tasks_processing.go:74] worker 30 stopped. I0507 13:02:17.205638 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 21.147485ms to process 0 records I0507 13:02:17.205644 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 24.680262ms to process 0 records I0507 13:02:17.205645 1 tasks_processing.go:74] worker 43 stopped. E0507 13:02:17.205649 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0507 13:02:17.205652 1 tasks_processing.go:74] worker 34 stopped. I0507 13:02:17.205654 1 tasks_processing.go:74] worker 0 stopped. I0507 13:02:17.205658 1 tasks_processing.go:74] worker 14 stopped. I0507 13:02:17.205657 1 gather.go:177] gatherer "clusterconfig" function "machines" took 21.236971ms to process 0 records I0507 13:02:17.213127 1 tasks_processing.go:74] worker 4 stopped. I0507 13:02:17.213163 1 gather_logs.go:145] no pods in namespace were found E0507 13:02:17.213188 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0507 13:02:17.213204 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 30.354727ms to process 0 records I0507 13:02:17.213224 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 30.486828ms to process 0 records I0507 13:02:17.213231 1 tasks_processing.go:74] worker 39 stopped. I0507 13:02:17.213782 1 tasks_processing.go:74] worker 49 stopped. I0507 13:02:17.214672 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=8303590d0e0ce6aa03fae88bc2542c6afba1f08523d1e138d8aecfab00b235ba I0507 13:02:17.214699 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=9041e29b58f108d54fd43dbf808c440ffca96d9ac02a21ad5766a6cae60757e5 I0507 13:02:17.214708 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 29.442552ms to process 2 records I0507 13:02:17.214862 1 recorder.go:75] Recording config/image with fingerprint=83a4508db2cfcdd61b2520628a01272a576f7206e47feac4061b2f6e1812e016 I0507 13:02:17.214876 1 gather.go:177] gatherer "clusterconfig" function "image" took 31.543735ms to process 1 records I0507 13:02:17.214885 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 30.771705ms to process 0 records I0507 13:02:17.214910 1 tasks_processing.go:74] worker 63 stopped. I0507 13:02:17.214926 1 tasks_processing.go:74] worker 31 stopped. I0507 13:02:17.215005 1 tasks_processing.go:74] worker 41 stopped. I0507 13:02:17.215272 1 recorder.go:75] Recording config/node/ip-10-0-0-215.ec2.internal with fingerprint=0f081b43572bf98b34a7c3b94e11ea6f49384b295717e192f35adb56c932bdcc I0507 13:02:17.215365 1 recorder.go:75] Recording config/node/ip-10-0-1-74.ec2.internal with fingerprint=8c203c2ffd04ea99e10953a171590553a4e6510547082fbb6e6d094dfea21b16 I0507 13:02:17.215448 1 recorder.go:75] Recording config/node/ip-10-0-2-127.ec2.internal with fingerprint=92a9419c223b468533514db2698ea85236a337e8d3bcd76cab25fea0f2f8345c I0507 13:02:17.215461 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 32.814318ms to process 3 records I0507 13:02:17.215553 1 tasks_processing.go:74] worker 58 stopped. I0507 13:02:17.215854 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=b20a0073070e449afb1f3b840770858f72255d78173111da7bdf34b67e901e82 I0507 13:02:17.215869 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 30.821765ms to process 1 records I0507 13:02:17.215961 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=970d0742614149c9c4397002547286625e958e32128115f3a4847c1b770370dd I0507 13:02:17.215962 1 tasks_processing.go:74] worker 57 stopped. I0507 13:02:17.215997 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=2d91c23b6c8fecd489b6582b831cc8df3cee7236c9cbbd325ca8243be3135cc1 I0507 13:02:17.216024 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=960305f5aafc502a63550e607a61345fd633aee41a62aeeb46ac4d346ade881d I0507 13:02:17.216036 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 30.638809ms to process 3 records I0507 13:02:17.216140 1 tasks_processing.go:74] worker 10 stopped. I0507 13:02:17.216157 1 recorder.go:75] Recording config/ingress with fingerprint=5da041811dc40a2ad90ef92b0d141ffb98a996c602c0f3ca48c750b5244001d5 I0507 13:02:17.216166 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 30.558002ms to process 1 records I0507 13:02:17.217193 1 tasks_processing.go:74] worker 9 stopped. I0507 13:02:17.217358 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=961748f6837939774304aae300df8c98bcb8fcadbab16b510d06942da2606bb7 I0507 13:02:17.217452 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=22c49fc5f6971f70690b8e9ee9f22d87fa05eed12efe60f816ee15441db5cb86 I0507 13:02:17.217506 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=a4c8fb83cc67bf857777547d4e735b7594036be5146db264d7063ad8cb361b09 I0507 13:02:17.217517 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 33.99897ms to process 3 records I0507 13:02:17.217629 1 tasks_processing.go:74] worker 18 stopped. I0507 13:02:17.217863 1 recorder.go:75] Recording config/version with fingerprint=27ef5210eaa44ce2bc101aa93acd69dfebb8d0811c20a134fd8a1341c9828ddb I0507 13:02:17.217880 1 recorder.go:75] Recording config/id with fingerprint=5b78a473c3a377ca4653796610126f8edafa33c621bf1a2abb8c32198478b901 I0507 13:02:17.217887 1 gather.go:177] gatherer "clusterconfig" function "version" took 34.619668ms to process 2 records I0507 13:02:17.217976 1 tasks_processing.go:74] worker 62 stopped. I0507 13:02:17.218022 1 recorder.go:75] Recording config/featuregate with fingerprint=42a948a3a483aed750027664c1c43f78298a840a757fa57b017f9ababe236ddf I0507 13:02:17.218037 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 32.59626ms to process 1 records I0507 13:02:17.218123 1 tasks_processing.go:74] worker 33 stopped. W0507 13:02:17.218417 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 13:02:17.218781 1 recorder.go:75] Recording config/authentication with fingerprint=100f1e8c729bf8b03fcb30c95dcb0a91551b23a0d8f647fc7f0389049b95f254 I0507 13:02:17.218813 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 32.82335ms to process 1 records I0507 13:02:17.218931 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=0ac21d47d5e2001d66aada0518b829f103817d8af0387580655e11ef897cb0d0 I0507 13:02:17.218948 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 32.971558ms to process 1 records I0507 13:02:17.219003 1 tasks_processing.go:74] worker 48 stopped. I0507 13:02:17.219884 1 tasks_processing.go:74] worker 28 stopped. I0507 13:02:17.220610 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=cffe8076c97345475173a01be1618e0b917ee26b9569ecda5f90782f4cc866b7 I0507 13:02:17.220649 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 33.663387ms to process 1 records I0507 13:02:17.220664 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 37.731065ms to process 0 records I0507 13:02:17.220676 1 tasks_processing.go:74] worker 15 stopped. I0507 13:02:17.221683 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0507 13:02:17.221899 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0507 13:02:17.221967 1 tasks_processing.go:74] worker 46 stopped. I0507 13:02:17.222023 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0507 13:02:17.222050 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 37.606135ms to process 1 records W0507 13:02:17.222064 1 operator.go:288] started I0507 13:02:17.222140 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0507 13:02:17.224467 1 tasks_processing.go:74] worker 21 stopped. I0507 13:02:17.224563 1 recorder.go:75] Recording config/olm_operators with fingerprint=e51f8f9589e30e114e2d1748a7d5cd4cc310a9c5d8d6de4ddd510c3e064db74c I0507 13:02:17.224582 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 42.819438ms to process 1 records I0507 13:02:17.231204 1 tasks_processing.go:74] worker 45 stopped. I0507 13:02:17.231342 1 recorder.go:75] Recording config/running_containers with fingerprint=4e93e49b32d00a2479304a3c957dd3b4bcfc3c58d5a8db25536327099443aaa9 I0507 13:02:17.231379 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 47.694286ms to process 1 records I0507 13:02:17.234376 1 tasks_processing.go:74] worker 32 stopped. I0507 13:02:17.234882 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=ea072d86c866afedd772a0293bafde6d4fe277528b4b971ca0093955346a826c I0507 13:02:17.235195 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=3630a9563aaff83f1b07383b71ad4196dddbc6f393b0a8f671061a09a686a409 I0507 13:02:17.235212 1 gather.go:177] gatherer "clusterconfig" function "crds" took 51.246421ms to process 2 records I0507 13:02:17.239104 1 tasks_processing.go:74] worker 12 stopped. I0507 13:02:17.239119 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 58.73765ms to process 0 records I0507 13:02:17.241198 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0507 13:02:17.241274 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0507 13:02:17.242413 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0507 13:02:17.245112 1 tasks_processing.go:74] worker 29 stopped. I0507 13:02:17.245277 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=c081f91a07940a9e93efaeefa75a5cb0700f2aae49c45f68e0fa25499ec5d59d I0507 13:02:17.245358 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=0e797f22d51f89e6bbd63ab021f4e26a2a894d664477467ca38f77a43bbd2e84 I0507 13:02:17.245367 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 63.350316ms to process 2 records I0507 13:02:17.246034 1 base_controller.go:82] Caches are synced for ConfigController I0507 13:02:17.246044 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0507 13:02:17.248570 1 prometheus_rules.go:88] Prometheus rules successfully created I0507 13:02:17.253227 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0507 13:02:17.253239 1 controller.go:212] Source scaController *sca.Controller is not ready I0507 13:02:17.253242 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0507 13:02:17.253245 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0507 13:02:17.253248 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0507 13:02:17.253264 1 controller.go:489] The operator is still being initialized I0507 13:02:17.253269 1 controller.go:512] The operator is healthy I0507 13:02:17.255595 1 tasks_processing.go:74] worker 13 stopped. I0507 13:02:17.255608 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 71.080563ms to process 0 records E0507 13:02:17.268529 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%278ff043ab-16b7-44da-a975-09f3d612dea6%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.14:40928->172.30.0.10:53: read: connection refused I0507 13:02:17.268541 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%278ff043ab-16b7-44da-a975-09f3d612dea6%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.14:40928->172.30.0.10:53: read: connection refused I0507 13:02:17.268872 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 13:02:17.285939 1 tasks_processing.go:74] worker 22 stopped. E0507 13:02:17.285962 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0507 13:02:17.285976 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0507 13:02:17.285980 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0507 13:02:17.285991 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0507 13:02:17.286017 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0507 13:02:17.286025 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0507 13:02:17.286030 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0507 13:02:17.286034 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0507 13:02:17.286071 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0507 13:02:17.286079 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0507 13:02:17.286085 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 105.233136ms to process 7 records I0507 13:02:17.295291 1 tasks_processing.go:74] worker 59 stopped. E0507 13:02:17.295303 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0507 13:02:17.295312 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2q53j0m1bgsurbq5o54lutofrkvlr3uc-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2q53j0m1bgsurbq5o54lutofrkvlr3uc-primary-cert-bundle-secret" not found I0507 13:02:17.295364 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=ab66d287248dda5e451f2cf5ddecf7e95a7e54fc50219aef687e348da80e2cf3 I0507 13:02:17.295377 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 110.454627ms to process 1 records I0507 13:02:17.299173 1 tasks_processing.go:74] worker 23 stopped. I0507 13:02:17.299201 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0507 13:02:17.299212 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 118.917653ms to process 1 records I0507 13:02:17.307404 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0507 13:02:17.310943 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.14:53721->172.30.0.10:53: read: connection refused I0507 13:02:17.310955 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.14:53721->172.30.0.10:53: read: connection refused I0507 13:02:17.323120 1 base_controller.go:82] Caches are synced for LoggingSyncer I0507 13:02:17.323131 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0507 13:02:17.627718 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0507 13:02:17.627753 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0507 13:02:17.628563 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-6rj9s pod in namespace openshift-dns (previous: false). I0507 13:02:17.849790 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-6rj9s pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-6rj9s\" is waiting to start: ContainerCreating" I0507 13:02:17.849804 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-6rj9s\" is waiting to start: ContainerCreating" I0507 13:02:17.849813 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-6rj9s pod in namespace openshift-dns (previous: false). I0507 13:02:18.034259 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-6rj9s pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-6rj9s\" is waiting to start: ContainerCreating" I0507 13:02:18.034274 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-6rj9s\" is waiting to start: ContainerCreating" I0507 13:02:18.034299 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-vxzcc pod in namespace openshift-dns (previous: false). W0507 13:02:18.215125 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 13:02:18.261777 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-vxzcc pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-vxzcc\" is waiting to start: ContainerCreating" I0507 13:02:18.261791 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-vxzcc\" is waiting to start: ContainerCreating" I0507 13:02:18.261800 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-vxzcc pod in namespace openshift-dns (previous: false). I0507 13:02:18.445270 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-vxzcc pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-vxzcc\" is waiting to start: ContainerCreating" I0507 13:02:18.445285 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-vxzcc\" is waiting to start: ContainerCreating" I0507 13:02:18.445295 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-wz49p pod in namespace openshift-dns (previous: false). I0507 13:02:18.647091 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0507 13:02:18.673584 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-wz49p pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-wz49p\" is waiting to start: ContainerCreating" I0507 13:02:18.673597 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-wz49p\" is waiting to start: ContainerCreating" I0507 13:02:18.673604 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-wz49p pod in namespace openshift-dns (previous: false). I0507 13:02:18.835050 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-wz49p pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-wz49p\" is waiting to start: ContainerCreating" I0507 13:02:18.835067 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-wz49p\" is waiting to start: ContainerCreating" I0507 13:02:18.835079 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-l6scm pod in namespace openshift-dns (previous: false). I0507 13:02:19.036168 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 13:02:19.036185 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-m4fzl pod in namespace openshift-dns (previous: false). I0507 13:02:19.047957 1 tasks_processing.go:74] worker 5 stopped. I0507 13:02:19.048011 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=fe1e4b745ad6b4bec7af4f8485f0b3d1ac760708f47c32c7dd9a3456b09c5378 I0507 13:02:19.048043 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=3f7f3292eef316cce381e791b05325ff98452ef9fa8a99cff2695c8c5a9c3742 I0507 13:02:19.048082 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0507 13:02:19.048111 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=efa12d0a70243ff8f43bacfe670b25bc0af9fec7a6111da09c28b67dacd9635a I0507 13:02:19.048134 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0507 13:02:19.048173 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=81820f92ba827ef07db6af25381f8d0b8af1364b4b4d7e08fb022bf2d72f0f88 I0507 13:02:19.048203 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=c5fbe45a10f3628dc3d7b4a84ef622292ebb12fe8c80f21d217ae8648ef88a03 I0507 13:02:19.048228 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=71e880453399213ecd485cc36a6d6edad81eafa7a6bd4589ab141b0f37b6a231 I0507 13:02:19.048241 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=e032a3280be96f3c6621f07bfe1e7c8cdd239b6546e6fd667ca95bab079e68d8 I0507 13:02:19.048259 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=a6c9d7edab20a50bcd32a1e2520f20a1b98150074f53f53454a131c23f6f844e I0507 13:02:19.048268 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0507 13:02:19.048284 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=f7f0ca36a4e705105580bb36bbe91082f57d4912e1d1282ccdbad7e34fbd6233 I0507 13:02:19.048307 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0507 13:02:19.048324 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=4d629c0831fa8c966b90019f50c05aead20b6289dd7179135167166d981df47d I0507 13:02:19.048333 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0507 13:02:19.048346 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=4505c8169edfd91227121bf9137ba7bb12002a9435656065dc8911523662d216 I0507 13:02:19.048361 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0507 13:02:19.048379 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=5a3a4eb15558276d80a97228bac30e51ef8371630c7b79ac621bc9491cab2a27 I0507 13:02:19.048520 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=70025b54ec5934c7682dc7302f8bb6bca21a28fd89d8c843772e2f23e3133d0f I0507 13:02:19.048531 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0507 13:02:19.048539 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0507 13:02:19.048559 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0507 13:02:19.048581 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=1ef4abbe9d7e980e91048da9507db9d84756b8dd6aa451c1f73c0392e6f99a32 I0507 13:02:19.048606 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=1a29c05cf69eb1259e22d16486deb719ab582f61aea73b84fbccf0a263b36f0b I0507 13:02:19.048615 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0507 13:02:19.048632 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=8cbd4787d01ffdfc213192461bedf5cfce698f296fd748f79def661129e7cfd9 I0507 13:02:19.048642 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0507 13:02:19.048655 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=6b972b3a22f8b8c31cfeb532c4a1a46ecbb73d48126f5a8fb746c39696618947 I0507 13:02:19.048676 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=e16ca6624a4c284e332d2a3e294caed173f8efdd40dee96094c4d51acac76e02 I0507 13:02:19.048690 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=1c5ae84a0f775d1283600a7900c1feec2d684d7141ec9557d5f3154162d65ba4 I0507 13:02:19.048705 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=112d94abceaa91856d68b16ad054a70af66fb22f1dbe63d6880b3c0af69e1d85 I0507 13:02:19.048719 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=e39e32fea3e8fda117a69aee1bbdc7457e413b87400960c8181494b359a3509a I0507 13:02:19.048763 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=42a0c9b9fb677d837ac39f0374a56945faa1f4ee48160b17fe8de04134a09c28 I0507 13:02:19.048779 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0507 13:02:19.048786 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0507 13:02:19.048792 1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.868489917s to process 35 records W0507 13:02:19.215186 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 13:02:19.232475 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 13:02:19.232488 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-mxvhl pod in namespace openshift-dns (previous: false). I0507 13:02:19.435555 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 13:02:19.435607 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6585df889d-5f4jt pod in namespace openshift-image-registry (previous: false). I0507 13:02:19.632123 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6585df889d-5f4jt pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6585df889d-5f4jt\" is waiting to start: ContainerCreating" I0507 13:02:19.632138 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6585df889d-5f4jt\" is waiting to start: ContainerCreating" I0507 13:02:19.632180 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6585df889d-zqh9v pod in namespace openshift-image-registry (previous: false). I0507 13:02:19.833983 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6585df889d-zqh9v pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6585df889d-zqh9v\" is waiting to start: ContainerCreating" I0507 13:02:19.833999 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6585df889d-zqh9v\" is waiting to start: ContainerCreating" I0507 13:02:19.834031 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7fbb966c89-wzrrn pod in namespace openshift-image-registry (previous: false). I0507 13:02:20.035952 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7fbb966c89-wzrrn pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7fbb966c89-wzrrn\" is waiting to start: ContainerCreating" I0507 13:02:20.035968 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7fbb966c89-wzrrn\" is waiting to start: ContainerCreating" I0507 13:02:20.035978 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-2mftz pod in namespace openshift-image-registry (previous: false). W0507 13:02:20.214572 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 13:02:20.242458 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 13:02:20.242472 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-tpxtc pod in namespace openshift-image-registry (previous: false). I0507 13:02:20.432655 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 13:02:20.432670 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-wrhcp pod in namespace openshift-image-registry (previous: false). I0507 13:02:20.633715 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0507 13:02:20.633755 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-587f856dd7-j4l6m pod in namespace openshift-ingress (previous: false). I0507 13:02:20.833549 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-587f856dd7-j4l6m pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-587f856dd7-j4l6m\" is waiting to start: ContainerCreating" I0507 13:02:20.833573 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-587f856dd7-j4l6m\" is waiting to start: ContainerCreating" I0507 13:02:20.833584 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7669f7b8f9-j88qq pod in namespace openshift-ingress (previous: false). I0507 13:02:21.036104 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-7669f7b8f9-j88qq pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-7669f7b8f9-j88qq\" is waiting to start: ContainerCreating" I0507 13:02:21.036121 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-7669f7b8f9-j88qq\" is waiting to start: ContainerCreating" I0507 13:02:21.036136 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7669f7b8f9-nr5h2 pod in namespace openshift-ingress (previous: false). W0507 13:02:21.216115 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 13:02:21.235724 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-7669f7b8f9-nr5h2 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-7669f7b8f9-nr5h2\" is waiting to start: ContainerCreating" I0507 13:02:21.235758 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-7669f7b8f9-nr5h2\" is waiting to start: ContainerCreating" I0507 13:02:21.235791 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-gc6qf pod in namespace openshift-ingress-canary (previous: false). I0507 13:02:21.432916 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-gc6qf pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-gc6qf\" is waiting to start: ContainerCreating" I0507 13:02:21.432933 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-gc6qf\" is waiting to start: ContainerCreating" I0507 13:02:21.432972 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-kqt2k pod in namespace openshift-ingress-canary (previous: false). I0507 13:02:21.634689 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-kqt2k pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-kqt2k\" is waiting to start: ContainerCreating" I0507 13:02:21.634706 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-kqt2k\" is waiting to start: ContainerCreating" I0507 13:02:21.634749 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-qs2rn pod in namespace openshift-ingress-canary (previous: false). I0507 13:02:21.836360 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-qs2rn pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-qs2rn\" is waiting to start: ContainerCreating" I0507 13:02:21.836386 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-qs2rn\" is waiting to start: ContainerCreating" I0507 13:02:21.836403 1 tasks_processing.go:74] worker 60 stopped. I0507 13:02:21.836486 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=9b97be526c9d8bebe45ef0b7d529a7eaaeab8790e45e2fd5f4d2c36c8dc656c2 I0507 13:02:21.836536 1 recorder.go:75] Recording events/openshift-dns with fingerprint=bffdaa8f1801b7e3a67119a5fedcbe5618ef5b2bb336cb5fa2cdc99dff2819e5 I0507 13:02:21.836630 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=89fac5632c3f0395a662a7325e4b7f132dea22808a5b5cc3cfb19d6b916d0021 I0507 13:02:21.836666 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=08157b0cd6ac21dbfd18eecbd7c680cd7cfbcaa09e3a6db67e1704d6b95d5c7f I0507 13:02:21.836713 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=52081a194483d44d8932d3ebffd9cdfe3f401c149b88f172531902ac6cf1ec55 I0507 13:02:21.836755 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=3a01797b02a74583235ee64806b86b516e0194aa23cc3f8cfdbfbfe1d9997aba I0507 13:02:21.838128 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-6rj9s with fingerprint=96418b44ceb58f0af28767d01cbeeb2fa18dce0d5364efd3f0aff08e5f8f68e4 I0507 13:02:21.838223 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-vxzcc with fingerprint=d8efdddd1846e71eff42e6377b745f34ba5955a7f65d2af42a08d2c539401549 I0507 13:02:21.838333 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-6585df889d-5f4jt with fingerprint=2a0dbdb03434862d55224e92c546a81f65ed2c7304b184ffb39dfd84883deda1 I0507 13:02:21.838436 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-6585df889d-zqh9v with fingerprint=02eb11964e6c7b43405765412bc445e45a7c8773faa6a209ace00fa6f9b32ed7 I0507 13:02:21.838536 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-7fbb966c89-wzrrn with fingerprint=3a1ef5a54a2f3eb23a23017a0a4806b893f0c2fa7634067426dede8bd436d68d I0507 13:02:21.838593 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-gc6qf with fingerprint=b6430cf3d636dfe8d81d5f37c975a60ab04017dba0ced0412f03a2c3cb3d19fc I0507 13:02:21.838655 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-kqt2k with fingerprint=6d254379b68a5f61c02bd552437a2e7cab82684248b0058f8829281c4f5140b7 I0507 13:02:21.838716 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-qs2rn with fingerprint=a650b50253b606c5e80e5fcad16f8e340302dc32a5906a6ffe98cf1b50c99600 I0507 13:02:21.838728 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.65404396s to process 14 records W0507 13:02:22.216461 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0507 13:02:22.216487 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0507 13:02:22.216498 1 tasks_processing.go:74] worker 36 stopped. E0507 13:02:22.216508 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0507 13:02:22.216518 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0507 13:02:22.216531 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0507 13:02:22.216544 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.037001419s to process 1 records I0507 13:02:29.630979 1 tasks_processing.go:74] worker 51 stopped. I0507 13:02:29.631023 1 recorder.go:75] Recording config/installplans with fingerprint=95dfd5f33a9a46199239158a0ec0183b629818eca24ae41f4d706d7a3d604aec I0507 13:02:29.631037 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.446533153s to process 1 records I0507 13:02:30.392929 1 tasks_processing.go:74] worker 42 stopped. I0507 13:02:30.393211 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=b3a2c4fa45ed7ae58b9c4093be9a56682fdfea23d7350a26feed0cd7c1d1f420 I0507 13:02:30.393228 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.208277403s to process 1 records E0507 13:02:30.393282 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.214s with: function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0507 13:02:30.394395 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0507 13:02:30.394410 1 periodic.go:209] Running workloads gatherer I0507 13:02:30.394426 1 tasks_processing.go:45] number of workers: 2 I0507 13:02:30.394432 1 tasks_processing.go:69] worker 1 listening for tasks. I0507 13:02:30.394436 1 tasks_processing.go:71] worker 1 working on workload_info task. I0507 13:02:30.394450 1 tasks_processing.go:69] worker 0 listening for tasks. I0507 13:02:30.394475 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0507 13:02:30.411666 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 13:02:30.426571 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0507 13:02:30.436201 1 tasks_processing.go:74] worker 0 stopped. I0507 13:02:30.436222 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 41.703637ms to process 0 records I0507 13:02:30.439216 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (13ms) I0507 13:02:30.452200 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (13ms) I0507 13:02:30.463071 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (11ms) I0507 13:02:30.474142 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (11ms) I0507 13:02:30.484746 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (11ms) I0507 13:02:30.495565 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (11ms) I0507 13:02:30.506773 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (11ms) I0507 13:02:30.517406 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (11ms) I0507 13:02:30.529242 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (12ms) I0507 13:02:30.541263 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (12ms) I0507 13:02:30.552495 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (11ms) I0507 13:02:30.638935 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (86ms) I0507 13:02:30.738222 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (99ms) I0507 13:02:30.838575 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (100ms) I0507 13:02:30.937825 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (99ms) I0507 13:02:31.038433 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (101ms) I0507 13:02:31.139790 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (101ms) I0507 13:02:31.238805 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (99ms) I0507 13:02:31.338923 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (100ms) I0507 13:02:31.442240 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (103ms) I0507 13:02:31.538748 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (96ms) I0507 13:02:31.638909 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (100ms) I0507 13:02:31.738413 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (99ms) I0507 13:02:31.838569 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (100ms) I0507 13:02:31.939256 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (101ms) I0507 13:02:32.038402 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (99ms) I0507 13:02:32.138965 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (101ms) I0507 13:02:32.238270 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (99ms) I0507 13:02:32.338488 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (100ms) I0507 13:02:32.438594 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (100ms) I0507 13:02:32.538770 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (100ms) I0507 13:02:32.637815 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (99ms) I0507 13:02:32.637844 1 tasks_processing.go:74] worker 1 stopped. E0507 13:02:32.637855 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0507 13:02:32.638197 1 recorder.go:75] Recording config/workload_info with fingerprint=e5a7f21bce45f6cc0bff79baf3f21c93a9083c819e6ad9038b38241d7d0816fd I0507 13:02:32.638216 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.243401272s to process 1 records E0507 13:02:32.638248 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.243s with: function \"workload_info\" failed with an error" I0507 13:02:32.639350 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0507 13:02:32.639363 1 periodic.go:209] Running conditional gatherer I0507 13:02:32.648422 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0507 13:02:32.654725 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.14:36083->172.30.0.10:53: read: connection refused E0507 13:02:32.654974 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0507 13:02:32.655031 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0507 13:02:32.661935 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0507 13:02:32.661949 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 13:02:32.661954 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 13:02:32.661958 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 13:02:32.661961 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 13:02:32.661964 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 13:02:32.661968 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 13:02:32.661971 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 13:02:32.661974 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 13:02:32.661976 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0507 13:02:32.661990 1 tasks_processing.go:45] number of workers: 3 I0507 13:02:32.662002 1 tasks_processing.go:69] worker 2 listening for tasks. I0507 13:02:32.662006 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0507 13:02:32.662012 1 tasks_processing.go:69] worker 0 listening for tasks. I0507 13:02:32.662023 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0507 13:02:32.662028 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0507 13:02:32.662027 1 tasks_processing.go:69] worker 1 listening for tasks. I0507 13:02:32.662037 1 tasks_processing.go:74] worker 1 stopped. I0507 13:02:32.662088 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0507 13:02:32.662099 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 891ns to process 1 records I0507 13:02:32.662131 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0507 13:02:32.662140 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.127µs to process 1 records I0507 13:02:32.662145 1 tasks_processing.go:74] worker 0 stopped. I0507 13:02:32.662266 1 tasks_processing.go:74] worker 2 stopped. I0507 13:02:32.662278 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 232.477µs to process 0 records I0507 13:02:32.662295 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.14:36083->172.30.0.10:53: read: connection refused I0507 13:02:32.662313 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0507 13:02:32.688127 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=8874f111ada2eff6d2a5e61513a1cfa922a60ac1203e7c4a982129f752ab617f I0507 13:02:32.688240 1 diskrecorder.go:70] Writing 108 records to /var/lib/insights-operator/insights-2026-05-07-130232.tar.gz I0507 13:02:32.694721 1 diskrecorder.go:51] Wrote 108 records to disk in 6ms I0507 13:02:32.694763 1 periodic.go:278] Gathering cluster info every 2h0m0s I0507 13:02:32.694778 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0507 13:02:32.850901 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 13:02:33.055030 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 13:02:45.997569 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 13:03:46.423302 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="8d1467fe2714ecb382797b79c6a4da2238d8d8774eafbd500ff8209a2e922664") W0507 13:03:46.423345 1 builder.go:160] Restart triggered because of file /var/run/configmaps/service-ca-bundle/service-ca.crt was created I0507 13:03:46.423394 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="66aee83f11961924f8284bf20adb44cf09527bbfd8ebe331b7a18573070a55c5") I0507 13:03:46.423419 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0507 13:03:46.423430 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="bd90238ee71875006788e79c05d4620012a767ef9d99e03289ca8e63c833ec8d") I0507 13:03:46.423461 1 base_controller.go:181] Shutting down ConfigController ...