W0513 00:04:04.948441 1 cmd.go:257] Using insecure, self-signed certificates I0513 00:04:05.333187 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0513 00:04:05.334401 1 observer_polling.go:159] Starting file observer I0513 00:04:05.792940 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0513 00:04:05.793163 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0513 00:04:05.793932 1 secure_serving.go:57] Forcing use of http/1.1 only I0513 00:04:05.794124 1 simple_featuregate_reader.go:171] Starting feature-gate-detector W0513 00:04:05.794137 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0513 00:04:05.794145 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0513 00:04:05.794157 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0513 00:04:05.794162 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0513 00:04:05.794182 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0513 00:04:05.794187 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0513 00:04:05.798912 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0513 00:04:05.798930 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0513 00:04:05.798956 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0513 00:04:05.798958 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0513 00:04:05.798971 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0513 00:04:05.798975 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0513 00:04:05.798967 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0513 00:04:05.798977 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"85e7301c-da34-4bb4-baa1-b40095103e64", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0513 00:04:05.799276 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-1581382115/tls.crt::/tmp/serving-cert-1581382115/tls.key" I0513 00:04:05.799585 1 secure_serving.go:213] Serving securely on [::]:8443 I0513 00:04:05.799611 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0513 00:04:05.804984 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0513 00:04:05.805015 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0513 00:04:05.805099 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0513 00:04:05.811496 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0513 00:04:05.811522 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0513 00:04:05.819527 1 secretconfigobserver.go:119] support secret does not exist I0513 00:04:05.824057 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0513 00:04:05.828058 1 secretconfigobserver.go:119] support secret does not exist I0513 00:04:05.830329 1 recorder.go:161] Pruning old reports every 7h31m48s, max age is 288h0m0s I0513 00:04:05.834996 1 periodic.go:209] Running clusterconfig gatherer I0513 00:04:05.835011 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0513 00:04:05.835024 1 insightsreport.go:296] Starting report retriever I0513 00:04:05.835031 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0513 00:04:05.835062 1 tasks_processing.go:45] number of workers: 64 I0513 00:04:05.835089 1 tasks_processing.go:69] worker 10 listening for tasks. I0513 00:04:05.834998 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0513 00:04:05.835103 1 tasks_processing.go:69] worker 23 listening for tasks. I0513 00:04:05.835108 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0513 00:04:05.835113 1 tasks_processing.go:69] worker 11 listening for tasks. I0513 00:04:05.835115 1 tasks_processing.go:69] worker 37 listening for tasks. I0513 00:04:05.835117 1 tasks_processing.go:71] worker 23 working on jaegers task. I0513 00:04:05.835125 1 tasks_processing.go:69] worker 24 listening for tasks. I0513 00:04:05.835131 1 tasks_processing.go:71] worker 24 working on metrics task. I0513 00:04:05.835132 1 tasks_processing.go:69] worker 12 listening for tasks. I0513 00:04:05.835136 1 tasks_processing.go:69] worker 7 listening for tasks. I0513 00:04:05.835135 1 tasks_processing.go:69] worker 4 listening for tasks. I0513 00:04:05.835143 1 tasks_processing.go:69] worker 8 listening for tasks. I0513 00:04:05.835150 1 tasks_processing.go:69] worker 9 listening for tasks. I0513 00:04:05.835126 1 tasks_processing.go:69] worker 5 listening for tasks. I0513 00:04:05.835143 1 tasks_processing.go:69] worker 13 listening for tasks. I0513 00:04:05.835149 1 tasks_processing.go:69] worker 14 listening for tasks. I0513 00:04:05.835157 1 tasks_processing.go:69] worker 0 listening for tasks. I0513 00:04:05.835163 1 tasks_processing.go:69] worker 1 listening for tasks. I0513 00:04:05.835161 1 tasks_processing.go:69] worker 31 listening for tasks. I0513 00:04:05.835189 1 tasks_processing.go:69] worker 25 listening for tasks. I0513 00:04:05.835157 1 tasks_processing.go:69] worker 15 listening for tasks. I0513 00:04:05.835186 1 tasks_processing.go:69] worker 16 listening for tasks. I0513 00:04:05.835195 1 tasks_processing.go:69] worker 20 listening for tasks. I0513 00:04:05.835197 1 tasks_processing.go:69] worker 28 listening for tasks. I0513 00:04:05.835191 1 tasks_processing.go:69] worker 2 listening for tasks. I0513 00:04:05.835199 1 tasks_processing.go:69] worker 3 listening for tasks. I0513 00:04:05.835204 1 tasks_processing.go:69] worker 21 listening for tasks. I0513 00:04:05.835206 1 tasks_processing.go:69] worker 29 listening for tasks. I0513 00:04:05.835202 1 tasks_processing.go:69] worker 26 listening for tasks. I0513 00:04:05.835206 1 tasks_processing.go:69] worker 22 listening for tasks. I0513 00:04:05.835209 1 tasks_processing.go:69] worker 18 listening for tasks. I0513 00:04:05.835214 1 tasks_processing.go:69] worker 30 listening for tasks. I0513 00:04:05.835210 1 tasks_processing.go:69] worker 19 listening for tasks. I0513 00:04:05.835218 1 tasks_processing.go:69] worker 36 listening for tasks. I0513 00:04:05.835226 1 tasks_processing.go:71] worker 30 working on mutating_webhook_configurations task. I0513 00:04:05.835124 1 tasks_processing.go:71] worker 37 working on sap_pods task. I0513 00:04:05.835229 1 tasks_processing.go:69] worker 58 listening for tasks. I0513 00:04:05.835226 1 tasks_processing.go:69] worker 17 listening for tasks. I0513 00:04:05.835234 1 tasks_processing.go:71] worker 36 working on container_images task. I0513 00:04:05.835237 1 tasks_processing.go:71] worker 7 working on machines task. I0513 00:04:05.835241 1 tasks_processing.go:71] worker 17 working on olm_operators task. I0513 00:04:05.835241 1 tasks_processing.go:69] worker 53 listening for tasks. I0513 00:04:05.835246 1 tasks_processing.go:69] worker 55 listening for tasks. I0513 00:04:05.835244 1 tasks_processing.go:69] worker 40 listening for tasks. I0513 00:04:05.835256 1 tasks_processing.go:71] worker 55 working on crds task. I0513 00:04:05.835260 1 tasks_processing.go:71] worker 40 working on tsdb_status task. I0513 00:04:05.835261 1 tasks_processing.go:69] worker 42 listening for tasks. I0513 00:04:05.835270 1 tasks_processing.go:69] worker 47 listening for tasks. I0513 00:04:05.835263 1 tasks_processing.go:69] worker 56 listening for tasks. I0513 00:04:05.835278 1 tasks_processing.go:69] worker 48 listening for tasks. I0513 00:04:05.835193 1 tasks_processing.go:69] worker 27 listening for tasks. I0513 00:04:05.835277 1 tasks_processing.go:69] worker 46 listening for tasks. W0513 00:04:05.835197 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory W0513 00:04:05.835290 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0513 00:04:05.835296 1 tasks_processing.go:69] worker 43 listening for tasks. I0513 00:04:05.835299 1 tasks_processing.go:69] worker 57 listening for tasks. I0513 00:04:05.835304 1 tasks_processing.go:69] worker 45 listening for tasks. I0513 00:04:05.835308 1 tasks_processing.go:71] worker 43 working on storage_cluster task. I0513 00:04:05.835301 1 tasks_processing.go:69] worker 49 listening for tasks. I0513 00:04:05.835315 1 tasks_processing.go:71] worker 45 working on image task. I0513 00:04:05.835316 1 tasks_processing.go:71] worker 4 working on openshift_machine_api_events task. I0513 00:04:05.835320 1 tasks_processing.go:71] worker 31 working on nodenetworkstates task. I0513 00:04:05.835310 1 tasks_processing.go:71] worker 57 working on validating_webhook_configurations task. I0513 00:04:05.835327 1 tasks_processing.go:69] worker 44 listening for tasks. I0513 00:04:05.835346 1 tasks_processing.go:71] worker 44 working on ingress task. I0513 00:04:05.835329 1 tasks_processing.go:71] worker 0 working on machine_autoscalers task. I0513 00:04:05.835305 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 160.592µs to process 0 records I0513 00:04:05.835470 1 tasks_processing.go:71] worker 13 working on config_maps task. I0513 00:04:05.835316 1 tasks_processing.go:71] worker 1 working on openshift_logging task. I0513 00:04:05.835506 1 tasks_processing.go:71] worker 14 working on nodes task. I0513 00:04:05.835131 1 tasks_processing.go:69] worker 6 listening for tasks. I0513 00:04:05.835224 1 tasks_processing.go:71] worker 9 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0513 00:04:05.835219 1 tasks_processing.go:69] worker 34 listening for tasks. I0513 00:04:05.835687 1 tasks_processing.go:71] worker 34 working on operators task. I0513 00:04:05.835229 1 tasks_processing.go:69] worker 38 listening for tasks. I0513 00:04:05.835230 1 tasks_processing.go:69] worker 54 listening for tasks. I0513 00:04:05.835227 1 tasks_processing.go:71] worker 12 working on dvo_metrics task. I0513 00:04:05.835221 1 tasks_processing.go:69] worker 51 listening for tasks. I0513 00:04:05.835237 1 tasks_processing.go:71] worker 58 working on oauths task. I0513 00:04:05.835235 1 tasks_processing.go:69] worker 52 listening for tasks. I0513 00:04:05.835251 1 tasks_processing.go:71] worker 53 working on clusterroles task. I0513 00:04:05.835228 1 tasks_processing.go:71] worker 19 working on openstack_dataplanenodesets task. I0513 00:04:05.835251 1 tasks_processing.go:69] worker 41 listening for tasks. I0513 00:04:05.835209 1 tasks_processing.go:69] worker 32 listening for tasks. I0513 00:04:05.835312 1 tasks_processing.go:71] worker 16 working on certificate_signing_requests task. I0513 00:04:05.835318 1 tasks_processing.go:71] worker 49 working on ingress_certificates task. I0513 00:04:05.835434 1 tasks_processing.go:69] worker 62 listening for tasks. I0513 00:04:05.836924 1 tasks_processing.go:71] worker 62 working on lokistack task. I0513 00:04:05.835442 1 tasks_processing.go:69] worker 59 listening for tasks. I0513 00:04:05.836945 1 tasks_processing.go:71] worker 59 working on infrastructures task. I0513 00:04:05.835450 1 tasks_processing.go:69] worker 60 listening for tasks. I0513 00:04:05.835449 1 tasks_processing.go:71] worker 8 working on sap_datahubs task. I0513 00:04:05.836965 1 tasks_processing.go:71] worker 60 working on install_plans task. I0513 00:04:05.835459 1 tasks_processing.go:71] worker 28 working on openstack_dataplanedeployments task. I0513 00:04:05.835460 1 tasks_processing.go:71] worker 21 working on monitoring_persistent_volumes task. I0513 00:04:05.835457 1 tasks_processing.go:69] worker 61 listening for tasks. I0513 00:04:05.837153 1 tasks_processing.go:71] worker 61 working on schedulers task. I0513 00:04:05.835214 1 tasks_processing.go:69] worker 35 listening for tasks. I0513 00:04:05.835465 1 tasks_processing.go:71] worker 2 working on machine_config_pools task. I0513 00:04:05.837183 1 tasks_processing.go:71] worker 35 working on feature_gates task. I0513 00:04:05.835465 1 tasks_processing.go:71] worker 20 working on node_logs task. I0513 00:04:05.835471 1 tasks_processing.go:71] worker 26 working on proxies task. I0513 00:04:05.835471 1 tasks_processing.go:71] worker 3 working on service_accounts task. I0513 00:04:05.835475 1 tasks_processing.go:71] worker 22 working on overlapping_namespace_uids task. I0513 00:04:05.835482 1 tasks_processing.go:71] worker 48 working on machine_healthchecks task. I0513 00:04:05.835477 1 tasks_processing.go:71] worker 29 working on qemu_kubevirt_launcher_logs task. I0513 00:04:05.835483 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 36.566µs to process 0 records I0513 00:04:05.835486 1 tasks_processing.go:71] worker 42 working on support_secret task. I0513 00:04:05.835487 1 tasks_processing.go:71] worker 10 working on container_runtime_configs task. I0513 00:04:05.835490 1 tasks_processing.go:71] worker 47 working on aggregated_monitoring_cr_names task. I0513 00:04:05.835490 1 tasks_processing.go:71] worker 40 working on machine_sets task. I0513 00:04:05.835486 1 tasks_processing.go:71] worker 5 working on ceph_cluster task. I0513 00:04:05.835495 1 tasks_processing.go:71] worker 27 working on nodenetworkconfigurationpolicies task. I0513 00:04:05.835494 1 tasks_processing.go:69] worker 63 listening for tasks. I0513 00:04:05.837983 1 tasks_processing.go:71] worker 63 working on openstack_controlplanes task. I0513 00:04:05.835494 1 tasks_processing.go:71] worker 56 working on sap_config task. I0513 00:04:05.835496 1 tasks_processing.go:71] worker 46 working on image_pruners task. I0513 00:04:05.835118 1 tasks_processing.go:71] worker 11 working on machine_configs task. I0513 00:04:05.835500 1 tasks_processing.go:71] worker 24 working on cluster_apiserver task. I0513 00:04:05.835505 1 tasks_processing.go:71] worker 18 working on storage_classes task. I0513 00:04:05.835507 1 tasks_processing.go:71] worker 25 working on operators_pods_and_events task. I0513 00:04:05.835511 1 tasks_processing.go:71] worker 15 working on networks task. I0513 00:04:05.835218 1 tasks_processing.go:69] worker 33 listening for tasks. I0513 00:04:05.838286 1 tasks_processing.go:71] worker 33 working on authentication task. I0513 00:04:05.835679 1 tasks_processing.go:71] worker 6 working on openstack_version task. I0513 00:04:05.835237 1 tasks_processing.go:69] worker 39 listening for tasks. I0513 00:04:05.838373 1 tasks_processing.go:71] worker 39 working on silenced_alerts task. W0513 00:04:05.838391 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0513 00:04:05.835874 1 tasks_processing.go:71] worker 41 working on cost_management_metrics_configs task. I0513 00:04:05.838402 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 18.659µs to process 0 records I0513 00:04:05.835880 1 tasks_processing.go:71] worker 51 working on image_registries task. I0513 00:04:05.838411 1 tasks_processing.go:74] worker 39 stopped. I0513 00:04:05.835886 1 tasks_processing.go:71] worker 52 working on pod_network_connectivity_checks task. I0513 00:04:05.835877 1 tasks_processing.go:71] worker 54 working on version task. I0513 00:04:05.835886 1 tasks_processing.go:71] worker 38 working on pdbs task. I0513 00:04:05.835285 1 tasks_processing.go:69] worker 50 listening for tasks. I0513 00:04:05.836760 1 tasks_processing.go:71] worker 32 working on active_alerts task. I0513 00:04:05.839053 1 tasks_processing.go:74] worker 50 stopped. W0513 00:04:05.839056 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0513 00:04:05.839081 1 tasks_processing.go:74] worker 32 stopped. I0513 00:04:05.839093 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 44.49µs to process 0 records I0513 00:04:05.843287 1 tasks_processing.go:74] worker 23 stopped. I0513 00:04:05.843306 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 8.157104ms to process 0 records I0513 00:04:05.843316 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 8.001086ms to process 0 records I0513 00:04:05.843324 1 tasks_processing.go:74] worker 43 stopped. I0513 00:04:05.854407 1 tasks_processing.go:74] worker 31 stopped. I0513 00:04:05.854430 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 19.061789ms to process 0 records I0513 00:04:05.854440 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 19.018944ms to process 0 records I0513 00:04:05.854444 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 18.801714ms to process 0 records I0513 00:04:05.854449 1 tasks_processing.go:74] worker 1 stopped. I0513 00:04:05.854453 1 tasks_processing.go:74] worker 0 stopped. I0513 00:04:05.854542 1 tasks_processing.go:74] worker 7 stopped. E0513 00:04:05.854555 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0513 00:04:05.854566 1 gather.go:177] gatherer "clusterconfig" function "machines" took 19.291471ms to process 0 records I0513 00:04:05.854575 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 18.749251ms to process 0 records I0513 00:04:05.854580 1 tasks_processing.go:74] worker 19 stopped. I0513 00:04:05.854640 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0513 00:04:05.854659 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0513 00:04:05.854665 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0513 00:04:05.854698 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0513 00:04:05.854718 1 controller.go:489] The operator is still being initialized I0513 00:04:05.854724 1 controller.go:512] The operator is healthy I0513 00:04:05.854936 1 tasks_processing.go:74] worker 45 stopped. I0513 00:04:05.855127 1 recorder.go:75] Recording config/image with fingerprint=209a37e7023392479d5f439cb18f7eff78dfd306fc598cea1d7d96d3a1422c56 I0513 00:04:05.855144 1 gather.go:177] gatherer "clusterconfig" function "image" took 19.604643ms to process 1 records I0513 00:04:05.858393 1 tasks_processing.go:74] worker 4 stopped. I0513 00:04:05.858412 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 23.063362ms to process 0 records I0513 00:04:05.858623 1 tasks_processing.go:74] worker 62 stopped. I0513 00:04:05.858635 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 21.689409ms to process 0 records I0513 00:04:05.858724 1 tasks_processing.go:74] worker 44 stopped. I0513 00:04:05.858995 1 recorder.go:75] Recording config/ingress with fingerprint=b3924c4c2ff59be1692fd1e24bbd0ba8455368fab8b2e621940845de6c13b154 I0513 00:04:05.859017 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 23.367525ms to process 1 records I0513 00:04:05.859025 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 21.665825ms to process 0 records I0513 00:04:05.859075 1 tasks_processing.go:74] worker 2 stopped. I0513 00:04:05.859139 1 tasks_processing.go:74] worker 30 stopped. I0513 00:04:05.859258 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=012825af381833011ccb02bb97d54554699c60fc16e95b4aac767b7ed30f78fb I0513 00:04:05.859313 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=fa9873bb7ed0326f1970ea1db929212f006b292a826b7f0e7b572cda2e1a7ff9 I0513 00:04:05.859354 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=55e362cbe2ca0e31403c4dbcaed0a0a8fb35899322d0b576aa01fd3284e2cb2f I0513 00:04:05.859362 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 23.655238ms to process 3 records I0513 00:04:05.859447 1 tasks_processing.go:74] worker 58 stopped. I0513 00:04:05.859559 1 recorder.go:75] Recording config/oauth with fingerprint=1ab80456c388c952084ab53597f824c5a0030925102601e81513ab605ac53821 I0513 00:04:05.859569 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 23.191645ms to process 1 records I0513 00:04:05.859661 1 tasks_processing.go:74] worker 59 stopped. I0513 00:04:05.860119 1 recorder.go:75] Recording config/infrastructure with fingerprint=fc3c87818a93a6385f90a2f5b3699a048fb25e8ce16d1a609f9d306655f369a4 I0513 00:04:05.860134 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 21.998123ms to process 1 records I0513 00:04:05.860145 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 22.042847ms to process 0 records I0513 00:04:05.860151 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 22.137102ms to process 0 records I0513 00:04:05.860156 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 24.012086ms to process 0 records I0513 00:04:05.860211 1 tasks_processing.go:74] worker 28 stopped. I0513 00:04:05.860224 1 tasks_processing.go:74] worker 8 stopped. I0513 00:04:05.860230 1 tasks_processing.go:74] worker 37 stopped. I0513 00:04:05.860233 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=c2ad11516245b734fabb7d621df7e3b3378fec54f6e387fbae48ef0185de3845 I0513 00:04:05.860240 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 22.266037ms to process 1 records I0513 00:04:05.860247 1 tasks_processing.go:74] worker 61 stopped. I0513 00:04:05.860427 1 tasks_processing.go:74] worker 48 stopped. E0513 00:04:05.860443 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0513 00:04:05.860451 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 22.859477ms to process 0 records I0513 00:04:05.860604 1 tasks_processing.go:74] worker 14 stopped. I0513 00:04:05.860948 1 recorder.go:75] Recording config/node/ip-10-0-0-44.ec2.internal with fingerprint=8650a88ed1cf490b85797b74448636e1a6b35f910d38daac8d9c1543ee1339f9 I0513 00:04:05.861013 1 recorder.go:75] Recording config/node/ip-10-0-1-232.ec2.internal with fingerprint=a1c17d504c8527d031b70ce768898bcd501d7af2c0346db01c21825aa33fbf86 I0513 00:04:05.861073 1 recorder.go:75] Recording config/node/ip-10-0-2-218.ec2.internal with fingerprint=36bd7c324409f9b867b792d6c20b0d4772bb37b8a9968a035e8a5208a7164bd1 I0513 00:04:05.861083 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 24.993554ms to process 3 records I0513 00:04:05.861155 1 tasks_processing.go:74] worker 57 stopped. I0513 00:04:05.861203 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=8b77c3ec23fbf3226d5b051d2b7d4fb367c8a7c482f356f354a57c3dfb08d193 I0513 00:04:05.861288 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=293b64bac2541c2abdc71b53f67e699e2ada9a983d857c619011c2f9d7a02fa6 I0513 00:04:05.861309 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=fedd0581146808a78d953589ff6d2b78ff9875641e085cb681b82d573b321cb8 I0513 00:04:05.861344 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=f1776a842226c3c5e919678707cc96ae08586a0554bca9f334666badcaeee6ff I0513 00:04:05.861378 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=d2d415c0735e4e2303b4874436fbbe94ad10ff3397055363e8e433ac5e0734ec I0513 00:04:05.861634 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=ed27c256160c96e2def9463bd5d93b0f8d11b28bedfa774f2a491938529b9e6b I0513 00:04:05.861688 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=6c9674876834a5e6e54ecb2537957a168a2e41bd621f12637df85e3866fce5b0 I0513 00:04:05.861744 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=79579c2dfe8bc704acbecc51fd164a0b6722617768e7630e9764f60ddb5c109d I0513 00:04:05.861778 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=1867ba8f8fd13e47b9de988d18228549f5974d0a686121c5eac657a567e70423 I0513 00:04:05.861950 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=42a006360f8a674f7a8778cf677e4c12f9cd4b383b78e880cf3faf51cce2af25 I0513 00:04:05.862049 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=50f37754535accb4185e7e3abb3ff0b885e760d76752dd9acb8db8cfbc2f84a6 I0513 00:04:05.862110 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 25.369628ms to process 11 records I0513 00:04:05.863772 1 tasks_processing.go:74] worker 20 stopped. I0513 00:04:05.863823 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 24.542545ms to process 0 records I0513 00:04:05.863980 1 tasks_processing.go:74] worker 16 stopped. I0513 00:04:05.864070 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 27.110516ms to process 0 records I0513 00:04:05.864457 1 tasks_processing.go:74] worker 21 stopped. I0513 00:04:05.864480 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 27.337196ms to process 0 records I0513 00:04:05.864645 1 tasks_processing.go:74] worker 26 stopped. I0513 00:04:05.865391 1 recorder.go:75] Recording config/proxy with fingerprint=0d6caa90d7d1d21d62a2b5cbe73d688142fdae77dce921e969e1e3c00f5cda2e I0513 00:04:05.865410 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 27.289981ms to process 1 records I0513 00:04:05.865552 1 tasks_processing.go:74] worker 35 stopped. I0513 00:04:05.865717 1 recorder.go:75] Recording config/featuregate with fingerprint=b39e70290d63861447ad1ddd01edc5b51a8ce399885f9c3ab6174610520de7d0 I0513 00:04:05.865736 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 28.358217ms to process 1 records I0513 00:04:05.865992 1 gather_logs.go:145] no pods in namespace were found I0513 00:04:05.866007 1 tasks_processing.go:74] worker 29 stopped. I0513 00:04:05.866016 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 28.402354ms to process 0 records W0513 00:04:05.866040 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0513 00:04:05.871451 1 tasks_processing.go:74] worker 40 stopped. I0513 00:04:05.871473 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 33.608312ms to process 0 records E0513 00:04:05.871489 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0513 00:04:05.871496 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 33.019323ms to process 0 records I0513 00:04:05.871503 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 33.454038ms to process 0 records I0513 00:04:05.871508 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 33.468386ms to process 0 records I0513 00:04:05.871514 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 33.740212ms to process 0 records I0513 00:04:05.871522 1 tasks_processing.go:74] worker 10 stopped. I0513 00:04:05.871527 1 tasks_processing.go:74] worker 56 stopped. I0513 00:04:05.871531 1 tasks_processing.go:74] worker 52 stopped. I0513 00:04:05.871542 1 tasks_processing.go:74] worker 5 stopped. I0513 00:04:05.871531 1 tasks_processing.go:74] worker 63 stopped. I0513 00:04:05.871553 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 33.682651ms to process 0 records I0513 00:04:05.871627 1 tasks_processing.go:74] worker 18 stopped. I0513 00:04:05.871671 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=019524e01758f47777fc305acbdbb0ad8128212554f66d7638565a2eeaf6dba9 I0513 00:04:05.871691 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=54f4324e433c3c4e55e3560c6cbf4b78e9bfca9df7c0de2ff7d9177fb7ccf52d I0513 00:04:05.871699 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 33.358159ms to process 2 records I0513 00:04:05.872340 1 tasks_processing.go:74] worker 6 stopped. I0513 00:04:05.872353 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 34.032383ms to process 0 records I0513 00:04:05.872368 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 33.929826ms to process 0 records I0513 00:04:05.872374 1 tasks_processing.go:74] worker 41 stopped. I0513 00:04:05.872556 1 tasks_processing.go:74] worker 27 stopped. I0513 00:04:05.872570 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 34.603422ms to process 0 records I0513 00:04:05.878100 1 tasks_processing.go:74] worker 42 stopped. E0513 00:04:05.878137 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0513 00:04:05.878154 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 40.348971ms to process 0 records I0513 00:04:05.878653 1 tasks_processing.go:74] worker 15 stopped. I0513 00:04:05.879151 1 recorder.go:75] Recording config/network with fingerprint=04219b39cf9ac017c5187befc5121fc18b06134a322dd15487b9f5f31bef3340 I0513 00:04:05.879238 1 gather.go:177] gatherer "clusterconfig" function "networks" took 40.426942ms to process 1 records I0513 00:04:05.879843 1 tasks_processing.go:74] worker 22 stopped. I0513 00:04:05.879872 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0513 00:04:05.879883 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 42.387604ms to process 1 records I0513 00:04:05.881889 1 tasks_processing.go:74] worker 17 stopped. I0513 00:04:05.881984 1 recorder.go:75] Recording config/olm_operators with fingerprint=b0185fe029daecd1935b52b74b919d7af565e52a01eb93d39aa5cf34cd66af1f I0513 00:04:05.882012 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 46.629384ms to process 1 records I0513 00:04:05.882103 1 tasks_processing.go:74] worker 33 stopped. I0513 00:04:05.882268 1 recorder.go:75] Recording config/authentication with fingerprint=08ed602300039be025579dea51051c34ba483e1fc2d53c647c21ffc0a31fe69e I0513 00:04:05.882281 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 43.589422ms to process 1 records I0513 00:04:05.885476 1 tasks_processing.go:74] worker 46 stopped. I0513 00:04:05.885700 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=82deb90f026889d5983b219748963f2668aa7d5350d98d222bbf7936091f6ebf I0513 00:04:05.885717 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 47.437423ms to process 1 records I0513 00:04:05.885800 1 tasks_processing.go:74] worker 53 stopped. I0513 00:04:05.885892 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=2463e09bf90acc8924f27690ae9ec99036d516291b819bf30b6385e3f533d509 I0513 00:04:05.885984 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=441b5a9f800531c0a83d7232d8b164ee4493b206399e9a036d3de9de701c04a9 I0513 00:04:05.885996 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 49.909444ms to process 2 records I0513 00:04:05.886387 1 tasks_processing.go:74] worker 55 stopped. I0513 00:04:05.887101 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=e1abbe4d0beba5f7e5fee42bc7561c0427b9af9e87a684a09ad3c48077d5a14f I0513 00:04:05.887324 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=7622966906e6d6932b7120ff8fc9a6d0d4c06b3281c6d951b07bd64b01184e22 I0513 00:04:05.887335 1 gather.go:177] gatherer "clusterconfig" function "crds" took 51.117997ms to process 2 records I0513 00:04:05.887347 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 48.729857ms to process 0 records I0513 00:04:05.887354 1 tasks_processing.go:74] worker 47 stopped. I0513 00:04:05.888988 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0513 00:04:05.889005 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0513 00:04:05.889201 1 operator.go:288] started I0513 00:04:05.889222 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0513 00:04:05.892754 1 tasks_processing.go:74] worker 24 stopped. I0513 00:04:05.892925 1 recorder.go:75] Recording config/apiserver with fingerprint=9ae54541fe08471fa904483b372ce04d85528df5ddd6e0feac26e7dce68d029f I0513 00:04:05.892944 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 54.630696ms to process 1 records I0513 00:04:05.893379 1 tasks_processing.go:74] worker 51 stopped. I0513 00:04:05.893711 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=69f0968101e1b082af551e54bc1991b8989d67dbe8feeea8adc0ec9ae692c90b I0513 00:04:05.893726 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 54.957156ms to process 1 records I0513 00:04:05.894761 1 tasks_processing.go:74] worker 36 stopped. I0513 00:04:05.894823 1 recorder.go:75] Recording config/running_containers with fingerprint=6c5da0a8b78722d5e6f90251dd16c1ffe98c071f891e9912bed30dd7b032bdcd I0513 00:04:05.894836 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 59.509081ms to process 1 records I0513 00:04:05.896735 1 tasks_processing.go:74] worker 9 stopped. I0513 00:04:05.896753 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 61.040339ms to process 0 records I0513 00:04:05.899196 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0513 00:04:05.899200 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0513 00:04:05.899220 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0513 00:04:05.899854 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0513 00:04:05.899868 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0513 00:04:05.899871 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0513 00:04:05.899876 1 controller.go:212] Source scaController *sca.Controller is not ready I0513 00:04:05.899879 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0513 00:04:05.899896 1 controller.go:489] The operator is still being initialized I0513 00:04:05.899902 1 controller.go:512] The operator is healthy I0513 00:04:05.905224 1 base_controller.go:82] Caches are synced for ConfigController I0513 00:04:05.905242 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0513 00:04:05.905317 1 tasks_processing.go:74] worker 54 stopped. I0513 00:04:05.905433 1 prometheus_rules.go:88] Prometheus rules successfully created I0513 00:04:05.906825 1 recorder.go:75] Recording config/version with fingerprint=5658b0f82398d46feaf730965256794bc285e24b4b73b1408252def688883176 I0513 00:04:05.907395 1 recorder.go:75] Recording config/id with fingerprint=f696aa343e66301012a82cbd4ab7b08d194fdf2d20f59ebcb1209961548101bc I0513 00:04:05.907742 1 gather.go:177] gatherer "clusterconfig" function "version" took 66.879653ms to process 2 records E0513 00:04:05.907762 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0513 00:04:05.907769 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0513 00:04:05.907774 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0513 00:04:05.907783 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0513 00:04:05.907813 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0513 00:04:05.907821 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0513 00:04:05.907825 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0513 00:04:05.907829 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0513 00:04:05.907845 1 tasks_processing.go:74] worker 13 stopped. I0513 00:04:05.907873 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0513 00:04:05.907885 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0513 00:04:05.907890 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 71.313277ms to process 7 records E0513 00:04:05.908461 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27f66144b2-ad01-40eb-8262-5243021ff265%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.12:60086->172.30.0.10:53: read: connection refused I0513 00:04:05.908475 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27f66144b2-ad01-40eb-8262-5243021ff265%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.12:60086->172.30.0.10:53: read: connection refused I0513 00:04:05.910347 1 tasks_processing.go:74] worker 38 stopped. I0513 00:04:05.910448 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=dc183f5e770d6f5a54d4be3ddb3ee01597bb745887da3a09403f7df40a3348bd I0513 00:04:05.910470 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=301661f0af759b3c1de70958b5e43cf07fbc53109cab990c98406ce36aa8fc07 I0513 00:04:05.910485 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=a763c7a98ac7a63c7f0b08992652137260063033bfe7c81d13d61cfd2f84f669 I0513 00:04:05.910494 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 71.898139ms to process 3 records I0513 00:04:05.910493 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0513 00:04:05.913523 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.12:54819->172.30.0.10:53: read: connection refused I0513 00:04:05.913539 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.12:54819->172.30.0.10:53: read: connection refused I0513 00:04:05.913742 1 configmapobserver.go:84] configmaps "insights-config" not found I0513 00:04:05.990101 1 base_controller.go:82] Caches are synced for LoggingSyncer I0513 00:04:05.990123 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0513 00:04:05.991262 1 tasks_processing.go:74] worker 49 stopped. E0513 00:04:05.991286 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0513 00:04:05.991294 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2q8mpfhpdc5gp552rut06rdt9cd93sqc-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2q8mpfhpdc5gp552rut06rdt9cd93sqc-primary-cert-bundle-secret" not found I0513 00:04:05.991360 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=39bdfc1fa61411a130d23b362f6be9129149eb8c5dcc2cc7987fd0bac261f3bc I0513 00:04:05.991374 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 154.410595ms to process 1 records I0513 00:04:06.003164 1 tasks_processing.go:74] worker 11 stopped. I0513 00:04:06.003219 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0513 00:04:06.003241 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 165.112603ms to process 1 records I0513 00:04:06.303984 1 gather_cluster_operator_pods_and_events.go:121] Found 19 pods with 22 containers I0513 00:04:06.304000 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1143901 bytes I0513 00:04:06.304424 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-k5xt8 pod in namespace openshift-dns (previous: false). I0513 00:04:06.549363 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-k5xt8 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-k5xt8\" is waiting to start: ContainerCreating" I0513 00:04:06.549384 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-k5xt8\" is waiting to start: ContainerCreating" I0513 00:04:06.549392 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-k5xt8 pod in namespace openshift-dns (previous: false). I0513 00:04:06.704359 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-k5xt8 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-k5xt8\" is waiting to start: ContainerCreating" I0513 00:04:06.704381 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-k5xt8\" is waiting to start: ContainerCreating" I0513 00:04:06.704413 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-t6pzb pod in namespace openshift-dns (previous: false). W0513 00:04:06.862391 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0513 00:04:06.929798 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-t6pzb pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-t6pzb\" is waiting to start: ContainerCreating" I0513 00:04:06.929818 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-t6pzb\" is waiting to start: ContainerCreating" I0513 00:04:06.929828 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-t6pzb pod in namespace openshift-dns (previous: false). I0513 00:04:07.114195 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-t6pzb pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-t6pzb\" is waiting to start: ContainerCreating" I0513 00:04:07.114215 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-t6pzb\" is waiting to start: ContainerCreating" I0513 00:04:07.114246 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-wpbv5 pod in namespace openshift-dns (previous: false). I0513 00:04:07.298938 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0513 00:04:07.327683 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-wpbv5 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-wpbv5\" is waiting to start: ContainerCreating" I0513 00:04:07.327706 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-wpbv5\" is waiting to start: ContainerCreating" I0513 00:04:07.327715 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-wpbv5 pod in namespace openshift-dns (previous: false). I0513 00:04:07.503923 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-wpbv5 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-wpbv5\" is waiting to start: ContainerCreating" I0513 00:04:07.503942 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-wpbv5\" is waiting to start: ContainerCreating" I0513 00:04:07.503954 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-b2rjb pod in namespace openshift-dns (previous: false). I0513 00:04:07.701929 1 tasks_processing.go:74] worker 34 stopped. I0513 00:04:07.701983 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=3b879cada68690e20ec8a018f9ee6a93e0d9c87a0d626b9392311a85f9c7591c I0513 00:04:07.702010 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=7708a6567e6ebda31d644ec27eb8c09e7e23d8a78c146a78a5de408f053eeb52 I0513 00:04:07.702041 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0513 00:04:07.702068 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=7ce8862a2fc06fe01b00c8cf6120ee0b5c402bf7ff1d82d956a42729e98451f5 I0513 00:04:07.702084 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0513 00:04:07.702125 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=d52fb4d2aed51cf92d5e93b0245777ef36e3587873c8e9af8ab47f6180efcb16 I0513 00:04:07.702155 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=dfd47162cb81c7e9759559d74ae52b16fe047cbba1a1a74696ee5e9249dde4e3 I0513 00:04:07.702199 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=4efb2d6eade8fe7429178b8a877c92fa9bd25828ea96cebad9fd787bf2e0bfe8 I0513 00:04:07.702215 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=087f449e4f9043e10c307020909093c9c4031b7333532ea7de2f80cd441d917d I0513 00:04:07.702233 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=a7ad412812960e848213beebb4db791c2365fa12ddaeebc5ddd74683fee02e97 I0513 00:04:07.702242 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0513 00:04:07.702259 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=833aa2e21874e932066b0b6da24331c23674b19cbb9695b3181dbec846f337ca I0513 00:04:07.702270 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0513 00:04:07.702285 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=1005f2cd272b02f211fcf833d6c8c2497a5d0dc050ac4aeefcfe5c2140802b8d I0513 00:04:07.702296 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0513 00:04:07.702310 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=16b77e99c96203c30801041706259f1b5d47d39b75cc140bd326e4633e5813aa I0513 00:04:07.702319 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0513 00:04:07.702334 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=dc298751e1928a1f82896a012d97ab37b1fac1c8e313c132277faeb6df328025 I0513 00:04:07.702442 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=9510efd3705fb81b522ca1b4d7e6a494e9952450e0836b07eba70d476f9429f4 I0513 00:04:07.702452 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0513 00:04:07.702459 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0513 00:04:07.702479 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0513 00:04:07.702500 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=f77703f57775e3b112176e3e85f92fe375067ff9f4d6f5663d2cbc6e8b92c9f0 I0513 00:04:07.702525 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=bf62242b4f3c57deec37653366ed85a94003a3caa9e9c66c8bbb17bb082a4dd1 I0513 00:04:07.702534 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0513 00:04:07.702552 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=27eac69a04dbb6f86c964d8eec55d1ed33633ffda552eb61f1f5dcbe70b6a74b I0513 00:04:07.702561 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0513 00:04:07.702574 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=3ce4fc96d18a5203be2e6b88f02da4613da460e38340c93af95e66f0d9bcb510 I0513 00:04:07.702590 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=a822f9a1691620b4a32cc994e3e949d7aa44c98a78430a13dc38af3acb22aa36 I0513 00:04:07.702605 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=8eba7ffa6347651f3b35cb4f6a5f483c43c93679822a6b66bd4e6c64332b5247 I0513 00:04:07.702621 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=770689cbe62c0176ea22683950c5cfb931f93dcc8669ce23c0e14c6961039369 I0513 00:04:07.702635 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=6ef64320a1ecc8dce261f147999b99b28d74ad61994283d07e39112bb25c5ca6 I0513 00:04:07.702662 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=751e190742552b2669ce75eb36eeea78f64915467f1d5c12a25da7a02ded318a I0513 00:04:07.702677 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0513 00:04:07.702685 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0513 00:04:07.702692 1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.866214821s to process 35 records I0513 00:04:07.704272 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0513 00:04:07.704287 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-s2wpg pod in namespace openshift-dns (previous: false). W0513 00:04:07.862678 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0513 00:04:07.907607 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0513 00:04:07.907628 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-zpxx6 pod in namespace openshift-dns (previous: false). I0513 00:04:08.104397 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0513 00:04:08.104418 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for image-pruner container image-pruner-29643840-l7gxj pod in namespace openshift-image-registry (previous: false). I0513 00:04:08.305923 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5d5dbc4df9-mph4l pod in namespace openshift-image-registry (previous: false). I0513 00:04:08.503592 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5d5dbc4df9-mph4l pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5d5dbc4df9-mph4l\" is waiting to start: ContainerCreating" I0513 00:04:08.503614 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5d5dbc4df9-mph4l\" is waiting to start: ContainerCreating" I0513 00:04:08.503661 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6dbd8bd4bd-lwnsn pod in namespace openshift-image-registry (previous: false). I0513 00:04:08.703827 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6dbd8bd4bd-lwnsn pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6dbd8bd4bd-lwnsn\" is waiting to start: ContainerCreating" I0513 00:04:08.703850 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6dbd8bd4bd-lwnsn\" is waiting to start: ContainerCreating" I0513 00:04:08.703926 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6dbd8bd4bd-m6ls8 pod in namespace openshift-image-registry (previous: false). W0513 00:04:08.862189 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0513 00:04:08.903814 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6dbd8bd4bd-m6ls8 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6dbd8bd4bd-m6ls8\" is waiting to start: ContainerCreating" I0513 00:04:08.903832 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6dbd8bd4bd-m6ls8\" is waiting to start: ContainerCreating" I0513 00:04:08.903843 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-bz2bc pod in namespace openshift-image-registry (previous: false). I0513 00:04:09.103976 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0513 00:04:09.103997 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-dw7q8 pod in namespace openshift-image-registry (previous: false). I0513 00:04:09.306903 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0513 00:04:09.306924 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-jkhdc pod in namespace openshift-image-registry (previous: false). I0513 00:04:09.504461 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0513 00:04:09.504483 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6868f5767b-q4c9m pod in namespace openshift-ingress (previous: false). I0513 00:04:09.703840 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6868f5767b-q4c9m pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6868f5767b-q4c9m\" is waiting to start: ContainerCreating" I0513 00:04:09.703858 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6868f5767b-q4c9m\" is waiting to start: ContainerCreating" I0513 00:04:09.703869 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6868f5767b-ss8pm pod in namespace openshift-ingress (previous: false). W0513 00:04:09.862758 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0513 00:04:09.903839 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6868f5767b-ss8pm pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6868f5767b-ss8pm\" is waiting to start: ContainerCreating" I0513 00:04:09.903862 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6868f5767b-ss8pm\" is waiting to start: ContainerCreating" I0513 00:04:09.903876 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-857ddbf8cc-dt2fx pod in namespace openshift-ingress (previous: false). I0513 00:04:10.104199 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-857ddbf8cc-dt2fx pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-857ddbf8cc-dt2fx\" is waiting to start: ContainerCreating" I0513 00:04:10.104219 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-857ddbf8cc-dt2fx\" is waiting to start: ContainerCreating" I0513 00:04:10.104256 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-h2ptj pod in namespace openshift-ingress-canary (previous: false). I0513 00:04:10.306623 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-h2ptj pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-h2ptj\" is waiting to start: ContainerCreating" I0513 00:04:10.306643 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-h2ptj\" is waiting to start: ContainerCreating" I0513 00:04:10.306676 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-mq44t pod in namespace openshift-ingress-canary (previous: false). I0513 00:04:10.504049 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-mq44t pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-mq44t\" is waiting to start: ContainerCreating" I0513 00:04:10.504068 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-mq44t\" is waiting to start: ContainerCreating" I0513 00:04:10.504100 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-xlwtq pod in namespace openshift-ingress-canary (previous: false). I0513 00:04:10.705020 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-xlwtq pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-xlwtq\" is waiting to start: ContainerCreating" I0513 00:04:10.705042 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-xlwtq\" is waiting to start: ContainerCreating" I0513 00:04:10.705066 1 tasks_processing.go:74] worker 25 stopped. I0513 00:04:10.705159 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=8c3205b33707e3350d4b07f420aaf01ba4bcbdddc8a78a64a47929fe7ad44143 I0513 00:04:10.705245 1 recorder.go:75] Recording events/openshift-dns with fingerprint=4f54ed06181a50ed52620ddcb9b7b596824504e93fc6d481192e7fb9e1e43680 I0513 00:04:10.705358 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=23cfaf26200bab6eabb11407cd3bcc8e26b30a60635ebd981626e718ac449fde I0513 00:04:10.705400 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=c499efeeb1b25e4f3cf16325b909eddd80685a660239433f3ad7d185036c8943 I0513 00:04:10.705462 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=8ce1acd62f76f273160e5bf46866e68e462204d8b5edc10c897f7396109c41d8 I0513 00:04:10.705494 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=cf0a7718e51e2ebdb82df5715d8829a256345ca24e2ddf54995ccc3f1fffa9e0 I0513 00:04:10.706863 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-k5xt8 with fingerprint=68a2e677d7675635071151441c337d3005501a81307f1a1ccdc140c188ebc942 I0513 00:04:10.706982 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-t6pzb with fingerprint=f5a7c727046d633b4f97bfcfd53214a2e1ca4db7ab222f9129b05779869838f4 I0513 00:04:10.707071 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-wpbv5 with fingerprint=fc06b31a7902bb3abb32c92134c4f305708861b18389418ea6adc56d65daf2ce I0513 00:04:10.707105 1 recorder.go:75] Recording config/pod/openshift-image-registry/logs/image-pruner-29643840-l7gxj/image-pruner_current.log with fingerprint=b39a81b8d7dc572267018900cecc9232bcef1bd923aa9513370c514ffe1ca4df I0513 00:04:10.707275 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-5d5dbc4df9-mph4l with fingerprint=15651e647eb2a6963579b4c4dde9a266839047b65cbc69f3f89125a343089ef9 I0513 00:04:10.707434 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-6dbd8bd4bd-lwnsn with fingerprint=7788544e294e111814ac58d8bc658d09d43ae1edfc7fc58ee938e42ba5dbc7f9 I0513 00:04:10.707593 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-6dbd8bd4bd-m6ls8 with fingerprint=bf435fb70c0196177edf93560b3e56476a289c0ba4ec7ca0c78b90d056e19cb3 I0513 00:04:10.707685 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-h2ptj with fingerprint=f17df857c0c88fe5150f10ad2e9067684be1f886ccdd7b61fffad6618fc74acd I0513 00:04:10.707778 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-mq44t with fingerprint=4a86e43a57370f2003a51c5720ff698506f41d5090ff0c7cff1769e51f086ea7 I0513 00:04:10.707871 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-xlwtq with fingerprint=2b240a6d55d4a78ff3099f1830c4b0cf2880798d0ef4ee6ad24d68a55d7a7851 I0513 00:04:10.707884 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.866847818s to process 16 records W0513 00:04:10.862630 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0513 00:04:10.862658 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0513 00:04:10.862674 1 tasks_processing.go:74] worker 12 stopped. E0513 00:04:10.862687 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0513 00:04:10.862698 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0513 00:04:10.862712 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0513 00:04:10.862725 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.026955469s to process 1 records I0513 00:04:18.473356 1 tasks_processing.go:74] worker 60 stopped. I0513 00:04:18.473399 1 recorder.go:75] Recording config/installplans with fingerprint=95dfd5f33a9a46199239158a0ec0183b629818eca24ae41f4d706d7a3d604aec I0513 00:04:18.473410 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.636371465s to process 1 records I0513 00:04:19.038286 1 configmapobserver.go:84] configmaps "insights-config" not found I0513 00:04:19.243550 1 tasks_processing.go:74] worker 3 stopped. I0513 00:04:19.243827 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=a7a4de02df1cc1abdf9107bf21a9d837b0f58083251a7f44b02bf3cc6249ecc3 I0513 00:04:19.243844 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.406099868s to process 1 records E0513 00:04:19.243902 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.408s with: function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0513 00:04:19.245017 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0513 00:04:19.245034 1 periodic.go:209] Running workloads gatherer I0513 00:04:19.245054 1 tasks_processing.go:45] number of workers: 2 I0513 00:04:19.245064 1 tasks_processing.go:69] worker 1 listening for tasks. I0513 00:04:19.245068 1 tasks_processing.go:71] worker 1 working on workload_info task. I0513 00:04:19.245081 1 tasks_processing.go:69] worker 0 listening for tasks. I0513 00:04:19.245097 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0513 00:04:19.277921 1 tasks_processing.go:74] worker 0 stopped. I0513 00:04:19.277944 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 32.804813ms to process 0 records I0513 00:04:19.363653 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0513 00:04:19.373282 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (10ms) I0513 00:04:19.384187 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (11ms) I0513 00:04:19.393472 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (9ms) I0513 00:04:19.402719 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (9ms) I0513 00:04:19.412413 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (10ms) I0513 00:04:19.421857 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (9ms) I0513 00:04:19.431342 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (9ms) I0513 00:04:19.441365 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (10ms) I0513 00:04:19.450970 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (10ms) I0513 00:04:19.460875 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (10ms) I0513 00:04:19.472220 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (11ms) I0513 00:04:19.573838 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (102ms) I0513 00:04:19.673640 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (100ms) I0513 00:04:19.774137 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (100ms) I0513 00:04:19.873562 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (99ms) I0513 00:04:19.973356 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (100ms) I0513 00:04:20.073589 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (100ms) I0513 00:04:20.173626 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (100ms) I0513 00:04:20.187518 1 configmapobserver.go:84] configmaps "insights-config" not found I0513 00:04:20.273925 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (100ms) I0513 00:04:20.374580 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (101ms) I0513 00:04:20.385916 1 configmapobserver.go:84] configmaps "insights-config" not found I0513 00:04:20.473662 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (99ms) I0513 00:04:20.574577 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (101ms) I0513 00:04:20.674344 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (100ms) I0513 00:04:20.774995 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (101ms) I0513 00:04:20.876277 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (101ms) I0513 00:04:20.974075 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (98ms) I0513 00:04:21.073940 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (100ms) I0513 00:04:21.174046 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (100ms) I0513 00:04:21.276250 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (102ms) I0513 00:04:21.374795 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (99ms) I0513 00:04:21.473393 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (99ms) I0513 00:04:21.583440 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (110ms) I0513 00:04:21.583473 1 tasks_processing.go:74] worker 1 stopped. E0513 00:04:21.583483 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0513 00:04:21.583783 1 recorder.go:75] Recording config/workload_info with fingerprint=3d8811d20adcf8ca09d3efdeb7c309c6419ae62d6a86799aceb198c4ffb0d4bc I0513 00:04:21.583800 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.338398702s to process 1 records E0513 00:04:21.583824 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.338s with: function \"workload_info\" failed with an error" I0513 00:04:21.584935 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0513 00:04:21.584952 1 periodic.go:209] Running conditional gatherer I0513 00:04:21.598250 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0513 00:04:21.606418 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.12:44050->172.30.0.10:53: read: connection refused E0513 00:04:21.606717 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0513 00:04:21.606781 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0513 00:04:21.625292 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0513 00:04:21.625310 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0513 00:04:21.625316 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0513 00:04:21.625319 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0513 00:04:21.625322 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0513 00:04:21.625325 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0513 00:04:21.625328 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0513 00:04:21.625331 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0513 00:04:21.625334 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0513 00:04:21.625337 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0513 00:04:21.625354 1 tasks_processing.go:45] number of workers: 3 I0513 00:04:21.625361 1 tasks_processing.go:69] worker 2 listening for tasks. I0513 00:04:21.625365 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0513 00:04:21.625374 1 tasks_processing.go:69] worker 0 listening for tasks. I0513 00:04:21.625385 1 tasks_processing.go:69] worker 1 listening for tasks. I0513 00:04:21.625402 1 tasks_processing.go:74] worker 1 stopped. I0513 00:04:21.625403 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0513 00:04:21.625415 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0513 00:04:21.625452 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0513 00:04:21.625465 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 821ns to process 1 records I0513 00:04:21.625497 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0513 00:04:21.625505 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.762µs to process 1 records I0513 00:04:21.625510 1 tasks_processing.go:74] worker 0 stopped. I0513 00:04:21.625685 1 tasks_processing.go:74] worker 2 stopped. I0513 00:04:21.625697 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 254.961µs to process 0 records I0513 00:04:21.625720 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.12:44050->172.30.0.10:53: read: connection refused I0513 00:04:21.625739 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0513 00:04:21.671019 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=b5adf17a48f5b094d8af31cf4eb7e3a5f81089d9b3ab257125da205fb4485f64 I0513 00:04:21.671189 1 diskrecorder.go:70] Writing 110 records to /var/lib/insights-operator/insights-2026-05-13-000421.tar.gz I0513 00:04:21.678439 1 diskrecorder.go:51] Wrote 110 records to disk in 7ms I0513 00:04:21.678482 1 periodic.go:278] Gathering cluster info every 2h0m0s I0513 00:04:21.678498 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0513 00:04:28.822210 1 configmapobserver.go:84] configmaps "insights-config" not found I0513 00:05:30.335549 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="68c3256b9ad755b0415aa3c9c53de14fa0f9bfc54956d4b978007fa54d4f0bc0") W0513 00:05:30.335584 1 builder.go:160] Restart triggered because of file /var/run/configmaps/service-ca-bundle/service-ca.crt was created I0513 00:05:30.335646 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="6ec8091da28d110f3b6f5fa2c5dc3e45bfdf541e5b8fb30cb162b0f766f90ac8") I0513 00:05:30.335652 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0513 00:05:30.335701 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="6ee73a03f44813c8742e30c0ce330d54242bbe17eecc4ebe9d93b97c80eec3a8") I0513 00:05:30.335727 1 base_controller.go:181] Shutting down LoggingSyncer ... I0513 00:05:30.335849 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0513 00:05:30.335866 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0513 00:05:30.335895 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"