W0421 15:04:02.544150 1 cmd.go:257] Using insecure, self-signed certificates I0421 15:04:03.233103 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0421 15:04:03.233420 1 observer_polling.go:159] Starting file observer I0421 15:04:03.747895 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0421 15:04:03.749136 1 secure_serving.go:57] Forcing use of http/1.1 only W0421 15:04:03.749359 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0421 15:04:03.749373 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0421 15:04:03.749377 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0421 15:04:03.749380 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0421 15:04:03.749383 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0421 15:04:03.749385 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0421 15:04:03.749388 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0421 15:04:03.749959 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0421 15:04:03.754460 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0421 15:04:03.754526 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"c6489fe6-a217-4aa1-b29e-8ed14357ad29", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0421 15:04:03.755014 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0421 15:04:03.755022 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0421 15:04:03.755036 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0421 15:04:03.755024 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0421 15:04:03.755067 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0421 15:04:03.755030 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0421 15:04:03.755301 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-3782072748/tls.crt::/tmp/serving-cert-3782072748/tls.key" I0421 15:04:03.755522 1 secure_serving.go:213] Serving securely on [::]:8443 I0421 15:04:03.755547 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0421 15:04:03.761453 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0421 15:04:03.761476 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0421 15:04:03.761578 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0421 15:04:03.766807 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0421 15:04:03.766823 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0421 15:04:03.771669 1 secretconfigobserver.go:119] support secret does not exist I0421 15:04:03.776495 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0421 15:04:03.781153 1 secretconfigobserver.go:119] support secret does not exist I0421 15:04:03.783643 1 recorder.go:161] Pruning old reports every 7h3m10s, max age is 288h0m0s I0421 15:04:03.789385 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0421 15:04:03.789408 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0421 15:04:03.789419 1 periodic.go:209] Running clusterconfig gatherer I0421 15:04:03.789388 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0421 15:04:03.789434 1 insightsreport.go:296] Starting report retriever I0421 15:04:03.789438 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0421 15:04:03.789456 1 tasks_processing.go:45] number of workers: 64 I0421 15:04:03.789483 1 tasks_processing.go:69] worker 5 listening for tasks. I0421 15:04:03.789495 1 tasks_processing.go:69] worker 3 listening for tasks. I0421 15:04:03.789495 1 tasks_processing.go:69] worker 0 listening for tasks. I0421 15:04:03.789498 1 tasks_processing.go:71] worker 5 working on nodenetworkconfigurationpolicies task. I0421 15:04:03.789504 1 tasks_processing.go:69] worker 34 listening for tasks. I0421 15:04:03.789502 1 tasks_processing.go:69] worker 4 listening for tasks. I0421 15:04:03.789507 1 tasks_processing.go:69] worker 1 listening for tasks. I0421 15:04:03.789513 1 tasks_processing.go:71] worker 4 working on openstack_dataplanedeployments task. I0421 15:04:03.789515 1 tasks_processing.go:69] worker 19 listening for tasks. I0421 15:04:03.789504 1 tasks_processing.go:71] worker 0 working on service_accounts task. I0421 15:04:03.789520 1 tasks_processing.go:69] worker 42 listening for tasks. I0421 15:04:03.789523 1 tasks_processing.go:71] worker 19 working on operators_pods_and_events task. I0421 15:04:03.789529 1 tasks_processing.go:69] worker 43 listening for tasks. I0421 15:04:03.789534 1 tasks_processing.go:69] worker 44 listening for tasks. I0421 15:04:03.789528 1 tasks_processing.go:69] worker 41 listening for tasks. I0421 15:04:03.789539 1 tasks_processing.go:69] worker 45 listening for tasks. I0421 15:04:03.789544 1 tasks_processing.go:69] worker 46 listening for tasks. I0421 15:04:03.789546 1 tasks_processing.go:69] worker 35 listening for tasks. I0421 15:04:03.789544 1 tasks_processing.go:69] worker 56 listening for tasks. I0421 15:04:03.789555 1 tasks_processing.go:69] worker 36 listening for tasks. I0421 15:04:03.789555 1 tasks_processing.go:69] worker 47 listening for tasks. I0421 15:04:03.789562 1 tasks_processing.go:69] worker 48 listening for tasks. I0421 15:04:03.789561 1 tasks_processing.go:69] worker 60 listening for tasks. I0421 15:04:03.789570 1 tasks_processing.go:69] worker 37 listening for tasks. I0421 15:04:03.789516 1 tasks_processing.go:71] worker 1 working on openstack_controlplanes task. I0421 15:04:03.789577 1 tasks_processing.go:69] worker 16 listening for tasks. I0421 15:04:03.789579 1 tasks_processing.go:69] worker 52 listening for tasks. I0421 15:04:03.789578 1 tasks_processing.go:69] worker 62 listening for tasks. I0421 15:04:03.789587 1 tasks_processing.go:69] worker 15 listening for tasks. I0421 15:04:03.789564 1 tasks_processing.go:69] worker 50 listening for tasks. I0421 15:04:03.789581 1 tasks_processing.go:69] worker 38 listening for tasks. I0421 15:04:03.789589 1 tasks_processing.go:69] worker 39 listening for tasks. I0421 15:04:03.789595 1 tasks_processing.go:69] worker 61 listening for tasks. I0421 15:04:03.789596 1 tasks_processing.go:69] worker 40 listening for tasks. I0421 15:04:03.789602 1 tasks_processing.go:69] worker 53 listening for tasks. I0421 15:04:03.789604 1 tasks_processing.go:69] worker 63 listening for tasks. I0421 15:04:03.789607 1 tasks_processing.go:69] worker 13 listening for tasks. I0421 15:04:03.789609 1 tasks_processing.go:69] worker 59 listening for tasks. I0421 15:04:03.789603 1 tasks_processing.go:69] worker 14 listening for tasks. I0421 15:04:03.789615 1 tasks_processing.go:69] worker 8 listening for tasks. I0421 15:04:03.789603 1 tasks_processing.go:69] worker 12 listening for tasks. I0421 15:04:03.789618 1 tasks_processing.go:69] worker 6 listening for tasks. I0421 15:04:03.789615 1 tasks_processing.go:69] worker 58 listening for tasks. I0421 15:04:03.789624 1 tasks_processing.go:69] worker 7 listening for tasks. I0421 15:04:03.789627 1 tasks_processing.go:69] worker 21 listening for tasks. I0421 15:04:03.789630 1 tasks_processing.go:69] worker 23 listening for tasks. I0421 15:04:03.789631 1 tasks_processing.go:69] worker 11 listening for tasks. I0421 15:04:03.789634 1 tasks_processing.go:69] worker 32 listening for tasks. I0421 15:04:03.789611 1 tasks_processing.go:69] worker 54 listening for tasks. I0421 15:04:03.789638 1 tasks_processing.go:69] worker 22 listening for tasks. I0421 15:04:03.789635 1 tasks_processing.go:69] worker 57 listening for tasks. I0421 15:04:03.789643 1 tasks_processing.go:69] worker 31 listening for tasks. I0421 15:04:03.789647 1 tasks_processing.go:69] worker 18 listening for tasks. I0421 15:04:03.789514 1 tasks_processing.go:69] worker 49 listening for tasks. I0421 15:04:03.789613 1 tasks_processing.go:69] worker 26 listening for tasks. I0421 15:04:03.789620 1 tasks_processing.go:69] worker 20 listening for tasks. I0421 15:04:03.789617 1 tasks_processing.go:69] worker 55 listening for tasks. I0421 15:04:03.789618 1 tasks_processing.go:69] worker 9 listening for tasks. I0421 15:04:03.789628 1 tasks_processing.go:69] worker 30 listening for tasks. I0421 15:04:03.789630 1 tasks_processing.go:69] worker 10 listening for tasks. I0421 15:04:03.789663 1 tasks_processing.go:69] worker 29 listening for tasks. I0421 15:04:03.789638 1 tasks_processing.go:69] worker 24 listening for tasks. I0421 15:04:03.789499 1 tasks_processing.go:71] worker 3 working on openstack_dataplanenodesets task. I0421 15:04:03.789571 1 tasks_processing.go:69] worker 51 listening for tasks. I0421 15:04:03.789495 1 tasks_processing.go:69] worker 2 listening for tasks. I0421 15:04:03.789725 1 tasks_processing.go:71] worker 42 working on node_logs task. I0421 15:04:03.789732 1 tasks_processing.go:71] worker 23 working on machines task. I0421 15:04:03.789734 1 tasks_processing.go:71] worker 63 working on image_registries task. I0421 15:04:03.789738 1 tasks_processing.go:71] worker 59 working on proxies task. I0421 15:04:03.789749 1 tasks_processing.go:71] worker 12 working on oauths task. I0421 15:04:03.789635 1 tasks_processing.go:69] worker 27 listening for tasks. I0421 15:04:03.789782 1 tasks_processing.go:71] worker 6 working on machine_healthchecks task. I0421 15:04:03.789787 1 tasks_processing.go:71] worker 27 working on sap_config task. I0421 15:04:03.789790 1 tasks_processing.go:71] worker 49 working on feature_gates task. I0421 15:04:03.789795 1 tasks_processing.go:71] worker 56 working on overlapping_namespace_uids task. I0421 15:04:03.789803 1 tasks_processing.go:71] worker 9 working on qemu_kubevirt_launcher_logs task. I0421 15:04:03.789819 1 tasks_processing.go:71] worker 10 working on storage_classes task. I0421 15:04:03.789643 1 tasks_processing.go:69] worker 25 listening for tasks. I0421 15:04:03.789508 1 tasks_processing.go:71] worker 34 working on machine_configs task. I0421 15:04:03.789877 1 tasks_processing.go:71] worker 20 working on jaegers task. I0421 15:04:03.789902 1 tasks_processing.go:71] worker 29 working on container_images task. I0421 15:04:03.789725 1 tasks_processing.go:71] worker 7 working on validating_webhook_configurations task. I0421 15:04:03.789720 1 tasks_processing.go:71] worker 62 working on nodes task. I0421 15:04:03.789648 1 tasks_processing.go:69] worker 17 listening for tasks. I0421 15:04:03.790105 1 tasks_processing.go:71] worker 17 working on infrastructures task. I0421 15:04:03.789725 1 tasks_processing.go:71] worker 51 working on ceph_cluster task. I0421 15:04:03.789729 1 tasks_processing.go:71] worker 2 working on pdbs task. I0421 15:04:03.789730 1 tasks_processing.go:71] worker 21 working on config_maps task. I0421 15:04:03.789640 1 tasks_processing.go:69] worker 33 listening for tasks. I0421 15:04:03.789730 1 tasks_processing.go:71] worker 15 working on openstack_version task. I0421 15:04:03.789734 1 tasks_processing.go:71] worker 13 working on machine_autoscalers task. I0421 15:04:03.789891 1 tasks_processing.go:71] worker 14 working on mutating_webhook_configurations task. I0421 15:04:03.789890 1 tasks_processing.go:71] worker 22 working on pod_network_connectivity_checks task. I0421 15:04:03.789890 1 tasks_processing.go:71] worker 58 working on container_runtime_configs task. I0421 15:04:03.789896 1 tasks_processing.go:71] worker 11 working on olm_operators task. I0421 15:04:03.789895 1 tasks_processing.go:71] worker 8 working on machine_config_pools task. I0421 15:04:03.789896 1 tasks_processing.go:71] worker 25 working on version task. I0421 15:04:03.789901 1 tasks_processing.go:71] worker 32 working on cluster_apiserver task. I0421 15:04:03.789901 1 tasks_processing.go:71] worker 60 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0421 15:04:03.789902 1 tasks_processing.go:71] worker 61 working on ingress task. I0421 15:04:03.789905 1 tasks_processing.go:71] worker 54 working on machine_sets task. I0421 15:04:03.789906 1 tasks_processing.go:71] worker 50 working on sap_datahubs task. I0421 15:04:03.789905 1 tasks_processing.go:71] worker 36 working on sap_pods task. I0421 15:04:03.789902 1 tasks_processing.go:71] worker 16 working on schedulers task. I0421 15:04:03.789910 1 tasks_processing.go:71] worker 38 working on storage_cluster task. I0421 15:04:03.789911 1 tasks_processing.go:71] worker 41 working on openshift_machine_api_events task. I0421 15:04:03.789912 1 tasks_processing.go:71] worker 47 working on authentication task. I0421 15:04:03.789916 1 tasks_processing.go:71] worker 43 working on ingress_certificates task. I0421 15:04:03.789914 1 tasks_processing.go:71] worker 39 working on aggregated_monitoring_cr_names task. I0421 15:04:03.789915 1 tasks_processing.go:71] worker 37 working on dvo_metrics task. I0421 15:04:03.789916 1 tasks_processing.go:71] worker 48 working on monitoring_persistent_volumes task. I0421 15:04:03.789921 1 tasks_processing.go:71] worker 46 working on lokistack task. I0421 15:04:03.789919 1 tasks_processing.go:71] worker 44 working on support_secret task. I0421 15:04:03.789922 1 tasks_processing.go:71] worker 52 working on image task. I0421 15:04:03.789923 1 tasks_processing.go:71] worker 55 working on certificate_signing_requests task. I0421 15:04:03.789925 1 tasks_processing.go:71] worker 45 working on image_pruners task. I0421 15:04:03.789926 1 tasks_processing.go:71] worker 30 working on openshift_logging task. I0421 15:04:03.789929 1 tasks_processing.go:71] worker 35 working on networks task. I0421 15:04:03.789932 1 tasks_processing.go:71] worker 31 working on nodenetworkstates task. I0421 15:04:03.789638 1 tasks_processing.go:69] worker 28 listening for tasks. I0421 15:04:03.791949 1 tasks_processing.go:71] worker 28 working on operators task. I0421 15:04:03.789931 1 tasks_processing.go:71] worker 26 working on install_plans task. I0421 15:04:03.789935 1 tasks_processing.go:71] worker 53 working on clusterroles task. I0421 15:04:03.789936 1 tasks_processing.go:71] worker 57 working on silenced_alerts task. W0421 15:04:03.792111 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0421 15:04:03.792125 1 tasks_processing.go:71] worker 57 working on metrics task. I0421 15:04:03.789937 1 tasks_processing.go:71] worker 40 working on cost_management_metrics_configs task. W0421 15:04:03.792144 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0421 15:04:03.792150 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 31.919µs to process 0 records I0421 15:04:03.792158 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 19.749µs to process 0 records I0421 15:04:03.792165 1 tasks_processing.go:74] worker 57 stopped. I0421 15:04:03.789938 1 tasks_processing.go:71] worker 18 working on active_alerts task. I0421 15:04:03.789928 1 tasks_processing.go:71] worker 24 working on crds task. I0421 15:04:03.790390 1 tasks_processing.go:71] worker 33 working on tsdb_status task. W0421 15:04:03.792310 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0421 15:04:03.792317 1 tasks_processing.go:74] worker 33 stopped. I0421 15:04:03.792322 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 15.611µs to process 0 records W0421 15:04:03.792226 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0421 15:04:03.792334 1 tasks_processing.go:74] worker 18 stopped. I0421 15:04:03.792346 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 115.774µs to process 0 records I0421 15:04:03.793838 1 tasks_processing.go:74] worker 1 stopped. I0421 15:04:03.793849 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 4.254531ms to process 0 records I0421 15:04:03.793856 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 4.165952ms to process 0 records I0421 15:04:03.793862 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 4.338108ms to process 0 records I0421 15:04:03.793861 1 tasks_processing.go:74] worker 3 stopped. I0421 15:04:03.793865 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 4.354086ms to process 0 records I0421 15:04:03.793872 1 tasks_processing.go:74] worker 4 stopped. I0421 15:04:03.793869 1 tasks_processing.go:74] worker 5 stopped. I0421 15:04:03.802207 1 tasks_processing.go:74] worker 13 stopped. I0421 15:04:03.802219 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 11.712054ms to process 0 records I0421 15:04:03.802225 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 12.041118ms to process 0 records I0421 15:04:03.802232 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 12.30615ms to process 0 records I0421 15:04:03.802235 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 11.832654ms to process 0 records I0421 15:04:03.802241 1 tasks_processing.go:74] worker 15 stopped. I0421 15:04:03.802245 1 tasks_processing.go:74] worker 51 stopped. I0421 15:04:03.802246 1 tasks_processing.go:74] worker 58 stopped. I0421 15:04:03.802248 1 tasks_processing.go:74] worker 20 stopped. I0421 15:04:03.802254 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 11.622637ms to process 0 records I0421 15:04:03.802347 1 tasks_processing.go:74] worker 6 stopped. E0421 15:04:03.802362 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0421 15:04:03.802374 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 12.550637ms to process 0 records E0421 15:04:03.802389 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0421 15:04:03.802408 1 gather.go:177] gatherer "clusterconfig" function "machines" took 12.616086ms to process 0 records I0421 15:04:03.802459 1 tasks_processing.go:74] worker 23 stopped. I0421 15:04:03.802496 1 recorder.go:75] Recording config/proxy with fingerprint=e8002389b845ea6fb2eba270ff9b918e8f8f0ee380a91a0841a1e621893612ce I0421 15:04:03.802508 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 12.62068ms to process 1 records I0421 15:04:03.802521 1 tasks_processing.go:74] worker 59 stopped. I0421 15:04:03.802591 1 tasks_processing.go:74] worker 49 stopped. I0421 15:04:03.802595 1 recorder.go:75] Recording config/featuregate with fingerprint=9007fc18b42b27236a3f6bc0a67605db909f8adc474e1ec8e4000b0909e653ed I0421 15:04:03.802604 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 12.69157ms to process 1 records I0421 15:04:03.802675 1 tasks_processing.go:74] worker 12 stopped. I0421 15:04:03.802773 1 recorder.go:75] Recording config/oauth with fingerprint=72f2bb897d13977f8e1cf72d1e47f6c9dc809d09026b26057cd5be360da833c5 I0421 15:04:03.802782 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 12.74902ms to process 1 records I0421 15:04:03.805212 1 tasks_processing.go:74] worker 22 stopped. E0421 15:04:03.805224 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0421 15:04:03.805231 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 14.639339ms to process 0 records I0421 15:04:03.805749 1 tasks_processing.go:74] worker 50 stopped. I0421 15:04:03.805770 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 14.610794ms to process 0 records I0421 15:04:03.815390 1 tasks_processing.go:74] worker 27 stopped. I0421 15:04:03.815405 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 25.595283ms to process 0 records I0421 15:04:03.815412 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 24.298474ms to process 0 records I0421 15:04:03.815417 1 tasks_processing.go:74] worker 54 stopped. I0421 15:04:03.815485 1 tasks_processing.go:74] worker 36 stopped. I0421 15:04:03.815499 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 24.261915ms to process 0 records I0421 15:04:03.815624 1 tasks_processing.go:74] worker 7 stopped. I0421 15:04:03.815798 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=c08caed91ad5b99d19901b5695afe7f3232c8a929a437ae2738df52388546953 I0421 15:04:03.815875 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=cf07d26eb14bc090fe357384a854785a22e9d9ff5a2f62afa6003766f04b78fd I0421 15:04:03.815892 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=87c5bad2c807bce0f10ac22d8c10d5c42e189243fe01437624b5a3bd3f438248 I0421 15:04:03.815914 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=938110c538e7baa6c408cb7918109269964e0ef7cc9432bcd39a555b63481884 I0421 15:04:03.815934 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=007226d2af954fdaeeb0deddd24128c3ee92d35e987869d0eaf8793e1b30a364 I0421 15:04:03.815956 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=ae2775baf819ec78e1abd4ec8387d51e911720afd72c88625a9bd35f2aac94b4 I0421 15:04:03.815981 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=8193b77e83081b3b07ece65654e2e2e165a37818d7b9755ca54418718e154fb6 I0421 15:04:03.816016 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=6e4b9dd0522970518e43d254d45717fac9b235066d56bbc39b03a60a66621686 I0421 15:04:03.816019 1 gather_logs.go:145] no pods in namespace were found I0421 15:04:03.816039 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=41b37aa395599e4bf8af670b35021248984ff9f8ff2dd6826bd975d0542ffad9 I0421 15:04:03.816069 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=07c3d3dbafc423e6da8c07acd7f13305f3ca0424c165fbd07f92b159fd98d024 I0421 15:04:03.816091 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=6d007e1609bdb408d484504456fb6293b6040766e98ba4b966d8db5b1dd40f05 I0421 15:04:03.816099 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 25.558759ms to process 11 records I0421 15:04:03.816110 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 24.34803ms to process 0 records I0421 15:04:03.816114 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 23.87693ms to process 0 records I0421 15:04:03.816117 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 24.012758ms to process 0 records I0421 15:04:03.816154 1 tasks_processing.go:74] worker 30 stopped. I0421 15:04:03.816162 1 tasks_processing.go:74] worker 38 stopped. I0421 15:04:03.816166 1 tasks_processing.go:74] worker 31 stopped. I0421 15:04:03.816210 1 tasks_processing.go:74] worker 17 stopped. I0421 15:04:03.816585 1 recorder.go:75] Recording config/infrastructure with fingerprint=333b6b1fc1a6b8ae346edd895588633f613813a0e04d4b85319cac5ae2b43494 I0421 15:04:03.816598 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 25.816527ms to process 1 records I0421 15:04:03.816608 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 26.216766ms to process 0 records I0421 15:04:03.816621 1 tasks_processing.go:74] worker 9 stopped. I0421 15:04:03.816659 1 recorder.go:75] Recording config/image with fingerprint=4842f762060d14cc5dccd8f82bce9cb473ca1de2163a1c4823d493481795b21f I0421 15:04:03.816667 1 gather.go:177] gatherer "clusterconfig" function "image" took 24.487092ms to process 1 records I0421 15:04:03.816684 1 tasks_processing.go:74] worker 52 stopped. I0421 15:04:03.816754 1 tasks_processing.go:74] worker 45 stopped. I0421 15:04:03.816839 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=1ff69e7dcb18ade58a1b8f9a16136df50eadb3186327760c1a01e1ddf6249f05 I0421 15:04:03.816848 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 24.685803ms to process 1 records I0421 15:04:03.819610 1 tasks_processing.go:74] worker 47 stopped. I0421 15:04:03.819758 1 recorder.go:75] Recording config/authentication with fingerprint=9e0237882114f8af37780751ccafbb5aea48256d36d3c7cb860775a502d7b4d4 I0421 15:04:03.819769 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 28.17704ms to process 1 records I0421 15:04:03.819842 1 tasks_processing.go:74] worker 10 stopped. I0421 15:04:03.819933 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=5893f03da3c52e9600913415871104263130a281c6de1291324fc5c6ac8901c3 I0421 15:04:03.819958 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=189258282a6d16b8c56f0626278e76a2400d1207d72c6dd2ebeabeec273c1bfd I0421 15:04:03.819971 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 30.008019ms to process 2 records I0421 15:04:03.819980 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 30.13709ms to process 0 records I0421 15:04:03.819990 1 tasks_processing.go:74] worker 42 stopped. I0421 15:04:03.820003 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0421 15:04:03.820017 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0421 15:04:03.820021 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0421 15:04:03.820024 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0421 15:04:03.820060 1 controller.go:489] The operator is still being initialized I0421 15:04:03.820069 1 controller.go:512] The operator is healthy I0421 15:04:03.820067 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=e2620d7857ad706411d0d150c3c07b06f44602b2027b3247c7f4c2fa6a6ee42d I0421 15:04:03.820084 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 28.59752ms to process 1 records I0421 15:04:03.820092 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 28.299756ms to process 0 records I0421 15:04:03.820110 1 tasks_processing.go:74] worker 46 stopped. I0421 15:04:03.820061 1 tasks_processing.go:74] worker 16 stopped. I0421 15:04:03.820274 1 recorder.go:75] Recording config/apiserver with fingerprint=8da2e280b96505bc11b0cc297371f9efedab4d1fdcd9c98dc716eb2cb732f11b I0421 15:04:03.820304 1 tasks_processing.go:74] worker 32 stopped. I0421 15:04:03.820305 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 29.062744ms to process 1 records I0421 15:04:03.820382 1 tasks_processing.go:74] worker 63 stopped. I0421 15:04:03.820671 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=7d764db074c36f2a3bc218beabc4f396dd907f9587d6959d92025f2280aada2e I0421 15:04:03.820685 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 30.248975ms to process 1 records I0421 15:04:03.820769 1 tasks_processing.go:74] worker 2 stopped. I0421 15:04:03.820779 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=c94990afa431dc7371de9a95ca3c3be29ff5129e01a2ed1d570f03c3fa809c90 I0421 15:04:03.820803 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=e151685ab1f292df32990d538923f2866b8ac246c4cab467c1faf4187fb0a97a I0421 15:04:03.820832 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=52b84f68547bbc5c13e4a9f8788a7b75d99596c6b3d54d05fdb105ab560724ed I0421 15:04:03.820843 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 29.789759ms to process 3 records I0421 15:04:03.820925 1 tasks_processing.go:74] worker 61 stopped. I0421 15:04:03.820960 1 recorder.go:75] Recording config/ingress with fingerprint=c9cc0d8088187414ef4f7272f5a1fdca0ea8570d9e06715f748d17bde530b6cc I0421 15:04:03.820970 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 29.033219ms to process 1 records I0421 15:04:03.820990 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 28.653654ms to process 0 records I0421 15:04:03.820999 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 28.177538ms to process 0 records I0421 15:04:03.821065 1 tasks_processing.go:74] worker 40 stopped. I0421 15:04:03.821064 1 tasks_processing.go:74] worker 48 stopped. I0421 15:04:03.821107 1 recorder.go:75] Recording config/network with fingerprint=ba69c3af22a57e9e6b14534d6393634fb38e778522613f53efde9e81844eb886 I0421 15:04:03.821118 1 gather.go:177] gatherer "clusterconfig" function "networks" took 28.537463ms to process 1 records I0421 15:04:03.821131 1 tasks_processing.go:74] worker 35 stopped. I0421 15:04:03.821136 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0421 15:04:03.821140 1 tasks_processing.go:74] worker 56 stopped. I0421 15:04:03.821155 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 30.914636ms to process 1 records I0421 15:04:03.821947 1 tasks_processing.go:74] worker 44 stopped. E0421 15:04:03.821962 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0421 15:04:03.821972 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 30.224272ms to process 0 records I0421 15:04:03.823504 1 tasks_processing.go:74] worker 62 stopped. I0421 15:04:03.824469 1 recorder.go:75] Recording config/node/ip-10-0-0-64.ec2.internal with fingerprint=6554dfa05f4f4db6841306584ccf6fb9c4991da03981c6cfa41ad9ae8cc824bc I0421 15:04:03.824575 1 recorder.go:75] Recording config/node/ip-10-0-1-68.ec2.internal with fingerprint=91aca1505c659718fa4c25f3338abde0824dcbf9cb3124c68d74af722789a5a6 I0421 15:04:03.824665 1 recorder.go:75] Recording config/node/ip-10-0-2-185.ec2.internal with fingerprint=12e1bc842c46fd658b817422ca0ef2c5018270ad370dd9bf45c80c32b0c84d2b I0421 15:04:03.824677 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 33.410998ms to process 3 records I0421 15:04:03.824684 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 32.359986ms to process 0 records I0421 15:04:03.824690 1 tasks_processing.go:74] worker 41 stopped. I0421 15:04:03.829117 1 tasks_processing.go:74] worker 11 stopped. I0421 15:04:03.829214 1 recorder.go:75] Recording config/olm_operators with fingerprint=63447e53032154c4d62a74c5ea50d9307130d4c3cd111f9b3f19db8fef759d92 I0421 15:04:03.829231 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 38.416542ms to process 1 records W0421 15:04:03.829809 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0421 15:04:03.830836 1 tasks_processing.go:74] worker 55 stopped. I0421 15:04:03.830888 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 39.074984ms to process 0 records I0421 15:04:03.834662 1 tasks_processing.go:74] worker 8 stopped. I0421 15:04:03.834681 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 43.871672ms to process 0 records I0421 15:04:03.838279 1 tasks_processing.go:74] worker 60 stopped. I0421 15:04:03.838294 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 47.309952ms to process 0 records I0421 15:04:03.838723 1 tasks_processing.go:74] worker 29 stopped. I0421 15:04:03.838786 1 recorder.go:75] Recording config/running_containers with fingerprint=bf07f9233ec960be312547df0daf5e18fd71e7aec1c134c6a71c5aab1ec041dc I0421 15:04:03.838797 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 48.76022ms to process 1 records I0421 15:04:03.841978 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0421 15:04:03.841985 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0421 15:04:03.842101 1 operator.go:288] started I0421 15:04:03.842115 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0421 15:04:03.842543 1 tasks_processing.go:74] worker 53 stopped. I0421 15:04:03.842700 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=28aac9cdae308b6e3bd6b8fd8569b604b7225dffc7718b6ecb9a4e73d6ce306b I0421 15:04:03.842781 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=52f4c9177a35ae5d66baefb7973228f7bb5c5199c112e0c95c7640f10696f163 I0421 15:04:03.842789 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 50.547533ms to process 2 records I0421 15:04:03.842799 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 51.10568ms to process 0 records I0421 15:04:03.842805 1 tasks_processing.go:74] worker 39 stopped. I0421 15:04:03.844318 1 tasks_processing.go:74] worker 24 stopped. I0421 15:04:03.844873 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=76b45d2f81823cbe31e93785a9d0c1cca795e05234f2088d6f29e718ff283cec I0421 15:04:03.845065 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=98d2e9fc7b2f57a9b1963249399d2f348140ff086a096d4b5f1e928490a3bdad I0421 15:04:03.845074 1 gather.go:177] gatherer "clusterconfig" function "crds" took 52.081625ms to process 2 records I0421 15:04:03.850030 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0421 15:04:03.850040 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0421 15:04:03.850043 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0421 15:04:03.850047 1 controller.go:212] Source scaController *sca.Controller is not ready I0421 15:04:03.850050 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0421 15:04:03.850066 1 controller.go:489] The operator is still being initialized I0421 15:04:03.850071 1 controller.go:512] The operator is healthy I0421 15:04:03.855279 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0421 15:04:03.855295 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0421 15:04:03.855307 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0421 15:04:03.858111 1 prometheus_rules.go:88] Prometheus rules successfully created I0421 15:04:03.861623 1 base_controller.go:82] Caches are synced for ConfigController I0421 15:04:03.861633 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0421 15:04:03.861747 1 tasks_processing.go:74] worker 14 stopped. I0421 15:04:03.861856 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=0392050256e12c69978d9c8a06037370f4a1e96bed1002b6249cea97f8319493 I0421 15:04:03.861904 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=229e108ab71531e5f976ebcd962ccc5deeeb7414636e94da669f43cb39e9ba87 I0421 15:04:03.861932 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=11bebbccb8e509b29ac4bafaf9261f1519d54e8ea2fce6869cc93f3ca5238e97 I0421 15:04:03.861940 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 71.227384ms to process 3 records E0421 15:04:03.862450 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27eebe6aee-92c2-4918-b427-537cc49fcec3%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.11:34912->172.30.0.10:53: read: connection refused I0421 15:04:03.862463 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27eebe6aee-92c2-4918-b427-537cc49fcec3%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.11:34912->172.30.0.10:53: read: connection refused I0421 15:04:03.868818 1 configmapobserver.go:84] configmaps "insights-config" not found I0421 15:04:03.869317 1 tasks_processing.go:74] worker 21 stopped. E0421 15:04:03.869331 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0421 15:04:03.869336 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0421 15:04:03.869340 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0421 15:04:03.869348 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0421 15:04:03.869371 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0421 15:04:03.869378 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0421 15:04:03.869383 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0421 15:04:03.869387 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0421 15:04:03.869423 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0421 15:04:03.869431 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0421 15:04:03.869436 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 78.968913ms to process 7 records I0421 15:04:03.910753 1 tasks_processing.go:74] worker 25 stopped. I0421 15:04:03.911033 1 recorder.go:75] Recording config/version with fingerprint=f119e99ed2cd9cdab625848c8b51cc693b8de9579cb18a2e3147b5a3d6f242c2 I0421 15:04:03.911049 1 recorder.go:75] Recording config/id with fingerprint=59d017fa6af0ed05ebe02d1fef0547d3e94bec7bfffe8c21450f5be0bf4e834d I0421 15:04:03.911057 1 gather.go:177] gatherer "clusterconfig" function "version" took 119.925592ms to process 2 records I0421 15:04:03.915568 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0421 15:04:03.919023 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.11:50687->172.30.0.10:53: read: connection refused I0421 15:04:03.919038 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.11:50687->172.30.0.10:53: read: connection refused I0421 15:04:03.942618 1 base_controller.go:82] Caches are synced for LoggingSyncer I0421 15:04:03.942633 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0421 15:04:03.942655 1 tasks_processing.go:74] worker 43 stopped. E0421 15:04:03.942665 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0421 15:04:03.942671 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pqjtml22a4bmh59j970jdq3qrafr08j-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pqjtml22a4bmh59j970jdq3qrafr08j-primary-cert-bundle-secret" not found I0421 15:04:03.942739 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=96d9d1b38c6152e38cb5034b7c44436a1dc42bab45c15745c7ebe98c875388f7 I0421 15:04:03.942754 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 151.187044ms to process 1 records I0421 15:04:04.233120 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0421 15:04:04.233136 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0421 15:04:04.233912 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-9ln77 pod in namespace openshift-dns (previous: false). I0421 15:04:04.469984 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-9ln77 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-9ln77\" is waiting to start: ContainerCreating" I0421 15:04:04.470004 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-9ln77\" is waiting to start: ContainerCreating" I0421 15:04:04.470015 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-9ln77 pod in namespace openshift-dns (previous: false). I0421 15:04:04.641464 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-9ln77 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-9ln77\" is waiting to start: ContainerCreating" I0421 15:04:04.641481 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-9ln77\" is waiting to start: ContainerCreating" I0421 15:04:04.641509 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-lbfww pod in namespace openshift-dns (previous: false). W0421 15:04:04.829755 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0421 15:04:04.847342 1 tasks_processing.go:74] worker 34 stopped. I0421 15:04:04.847394 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0421 15:04:04.847412 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 1.057487112s to process 1 records I0421 15:04:04.867406 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-lbfww pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-lbfww\" is waiting to start: ContainerCreating" I0421 15:04:04.867429 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-lbfww\" is waiting to start: ContainerCreating" I0421 15:04:04.867436 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-lbfww pod in namespace openshift-dns (previous: false). I0421 15:04:05.054250 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-lbfww pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-lbfww\" is waiting to start: ContainerCreating" I0421 15:04:05.054277 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-lbfww\" is waiting to start: ContainerCreating" I0421 15:04:05.054315 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-nlm5q pod in namespace openshift-dns (previous: false). I0421 15:04:05.252497 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0421 15:04:05.263879 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-nlm5q pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-nlm5q\" is waiting to start: ContainerCreating" I0421 15:04:05.263890 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-nlm5q\" is waiting to start: ContainerCreating" I0421 15:04:05.263898 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-nlm5q pod in namespace openshift-dns (previous: false). I0421 15:04:05.439794 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-nlm5q pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-nlm5q\" is waiting to start: ContainerCreating" I0421 15:04:05.439812 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-nlm5q\" is waiting to start: ContainerCreating" I0421 15:04:05.439822 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-78xbg pod in namespace openshift-dns (previous: false). I0421 15:04:05.641313 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0421 15:04:05.641332 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-ngkb2 pod in namespace openshift-dns (previous: false). I0421 15:04:05.655315 1 tasks_processing.go:74] worker 28 stopped. I0421 15:04:05.655382 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=28adf0835b04418ac9d8daebae9a15f683ff29b47c7edd4bf4b840713db07ce4 I0421 15:04:05.655417 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=c9ef75714953ee9d73d1c807b0052b4196f2e591c553d66223562cd1d0326dd7 I0421 15:04:05.655451 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0421 15:04:05.655478 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=f8eb304649d21d824101658313ea81124e2455e3b5b0093f828b0ccf4d7183d7 I0421 15:04:05.655495 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0421 15:04:05.655532 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=6bc08d81a9929cb711029567c98f46f5830f27f8b8474101a2d286240ee37cfe I0421 15:04:05.655562 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=e3740dbf18e2d8f89705d786ebd708c57921942195603ed6d4bd1811f08058ca I0421 15:04:05.655585 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=39944668d01474af77df5c63123d39d73a92f2b93329ab4dbf76feca03857799 I0421 15:04:05.655599 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=f4bbe2391e62568ab1a886001e1df0d73b01de95278bafbb79230e8754582a13 I0421 15:04:05.655619 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=536b22d40d888a3ccabc0f003c919595fb8c4c7e3686deb299267c8d9b24a746 I0421 15:04:05.655628 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0421 15:04:05.655644 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=202f5202edb3a88ad65d3509835f7c59365150644dbfb156fd108a93522dfdb2 I0421 15:04:05.655655 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0421 15:04:05.655670 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=f8af61d63c224d3f822e3ef3657318f232d349a30c2ac33734950c17255dd2bd I0421 15:04:05.655679 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0421 15:04:05.655692 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=2d5b687c1669005c0ee23c19cb4ad91f18c406a1478f0d68078843f608a616bb I0421 15:04:05.655702 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0421 15:04:05.655718 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=e7b55095782b5ec156be25ed9eec4ac7d1aff22cd43b695e526d21430df19688 I0421 15:04:05.655839 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=9ea10ff8e555c7fc0a0020a1bd59ee60ebc2ea198d455179e05e84f83f13d38d I0421 15:04:05.655850 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0421 15:04:05.655857 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0421 15:04:05.655877 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0421 15:04:05.655898 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=58fb04159bcc4a144c05956e8d46aef1fa0b1cc8f64d77958f1fafb08e7e2ba4 I0421 15:04:05.655920 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=0abc915786e7808c20c882a94af7961cd7ee940f365b4dcb43bad5ef4678105f I0421 15:04:05.655929 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0421 15:04:05.655944 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=5139c108efbe3e92dc5cb84fdacbb28dac8dbc2a6cc06c0dec708032ece51a5a I0421 15:04:05.655953 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0421 15:04:05.655965 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=de75eca704d37960c581ec8bf3a6b400592b74e68247f0d094a17ba95767cefa I0421 15:04:05.655980 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=54a453c806ecce2a8a7232f44d679865f24456ac2b7735a21d5e1568a514f127 I0421 15:04:05.655996 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=5d90f92f9bb1102b0da3ac4101886ce30ab9bde24b82afa175f1fdb18d1c9d3b I0421 15:04:05.656010 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=b929398d8930ab0adb6a28caba598f586abf9465d923856c61daaaf25c393160 I0421 15:04:05.656024 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=bf21673edb5438b6e7e4f149c671d72a09bad67789570db45ad6d1273a7ac010 I0421 15:04:05.656046 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=3d11fc13dfc99a6824f52c73d4c8a998f149417c0b45b69552216d7e486242fb I0421 15:04:05.656069 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0421 15:04:05.656077 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0421 15:04:05.656084 1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.863352925s to process 35 records W0421 15:04:05.829034 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0421 15:04:05.839070 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0421 15:04:05.839084 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-q4k27 pod in namespace openshift-dns (previous: false). I0421 15:04:06.041395 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0421 15:04:06.041450 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-67d6c76599-h5lvd pod in namespace openshift-image-registry (previous: false). I0421 15:04:06.240719 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-67d6c76599-h5lvd pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-67d6c76599-h5lvd\" is waiting to start: ContainerCreating" I0421 15:04:06.240737 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-67d6c76599-h5lvd\" is waiting to start: ContainerCreating" I0421 15:04:06.240786 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6f845b68d4-6jft2 pod in namespace openshift-image-registry (previous: false). I0421 15:04:06.441268 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6f845b68d4-6jft2 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6f845b68d4-6jft2\" is waiting to start: ContainerCreating" I0421 15:04:06.441284 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6f845b68d4-6jft2\" is waiting to start: ContainerCreating" I0421 15:04:06.441317 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6f845b68d4-q9vjc pod in namespace openshift-image-registry (previous: false). I0421 15:04:06.640245 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6f845b68d4-q9vjc pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6f845b68d4-q9vjc\" is waiting to start: ContainerCreating" I0421 15:04:06.640267 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6f845b68d4-q9vjc\" is waiting to start: ContainerCreating" I0421 15:04:06.640282 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-6zzk8 pod in namespace openshift-image-registry (previous: false). W0421 15:04:06.829122 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0421 15:04:06.839632 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0421 15:04:06.839646 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-hsxwv pod in namespace openshift-image-registry (previous: false). I0421 15:04:07.040287 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0421 15:04:07.040303 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-rrlz8 pod in namespace openshift-image-registry (previous: false). I0421 15:04:07.240297 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0421 15:04:07.240314 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-58857bf79c-4ns6d pod in namespace openshift-ingress (previous: false). I0421 15:04:07.440620 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-58857bf79c-4ns6d pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-58857bf79c-4ns6d\" is waiting to start: ContainerCreating" I0421 15:04:07.440642 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-58857bf79c-4ns6d\" is waiting to start: ContainerCreating" I0421 15:04:07.440657 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-f8b9566b9-8v7nd pod in namespace openshift-ingress (previous: false). I0421 15:04:07.639172 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-f8b9566b9-8v7nd pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-f8b9566b9-8v7nd\" is waiting to start: ContainerCreating" I0421 15:04:07.639217 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-f8b9566b9-8v7nd\" is waiting to start: ContainerCreating" I0421 15:04:07.639228 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-f8b9566b9-rctzq pod in namespace openshift-ingress (previous: false). W0421 15:04:07.829588 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0421 15:04:07.839448 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-f8b9566b9-rctzq pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-f8b9566b9-rctzq\" is waiting to start: ContainerCreating" I0421 15:04:07.839461 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-f8b9566b9-rctzq\" is waiting to start: ContainerCreating" I0421 15:04:07.839488 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-jzj9v pod in namespace openshift-ingress-canary (previous: false). I0421 15:04:08.039474 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-jzj9v pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-jzj9v\" is waiting to start: ContainerCreating" I0421 15:04:08.039490 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-jzj9v\" is waiting to start: ContainerCreating" I0421 15:04:08.039517 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-ljgvj pod in namespace openshift-ingress-canary (previous: false). I0421 15:04:08.239369 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-ljgvj pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-ljgvj\" is waiting to start: ContainerCreating" I0421 15:04:08.239388 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-ljgvj\" is waiting to start: ContainerCreating" I0421 15:04:08.239420 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-rqvpm pod in namespace openshift-ingress-canary (previous: false). I0421 15:04:08.440041 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-rqvpm pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-rqvpm\" is waiting to start: ContainerCreating" I0421 15:04:08.440064 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-rqvpm\" is waiting to start: ContainerCreating" I0421 15:04:08.440081 1 tasks_processing.go:74] worker 19 stopped. I0421 15:04:08.440183 1 recorder.go:75] Recording events/openshift-dns with fingerprint=b6fb3788d78dbeff6ac339f3b420585c9f409911238a4e2cc53816a094139973 I0421 15:04:08.440292 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=47b91293dcfbec957a1b9c49a3f24b91fb083a876947bfa2bd47b145933f36e1 I0421 15:04:08.440320 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=d9ae365e2958e323858a0ff0e609b1777a4fd21252fa9d7c650d6c6232d832ea I0421 15:04:08.440365 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=987903ebf7b8d3b34439e3ff6d0620cc0fcd1a09c3482877c1f68d1fc9e9f1c1 I0421 15:04:08.440382 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=4ebb6f846b4f736b656c129762db24d5747d83d7d972a53902cbcf49dd096334 I0421 15:04:08.441691 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-9ln77 with fingerprint=84497098bfe11b39484879f530e5918639fd2f0e36670f37ab42ae21dd747f9f I0421 15:04:08.441804 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-lbfww with fingerprint=87c10cb2173d7e54dc39e62cd0603ebcc929a812036c4511526ffe1fec0f0d65 I0421 15:04:08.441878 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-nlm5q with fingerprint=582dbcda43485f3f46e59931eecafb729c3a54b4021e7cbbd2072c30a918eb8d I0421 15:04:08.441980 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-67d6c76599-h5lvd with fingerprint=924a32299d0ad9c7fdf473a2e7c7baa0c5b8fbb4a94c2b75f89ee7a9cb077a14 I0421 15:04:08.442073 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-6f845b68d4-6jft2 with fingerprint=c0c2bda794b0fc94ffbc48910b9805e8e1bdb16e925eb0d29bdd3dab3f86af49 I0421 15:04:08.442160 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-6f845b68d4-q9vjc with fingerprint=1e94f2ecfe4507801e688b722a1bac9e72eae1288a1b2d0b072328db920294d3 I0421 15:04:08.442232 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-jzj9v with fingerprint=3fad6cae5100e95c7788ec80947ebbeb3391f43fe1c0ec534b9f74f7725b21a3 I0421 15:04:08.442287 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-ljgvj with fingerprint=1347a1ddf0062eece70eb8919cde6b2d77f51160f37075a965beefdf4ce4ad9c I0421 15:04:08.442341 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-rqvpm with fingerprint=19be579bfd8b62e9bcf76b9dd20ab63ccd0bd5ef9fd50d3e7cad583fdf571d07 I0421 15:04:08.442350 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.65054617s to process 14 records W0421 15:04:08.829271 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0421 15:04:08.829306 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0421 15:04:08.829322 1 tasks_processing.go:74] worker 37 stopped. E0421 15:04:08.829332 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0421 15:04:08.829343 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0421 15:04:08.829357 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0421 15:04:08.829370 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.037740691s to process 1 records I0421 15:04:16.235624 1 tasks_processing.go:74] worker 26 stopped. I0421 15:04:16.235668 1 recorder.go:75] Recording config/installplans with fingerprint=f17dbfacc3bfddf27ca3b213b39495434cd4c4e9e3dbd69566ffb3845bbcf539 I0421 15:04:16.235679 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.443654503s to process 1 records I0421 15:04:16.996833 1 tasks_processing.go:74] worker 0 stopped. I0421 15:04:16.997099 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=751aa8b7d1208af5fd734152a53c8f2354708612b0cd50cfd9c595651a5cc8c8 I0421 15:04:16.997114 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.207300274s to process 1 records E0421 15:04:16.997186 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.207s with: function \"machine_healthchecks\" failed with an error, function \"machines\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0421 15:04:16.998310 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0421 15:04:16.998324 1 periodic.go:209] Running workloads gatherer I0421 15:04:16.998339 1 tasks_processing.go:45] number of workers: 2 I0421 15:04:16.998345 1 tasks_processing.go:69] worker 1 listening for tasks. I0421 15:04:16.998349 1 tasks_processing.go:71] worker 1 working on workload_info task. I0421 15:04:16.998363 1 tasks_processing.go:69] worker 0 listening for tasks. I0421 15:04:16.998375 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0421 15:04:17.027469 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0421 15:04:17.031958 1 tasks_processing.go:74] worker 0 stopped. I0421 15:04:17.031973 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 33.569369ms to process 0 records I0421 15:04:17.034613 1 configmapobserver.go:84] configmaps "insights-config" not found I0421 15:04:17.037006 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (10ms) I0421 15:04:17.047888 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (11ms) I0421 15:04:17.057983 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (10ms) I0421 15:04:17.068023 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (10ms) I0421 15:04:17.077383 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (9ms) I0421 15:04:17.087520 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (10ms) I0421 15:04:17.101263 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (14ms) I0421 15:04:17.112085 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (11ms) I0421 15:04:17.125855 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (14ms) I0421 15:04:17.138173 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (12ms) I0421 15:04:17.149946 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (12ms) I0421 15:04:17.237062 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (87ms) I0421 15:04:17.337675 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (101ms) I0421 15:04:17.436695 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (99ms) I0421 15:04:17.536543 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (100ms) I0421 15:04:17.636178 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (100ms) I0421 15:04:17.738491 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (102ms) I0421 15:04:17.839061 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (101ms) I0421 15:04:17.938494 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (99ms) I0421 15:04:18.039781 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (101ms) I0421 15:04:18.138619 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (99ms) I0421 15:04:18.242181 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (104ms) I0421 15:04:18.341435 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (99ms) I0421 15:04:18.441442 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (100ms) I0421 15:04:18.541176 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (100ms) I0421 15:04:18.640715 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (100ms) I0421 15:04:18.741045 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (100ms) I0421 15:04:18.838182 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (97ms) I0421 15:04:18.938471 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (100ms) I0421 15:04:19.037689 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (99ms) I0421 15:04:19.139988 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (102ms) I0421 15:04:19.237148 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (97ms) I0421 15:04:19.237178 1 tasks_processing.go:74] worker 1 stopped. E0421 15:04:19.237188 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0421 15:04:19.237491 1 recorder.go:75] Recording config/workload_info with fingerprint=80e4ae6114088963732fc1122c7afb0d839dcd2de5fe134489a3f1e9d5321004 I0421 15:04:19.237505 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.238821833s to process 1 records E0421 15:04:19.237529 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.239s with: function \"workload_info\" failed with an error" I0421 15:04:19.239218 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0421 15:04:19.239231 1 periodic.go:209] Running conditional gatherer I0421 15:04:19.246178 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0421 15:04:19.252749 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.11:53669->172.30.0.10:53: read: connection refused E0421 15:04:19.253003 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0421 15:04:19.253063 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0421 15:04:19.262362 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0421 15:04:19.262376 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0421 15:04:19.262381 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0421 15:04:19.262384 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0421 15:04:19.262387 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0421 15:04:19.262390 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0421 15:04:19.262393 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0421 15:04:19.262407 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0421 15:04:19.262410 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0421 15:04:19.262413 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0421 15:04:19.262427 1 tasks_processing.go:45] number of workers: 3 I0421 15:04:19.262437 1 tasks_processing.go:69] worker 2 listening for tasks. I0421 15:04:19.262441 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0421 15:04:19.262446 1 tasks_processing.go:69] worker 0 listening for tasks. I0421 15:04:19.262453 1 tasks_processing.go:69] worker 1 listening for tasks. I0421 15:04:19.262457 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0421 15:04:19.262464 1 tasks_processing.go:74] worker 1 stopped. I0421 15:04:19.262470 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0421 15:04:19.262517 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0421 15:04:19.262529 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.16µs to process 1 records I0421 15:04:19.262559 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0421 15:04:19.262567 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.364µs to process 1 records I0421 15:04:19.262574 1 tasks_processing.go:74] worker 0 stopped. I0421 15:04:19.262743 1 tasks_processing.go:74] worker 2 stopped. I0421 15:04:19.262757 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 255.018µs to process 0 records I0421 15:04:19.262780 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.11:53669->172.30.0.10:53: read: connection refused I0421 15:04:19.262797 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0421 15:04:19.287679 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=bc7e40fee94d4998dcb35decf9f8429b4ef8beadde41f0f60ffcc2b7a921af40 I0421 15:04:19.287804 1 diskrecorder.go:70] Writing 108 records to /var/lib/insights-operator/insights-2026-04-21-150419.tar.gz I0421 15:04:19.294247 1 diskrecorder.go:51] Wrote 108 records to disk in 6ms I0421 15:04:19.294274 1 periodic.go:278] Gathering cluster info every 2h0m0s I0421 15:04:19.294288 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0421 15:04:19.421379 1 configmapobserver.go:84] configmaps "insights-config" not found I0421 15:04:19.623303 1 configmapobserver.go:84] configmaps "insights-config" not found I0421 15:04:27.591007 1 configmapobserver.go:84] configmaps "insights-config" not found I0421 15:05:28.234297 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="e819da0c91227e7c1340f35ad74d88654dffa5359df0a4088f1a8a360a7ef036") W0421 15:05:28.234333 1 builder.go:160] Restart triggered because of file /var/run/configmaps/service-ca-bundle/service-ca.crt was created I0421 15:05:28.234397 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="de15329ac3f041e2dc0b4c70cf050eba98fc4ab380d3e5784ff2294b5e552092") I0421 15:05:28.234414 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0421 15:05:28.234444 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0421 15:05:28.234447 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="472bdd756e45d5c4b8f1c807e75ffd9f3dfd0c089227220a0cad60a46fc3f2b2") I0421 15:05:28.234463 1 periodic.go:170] Shutting down I0421 15:05:28.234477 1 base_controller.go:181] Shutting down LoggingSyncer ... I0421 15:05:28.234489 1 base_controller.go:123] Shutting down worker of ConfigController controller ... I0421 15:05:28.234497 1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ... I0421 15:05:28.234504 1 base_controller.go:113] All LoggingSyncer workers have been terminated