W0423 20:43:29.009074 1 cmd.go:257] Using insecure, self-signed certificates I0423 20:43:29.911721 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0423 20:43:29.912076 1 observer_polling.go:159] Starting file observer I0423 20:43:30.341959 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0423 20:43:30.342159 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0423 20:43:30.342740 1 secure_serving.go:57] Forcing use of http/1.1 only W0423 20:43:30.342759 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0423 20:43:30.342764 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0423 20:43:30.342768 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0423 20:43:30.342770 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0423 20:43:30.342772 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0423 20:43:30.342776 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0423 20:43:30.342804 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0423 20:43:30.346688 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0423 20:43:30.346758 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"4207ba7f-c239-4fcd-8326-d948a9adbcc9", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0423 20:43:30.347571 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0423 20:43:30.347588 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0423 20:43:30.347587 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0423 20:43:30.347589 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0423 20:43:30.347602 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0423 20:43:30.347606 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0423 20:43:30.347833 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-366482630/tls.crt::/tmp/serving-cert-366482630/tls.key" I0423 20:43:30.348185 1 secure_serving.go:213] Serving securely on [::]:8443 I0423 20:43:30.348223 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0423 20:43:30.351732 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0423 20:43:30.351752 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0423 20:43:30.351812 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0423 20:43:30.358141 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0423 20:43:30.358227 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0423 20:43:30.362907 1 secretconfigobserver.go:119] support secret does not exist I0423 20:43:30.366878 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0423 20:43:30.373107 1 secretconfigobserver.go:119] support secret does not exist I0423 20:43:30.376351 1 recorder.go:176] Pruning old reports every 7h53m55s, max age is 288h0m0s I0423 20:43:30.383343 1 periodic.go:216] Running clusterconfig gatherer I0423 20:43:30.383345 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0423 20:43:30.383362 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0423 20:43:30.383393 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0423 20:43:30.383398 1 insightsreport.go:296] Starting report retriever I0423 20:43:30.383401 1 tasks_processing.go:45] number of workers: 64 I0423 20:43:30.383402 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0423 20:43:30.383426 1 tasks_processing.go:69] worker 3 listening for tasks. I0423 20:43:30.383442 1 tasks_processing.go:69] worker 63 listening for tasks. I0423 20:43:30.383447 1 tasks_processing.go:71] worker 63 working on overlapping_namespace_uids task. I0423 20:43:30.383450 1 tasks_processing.go:69] worker 0 listening for tasks. I0423 20:43:30.383457 1 tasks_processing.go:69] worker 1 listening for tasks. I0423 20:43:30.383462 1 tasks_processing.go:69] worker 2 listening for tasks. I0423 20:43:30.383468 1 tasks_processing.go:69] worker 33 listening for tasks. I0423 20:43:30.383473 1 tasks_processing.go:69] worker 4 listening for tasks. I0423 20:43:30.383481 1 tasks_processing.go:69] worker 5 listening for tasks. I0423 20:43:30.383481 1 tasks_processing.go:69] worker 48 listening for tasks. I0423 20:43:30.383486 1 tasks_processing.go:69] worker 20 listening for tasks. I0423 20:43:30.383488 1 tasks_processing.go:69] worker 19 listening for tasks. I0423 20:43:30.383491 1 tasks_processing.go:69] worker 34 listening for tasks. I0423 20:43:30.383491 1 tasks_processing.go:69] worker 21 listening for tasks. I0423 20:43:30.383496 1 tasks_processing.go:69] worker 6 listening for tasks. I0423 20:43:30.383495 1 tasks_processing.go:69] worker 22 listening for tasks. I0423 20:43:30.383502 1 tasks_processing.go:69] worker 35 listening for tasks. I0423 20:43:30.383504 1 tasks_processing.go:69] worker 7 listening for tasks. I0423 20:43:30.383505 1 tasks_processing.go:69] worker 23 listening for tasks. I0423 20:43:30.383508 1 tasks_processing.go:69] worker 36 listening for tasks. I0423 20:43:30.383511 1 tasks_processing.go:69] worker 8 listening for tasks. I0423 20:43:30.383512 1 tasks_processing.go:69] worker 24 listening for tasks. I0423 20:43:30.383513 1 tasks_processing.go:69] worker 37 listening for tasks. I0423 20:43:30.383516 1 tasks_processing.go:69] worker 9 listening for tasks. I0423 20:43:30.383518 1 tasks_processing.go:69] worker 25 listening for tasks. I0423 20:43:30.383519 1 tasks_processing.go:69] worker 38 listening for tasks. I0423 20:43:30.383524 1 tasks_processing.go:69] worker 26 listening for tasks. I0423 20:43:30.383524 1 tasks_processing.go:69] worker 10 listening for tasks. I0423 20:43:30.383525 1 tasks_processing.go:69] worker 39 listening for tasks. I0423 20:43:30.383528 1 tasks_processing.go:69] worker 11 listening for tasks. I0423 20:43:30.383529 1 tasks_processing.go:69] worker 40 listening for tasks. I0423 20:43:30.383529 1 tasks_processing.go:69] worker 52 listening for tasks. I0423 20:43:30.383539 1 tasks_processing.go:69] worker 13 listening for tasks. I0423 20:43:30.383514 1 tasks_processing.go:69] worker 56 listening for tasks. I0423 20:43:30.383570 1 tasks_processing.go:69] worker 59 listening for tasks. I0423 20:43:30.383581 1 tasks_processing.go:69] worker 51 listening for tasks. I0423 20:43:30.383584 1 tasks_processing.go:69] worker 49 listening for tasks. I0423 20:43:30.383534 1 tasks_processing.go:69] worker 41 listening for tasks. I0423 20:43:30.383581 1 tasks_processing.go:69] worker 58 listening for tasks. I0423 20:43:30.383538 1 tasks_processing.go:69] worker 42 listening for tasks. I0423 20:43:30.383534 1 tasks_processing.go:69] worker 12 listening for tasks. I0423 20:43:30.383601 1 tasks_processing.go:69] worker 57 listening for tasks. I0423 20:43:30.383542 1 tasks_processing.go:69] worker 27 listening for tasks. I0423 20:43:30.383545 1 tasks_processing.go:69] worker 43 listening for tasks. I0423 20:43:30.383546 1 tasks_processing.go:69] worker 14 listening for tasks. I0423 20:43:30.383546 1 tasks_processing.go:69] worker 28 listening for tasks. I0423 20:43:30.383546 1 tasks_processing.go:69] worker 53 listening for tasks. I0423 20:43:30.383549 1 tasks_processing.go:69] worker 44 listening for tasks. I0423 20:43:30.383550 1 tasks_processing.go:69] worker 17 listening for tasks. I0423 20:43:30.383552 1 tasks_processing.go:69] worker 29 listening for tasks. I0423 20:43:30.383554 1 tasks_processing.go:69] worker 45 listening for tasks. I0423 20:43:30.383556 1 tasks_processing.go:69] worker 30 listening for tasks. I0423 20:43:30.383557 1 tasks_processing.go:69] worker 54 listening for tasks. I0423 20:43:30.383559 1 tasks_processing.go:69] worker 46 listening for tasks. I0423 20:43:30.383555 1 tasks_processing.go:69] worker 18 listening for tasks. I0423 20:43:30.383552 1 tasks_processing.go:69] worker 60 listening for tasks. I0423 20:43:30.383656 1 tasks_processing.go:71] worker 0 working on install_plans task. I0423 20:43:30.383561 1 tasks_processing.go:69] worker 31 listening for tasks. I0423 20:43:30.383661 1 tasks_processing.go:71] worker 25 working on silenced_alerts task. I0423 20:43:30.383665 1 tasks_processing.go:71] worker 20 working on jaegers task. I0423 20:43:30.383667 1 tasks_processing.go:71] worker 31 working on container_images task. I0423 20:43:30.383672 1 tasks_processing.go:71] worker 26 working on storage_classes task. I0423 20:43:30.383676 1 tasks_processing.go:71] worker 33 working on openstack_dataplanedeployments task. I0423 20:43:30.383686 1 tasks_processing.go:71] worker 7 working on operators task. I0423 20:43:30.383696 1 tasks_processing.go:71] worker 1 working on cluster_apiserver task. W0423 20:43:30.383701 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0423 20:43:30.383712 1 tasks_processing.go:71] worker 2 working on openshift_logging task. I0423 20:43:30.383716 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 42.184µs to process 0 records I0423 20:43:30.383723 1 tasks_processing.go:71] worker 12 working on support_secret task. I0423 20:43:30.383730 1 tasks_processing.go:71] worker 37 working on ingress task. I0423 20:43:30.383664 1 tasks_processing.go:71] worker 60 working on openstack_version task. I0423 20:43:30.383759 1 tasks_processing.go:71] worker 9 working on oauths task. I0423 20:43:30.383804 1 tasks_processing.go:71] worker 6 working on nodenetworkstates task. I0423 20:43:30.383817 1 tasks_processing.go:71] worker 53 working on mutating_webhook_configurations task. I0423 20:43:30.383827 1 tasks_processing.go:71] worker 10 working on tsdb_status task. W0423 20:43:30.383858 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0423 20:43:30.383911 1 tasks_processing.go:71] worker 51 working on config_maps task. I0423 20:43:30.383927 1 tasks_processing.go:71] worker 39 working on ingress_certificates task. I0423 20:43:30.383929 1 tasks_processing.go:71] worker 58 working on aggregated_monitoring_cr_names task. I0423 20:43:30.383944 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 86.38µs to process 0 records I0423 20:43:30.383956 1 tasks_processing.go:71] worker 41 working on storage_cluster task. I0423 20:43:30.383984 1 tasks_processing.go:71] worker 42 working on certificate_signing_requests task. I0423 20:43:30.383986 1 tasks_processing.go:71] worker 11 working on pdbs task. I0423 20:43:30.383929 1 tasks_processing.go:71] worker 52 working on proxies task. I0423 20:43:30.383669 1 tasks_processing.go:71] worker 38 working on sap_datahubs task. I0423 20:43:30.383881 1 tasks_processing.go:71] worker 30 working on olm_operators task. I0423 20:43:30.383565 1 tasks_processing.go:69] worker 47 listening for tasks. I0423 20:43:30.384213 1 tasks_processing.go:71] worker 47 working on validating_webhook_configurations task. I0423 20:43:30.383565 1 tasks_processing.go:69] worker 55 listening for tasks. I0423 20:43:30.383776 1 tasks_processing.go:71] worker 36 working on image_registries task. I0423 20:43:30.383661 1 tasks_processing.go:71] worker 35 working on node_features task. I0423 20:43:30.383442 1 tasks_processing.go:71] worker 3 working on monitoring_persistent_volumes task. I0423 20:43:30.383681 1 tasks_processing.go:71] worker 8 working on ceph_cluster task. I0423 20:43:30.383579 1 tasks_processing.go:69] worker 50 listening for tasks. I0423 20:43:30.384531 1 tasks_processing.go:71] worker 50 working on machine_config_pools task. I0423 20:43:30.383725 1 tasks_processing.go:71] worker 24 working on service_accounts task. I0423 20:43:30.383578 1 tasks_processing.go:69] worker 15 listening for tasks. I0423 20:43:30.383777 1 tasks_processing.go:71] worker 4 working on machine_sets task. I0423 20:43:30.383770 1 tasks_processing.go:71] worker 23 working on sap_config task. I0423 20:43:30.383794 1 tasks_processing.go:71] worker 44 working on operators_pods_and_events task. I0423 20:43:30.383798 1 tasks_processing.go:71] worker 57 working on machine_healthchecks task. I0423 20:43:30.383794 1 tasks_processing.go:71] worker 25 working on machines task. I0423 20:43:30.383800 1 tasks_processing.go:71] worker 21 working on cost_management_metrics_configs task. I0423 20:43:30.383802 1 tasks_processing.go:71] worker 27 working on openstack_controlplanes task. I0423 20:43:30.383806 1 tasks_processing.go:71] worker 43 working on feature_gates task. I0423 20:43:30.383804 1 tasks_processing.go:71] worker 19 working on dvo_metrics task. I0423 20:43:30.383810 1 tasks_processing.go:71] worker 14 working on image task. I0423 20:43:30.383814 1 tasks_processing.go:71] worker 28 working on nodes task. I0423 20:43:30.383811 1 tasks_processing.go:71] worker 34 working on openshift_machine_api_events task. I0423 20:43:30.383823 1 tasks_processing.go:71] worker 56 working on version task. I0423 20:43:30.383886 1 tasks_processing.go:71] worker 17 working on clusterroles task. I0423 20:43:30.383888 1 tasks_processing.go:71] worker 46 working on machine_autoscalers task. I0423 20:43:30.383891 1 tasks_processing.go:71] worker 29 working on infrastructures task. I0423 20:43:30.383893 1 tasks_processing.go:71] worker 54 working on openstack_dataplanenodesets task. I0423 20:43:30.386130 1 tasks_processing.go:71] worker 55 working on nodenetworkconfigurationpolicies task. I0423 20:43:30.383895 1 tasks_processing.go:71] worker 45 working on metrics task. W0423 20:43:30.386199 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0423 20:43:30.383903 1 tasks_processing.go:71] worker 49 working on machine_configs task. I0423 20:43:30.386359 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 69.857µs to process 0 records I0423 20:43:30.383907 1 tasks_processing.go:71] worker 59 working on container_runtime_configs task. I0423 20:43:30.383912 1 tasks_processing.go:71] worker 22 working on qemu_kubevirt_launcher_logs task. I0423 20:43:30.383564 1 tasks_processing.go:69] worker 16 listening for tasks. I0423 20:43:30.386650 1 tasks_processing.go:71] worker 16 working on pod_network_connectivity_checks task. I0423 20:43:30.383922 1 tasks_processing.go:71] worker 40 working on node_logs task. I0423 20:43:30.383923 1 tasks_processing.go:71] worker 10 working on crds task. I0423 20:43:30.383918 1 tasks_processing.go:71] worker 18 working on networks task. I0423 20:43:30.383934 1 tasks_processing.go:71] worker 13 working on schedulers task. I0423 20:43:30.383568 1 tasks_processing.go:69] worker 32 listening for tasks. I0423 20:43:30.383566 1 tasks_processing.go:69] worker 62 listening for tasks. I0423 20:43:30.383574 1 tasks_processing.go:69] worker 61 listening for tasks. I0423 20:43:30.383653 1 tasks_processing.go:71] worker 48 working on lokistack task. I0423 20:43:30.384671 1 tasks_processing.go:71] worker 15 working on authentication task. I0423 20:43:30.383789 1 tasks_processing.go:71] worker 5 working on sap_pods task. I0423 20:43:30.386259 1 tasks_processing.go:71] worker 45 working on image_pruners task. I0423 20:43:30.386953 1 tasks_processing.go:71] worker 62 working on active_alerts task. W0423 20:43:30.387020 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0423 20:43:30.387059 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 48.544µs to process 0 records I0423 20:43:30.387101 1 tasks_processing.go:74] worker 61 stopped. I0423 20:43:30.387129 1 tasks_processing.go:71] worker 32 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0423 20:43:30.387144 1 tasks_processing.go:74] worker 62 stopped. I0423 20:43:30.387319 1 tasks_processing.go:74] worker 33 stopped. I0423 20:43:30.387336 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 3.625636ms to process 0 records I0423 20:43:30.389326 1 tasks_processing.go:74] worker 2 stopped. I0423 20:43:30.389342 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 5.601841ms to process 0 records I0423 20:43:30.389362 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 5.602044ms to process 0 records I0423 20:43:30.389383 1 tasks_processing.go:74] worker 60 stopped. I0423 20:43:30.389590 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0423 20:43:30.389598 1 tasks_processing.go:74] worker 1 stopped. I0423 20:43:30.389610 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0423 20:43:30.389616 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0423 20:43:30.389620 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0423 20:43:30.389637 1 controller.go:531] The operator is still being initialized I0423 20:43:30.389647 1 controller.go:554] The operator is healthy I0423 20:43:30.389744 1 recorder.go:75] Recording config/apiserver with fingerprint=c24f283cd038548d41a354b2c4e379fa0be48c502640159b0ff8f6471810cefa I0423 20:43:30.389758 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 5.887891ms to process 1 records E0423 20:43:30.391996 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0423 20:43:30.392012 1 tasks_processing.go:74] worker 35 stopped. I0423 20:43:30.392019 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 7.716943ms to process 0 records I0423 20:43:30.394355 1 tasks_processing.go:74] worker 6 stopped. I0423 20:43:30.394498 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 10.527373ms to process 0 records E0423 20:43:30.394753 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0423 20:43:30.394784 1 gather.go:177] gatherer "clusterconfig" function "machines" took 9.664152ms to process 0 records I0423 20:43:30.394812 1 tasks_processing.go:74] worker 25 stopped. I0423 20:43:30.394846 1 tasks_processing.go:74] worker 37 stopped. I0423 20:43:30.395028 1 recorder.go:75] Recording config/ingress with fingerprint=a3074c59cfdddb4c2db84934ccf4c51ae8c9cb6555a4311e8fc7e3b119c71c47 I0423 20:43:30.395044 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 11.106687ms to process 1 records I0423 20:43:30.395237 1 tasks_processing.go:74] worker 63 stopped. I0423 20:43:30.395269 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0423 20:43:30.395282 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 11.781627ms to process 1 records I0423 20:43:30.398117 1 tasks_processing.go:74] worker 38 stopped. I0423 20:43:30.398132 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 13.992121ms to process 0 records I0423 20:43:30.398185 1 tasks_processing.go:74] worker 52 stopped. I0423 20:43:30.398263 1 recorder.go:75] Recording config/proxy with fingerprint=26a4387a8b171dca20b0cf57d372fa8c507021febb9d85ec8335fc907f99925e I0423 20:43:30.398279 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 14.095716ms to process 1 records I0423 20:43:30.398344 1 tasks_processing.go:74] worker 9 stopped. I0423 20:43:30.398551 1 recorder.go:75] Recording config/oauth with fingerprint=539daf76aff79a44bf23c33469f39a43af3d3e0cb5cabcc2827a02266227805d I0423 20:43:30.398567 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 14.528437ms to process 1 records I0423 20:43:30.398584 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 13.413635ms to process 0 records E0423 20:43:30.398594 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0423 20:43:30.398602 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 14.711972ms to process 0 records I0423 20:43:30.398609 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 13.853111ms to process 0 records I0423 20:43:30.398656 1 tasks_processing.go:74] worker 12 stopped. I0423 20:43:30.398665 1 tasks_processing.go:74] worker 21 stopped. I0423 20:43:30.398668 1 tasks_processing.go:74] worker 4 stopped. I0423 20:43:30.398684 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=a3f4229aa91d9c30659be98b15b0e808331274ae7c2dd31cb6013775635a5c72 I0423 20:43:30.398704 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=a3fd813e7c5477c5b874aa1776ede6a986e8c7edf14a827cd4a5eca50a5163f2 I0423 20:43:30.398719 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 14.869451ms to process 2 records I0423 20:43:30.398728 1 tasks_processing.go:74] worker 26 stopped. I0423 20:43:30.400288 1 tasks_processing.go:74] worker 20 stopped. I0423 20:43:30.400301 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 16.608811ms to process 0 records I0423 20:43:30.400307 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 16.320103ms to process 0 records I0423 20:43:30.400312 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 15.866755ms to process 0 records I0423 20:43:30.400316 1 tasks_processing.go:74] worker 8 stopped. I0423 20:43:30.400320 1 tasks_processing.go:74] worker 41 stopped. I0423 20:43:30.402208 1 tasks_processing.go:74] worker 50 stopped. I0423 20:43:30.402220 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 17.66846ms to process 0 records I0423 20:43:30.402227 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 16.188279ms to process 0 records E0423 20:43:30.402233 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0423 20:43:30.402234 1 tasks_processing.go:74] worker 54 stopped. I0423 20:43:30.402239 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 17.474432ms to process 0 records I0423 20:43:30.402245 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 17.196546ms to process 0 records I0423 20:43:30.402248 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 17.546101ms to process 0 records I0423 20:43:30.402253 1 tasks_processing.go:74] worker 23 stopped. I0423 20:43:30.402257 1 tasks_processing.go:74] worker 57 stopped. I0423 20:43:30.402260 1 tasks_processing.go:74] worker 27 stopped. I0423 20:43:30.404388 1 tasks_processing.go:74] worker 30 stopped. I0423 20:43:30.404402 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 20.210248ms to process 0 records I0423 20:43:30.405170 1 tasks_processing.go:74] worker 36 stopped. I0423 20:43:30.405606 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=674a1b50de65b2f27af04d33275d524592a36f3fc447467c9c0db0e18d20ea78 I0423 20:43:30.405622 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 20.910154ms to process 1 records I0423 20:43:30.406861 1 tasks_processing.go:74] worker 11 stopped. I0423 20:43:30.407231 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=9b880dfe27de029493bc8a3573772279ec97d7f3cd4755d7cc87c661db18ea61 I0423 20:43:30.407350 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=0db347343f56e202cee71f539d9c749b138ca1c0665cf0cdda0200cc36355bdf I0423 20:43:30.407432 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=9b1ec5cad64196037bd20ae0539e0cd994bc03fbdb50937d505b8d720949b0ab I0423 20:43:30.407479 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 22.791282ms to process 3 records I0423 20:43:30.410406 1 tasks_processing.go:74] worker 46 stopped. I0423 20:43:30.410426 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 24.816836ms to process 0 records I0423 20:43:30.410637 1 tasks_processing.go:74] worker 53 stopped. I0423 20:43:30.410787 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=808a90a50bac7741e298b7050e50c9fc64a52a9a83370de0d453db7ec5c4a495 I0423 20:43:30.410817 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=316caea22f5b7aedaa7876728c021896554fa810f4c15e706a2d0c029af3719e I0423 20:43:30.410842 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=f58ef71182eb9929127841e7b6c75838d9c650436c00022eebfed7510a264944 I0423 20:43:30.410851 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 26.803583ms to process 3 records I0423 20:43:30.410910 1 recorder.go:75] Recording config/image with fingerprint=abc6f17f227ac248059f67993c5c2ad4867544772f476d0d6a050488e6f5a7c5 I0423 20:43:30.410921 1 gather.go:177] gatherer "clusterconfig" function "image" took 25.45635ms to process 1 records I0423 20:43:30.410929 1 tasks_processing.go:74] worker 14 stopped. W0423 20:43:30.414598 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0423 20:43:30.415442 1 tasks_processing.go:74] worker 34 stopped. I0423 20:43:30.415455 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 30.034187ms to process 0 records I0423 20:43:30.415586 1 tasks_processing.go:74] worker 55 stopped. I0423 20:43:30.415605 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 29.436207ms to process 0 records I0423 20:43:30.415928 1 tasks_processing.go:74] worker 3 stopped. I0423 20:43:30.415939 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 31.565422ms to process 0 records I0423 20:43:30.415947 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 28.933551ms to process 0 records I0423 20:43:30.415952 1 tasks_processing.go:74] worker 48 stopped. I0423 20:43:30.416063 1 tasks_processing.go:74] worker 47 stopped. I0423 20:43:30.416174 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=2ccc2c2d3eaa4dfbe94a44e1fde5b04bd3b1986d11d262bc3ea5c76ee708f706 I0423 20:43:30.416251 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=33b813bc1dafb4cff9f6b20991b80737e5dbda0f42c7881f0498430fc14a9c6a I0423 20:43:30.416269 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=dee041510a57c96b11454fdd1252fd96aa947b5597d2ae19533b88738c4ad94f I0423 20:43:30.416291 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=8d2ac3a36183af8a48bb53b09e4476075554539cc4528552c348c1e662f6189a I0423 20:43:30.416314 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=d6be7484a145633224f0604f8959da4114507bc3b965fba36b3c715674bf0164 I0423 20:43:30.416337 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=f3aaf09535319dfb61508df1f72f086ad08a942c8fb98f66e8864dab9c1a1d69 I0423 20:43:30.416359 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=b45919291b754de129b848e555a09a441c500e096fc6cae5c7ad03aeb4671285 I0423 20:43:30.416412 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=e30a81b0beea34015dfe207f330814899acb4ea48fcab158cd2ef7725c0fb6a9 I0423 20:43:30.416434 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=c29097e0dc6d3fc33221baa2383784258a79c39866ded4f8b833e1c6c344cdb0 I0423 20:43:30.416457 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=7adb85ed28dc1a8b62922fe0958ae180286aa13141d45f4d7e374d3650e7e0a6 I0423 20:43:30.416480 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=505685e01f7381fdde4051dca1b1e3f09593e7f6d6a4cc3305b29a2090b30fca I0423 20:43:30.416486 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 31.837848ms to process 11 records I0423 20:43:30.416573 1 tasks_processing.go:74] worker 29 stopped. I0423 20:43:30.416965 1 recorder.go:75] Recording config/infrastructure with fingerprint=a23a05fd9f44ccdcbe3b8bf012c0902c74ec29b1b372242105bbb6ba20d70fc8 I0423 20:43:30.416977 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 30.299769ms to process 1 records I0423 20:43:30.417064 1 tasks_processing.go:74] worker 43 stopped. I0423 20:43:30.417068 1 recorder.go:75] Recording config/featuregate with fingerprint=13094ba5d4e7c686b97ed079e8e2e61fc2c71137d5d0756f796c26814615d4f7 I0423 20:43:30.417079 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 30.993723ms to process 1 records I0423 20:43:30.417087 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 30.216605ms to process 0 records I0423 20:43:30.417091 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 29.598582ms to process 0 records I0423 20:43:30.417095 1 tasks_processing.go:74] worker 59 stopped. I0423 20:43:30.417099 1 tasks_processing.go:74] worker 5 stopped. E0423 20:43:30.417099 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0423 20:43:30.417104 1 tasks_processing.go:74] worker 16 stopped. I0423 20:43:30.417109 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 29.828271ms to process 0 records I0423 20:43:30.417229 1 tasks_processing.go:74] worker 28 stopped. I0423 20:43:30.417429 1 recorder.go:75] Recording config/node/ip-10-0-0-172.ec2.internal with fingerprint=05527039706d7d75fb4a630a8133bf2779e5fa58a3d3b6afc987020315530bce I0423 20:43:30.417490 1 recorder.go:75] Recording config/node/ip-10-0-1-197.ec2.internal with fingerprint=134724687d1e700fb4d993e6f167d45129eec1864949fedbe78d9bbe587c074d I0423 20:43:30.417536 1 recorder.go:75] Recording config/node/ip-10-0-2-22.ec2.internal with fingerprint=bfaca2a6ff23a155003feb6cb5c99cfb5d0a48267ad48f9d8ca8620345e9358a I0423 20:43:30.417544 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 31.629603ms to process 3 records I0423 20:43:30.417678 1 tasks_processing.go:74] worker 49 stopped. E0423 20:43:30.417690 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0423 20:43:30.417708 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0423 20:43:30.417718 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 31.323053ms to process 1 records I0423 20:43:30.418907 1 tasks_processing.go:74] worker 42 stopped. I0423 20:43:30.418922 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 34.866341ms to process 0 records I0423 20:43:30.424653 1 tasks_processing.go:74] worker 13 stopped. I0423 20:43:30.424741 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=57d0df5c8a4b3b4594dd8b6c7407237851f45ad0a05e885638e072c964ba0b9a I0423 20:43:30.424756 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 37.686155ms to process 1 records I0423 20:43:30.424791 1 tasks_processing.go:74] worker 17 stopped. I0423 20:43:30.424953 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=44e217262271ffc9ec4f281d4b35e12cee7c2b1c674e6afec23ddbf5fdce3d25 I0423 20:43:30.425043 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=54b004c913b08e8c6a821151ffc2b4a5157476e5f015c2fb6a220ee02fb4f4f0 I0423 20:43:30.425051 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 39.224005ms to process 2 records I0423 20:43:30.425191 1 recorder.go:75] Recording config/authentication with fingerprint=7136b19e6bcc20b5469da1b337cfe0059dcb87e556b3f3bf63792379688eca0d I0423 20:43:30.425199 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 37.816984ms to process 1 records I0423 20:43:30.425204 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 40.924047ms to process 0 records I0423 20:43:30.425203 1 tasks_processing.go:74] worker 15 stopped. I0423 20:43:30.425210 1 tasks_processing.go:74] worker 58 stopped. I0423 20:43:30.425347 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0423 20:43:30.425399 1 tasks_processing.go:74] worker 18 stopped. I0423 20:43:30.425429 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0423 20:43:30.425518 1 operator.go:328] started I0423 20:43:30.425529 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0423 20:43:30.425569 1 recorder.go:75] Recording config/network with fingerprint=ef9dbb2086c23e8eeb1d911969603691b9b767792191ced452b26a14bb3b9b25 I0423 20:43:30.425582 1 gather.go:177] gatherer "clusterconfig" function "networks" took 38.288483ms to process 1 records I0423 20:43:30.435583 1 gather_logs.go:145] no pods in namespace were found I0423 20:43:30.435599 1 tasks_processing.go:74] worker 22 stopped. I0423 20:43:30.435606 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 49.083955ms to process 0 records I0423 20:43:30.435630 1 tasks_processing.go:74] worker 10 stopped. I0423 20:43:30.435775 1 prometheus_rules.go:88] Prometheus rules successfully created I0423 20:43:30.435973 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0423 20:43:30.435986 1 controller.go:254] Source scaController *sca.Controller is not ready I0423 20:43:30.435990 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0423 20:43:30.435993 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0423 20:43:30.435995 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0423 20:43:30.436011 1 controller.go:531] The operator is still being initialized I0423 20:43:30.436018 1 controller.go:554] The operator is healthy I0423 20:43:30.436074 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=2a2c29c1894dfc44d9f7b4bd211ffe8b41ce1e7c63a3a80417a9dbafbd6f3dba I0423 20:43:30.436278 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=7f84b8fc095b0459f03a0d4c171fd8d91eff599d61925f06423b2ec0cc988cf7 I0423 20:43:30.436287 1 gather.go:177] gatherer "clusterconfig" function "crds" took 48.822394ms to process 2 records I0423 20:43:30.438628 1 tasks_processing.go:74] worker 56 stopped. I0423 20:43:30.438833 1 recorder.go:75] Recording config/version with fingerprint=76445b73aa8d739fe8f0b1c620580d82d4e7bde83b0ecda1e203d3d90b4b221a I0423 20:43:30.438848 1 recorder.go:75] Recording config/id with fingerprint=e91d861be4f49cbe55dfc3982ade0f0908809c76749c4e30f261693546c05a7e I0423 20:43:30.438854 1 gather.go:177] gatherer "clusterconfig" function "version" took 53.151463ms to process 2 records E0423 20:43:30.445061 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27e85948f0-d24a-4d25-aa93-a3e4b72649f3%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.10:46300->172.30.0.10:53: read: connection refused I0423 20:43:30.445075 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27e85948f0-d24a-4d25-aa93-a3e4b72649f3%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.10:46300->172.30.0.10:53: read: connection refused I0423 20:43:30.448285 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0423 20:43:30.448304 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0423 20:43:30.448333 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0423 20:43:30.452476 1 base_controller.go:82] Caches are synced for ConfigController I0423 20:43:30.452492 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0423 20:43:30.452800 1 tasks_processing.go:74] worker 45 stopped. I0423 20:43:30.452879 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=e80236acd10ff09cb2932e26b64c0446a91e582c7e726cce246ee1307e7e3a0c I0423 20:43:30.452892 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 65.947993ms to process 1 records I0423 20:43:30.458339 1 tasks_processing.go:74] worker 31 stopped. I0423 20:43:30.459700 1 recorder.go:75] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-s25tl with fingerprint=aa9bf9399c56e7e5e54c8fe86bb6ccf65afd77969fb27f1004043e72b09f3f7f I0423 20:43:30.459764 1 recorder.go:75] Recording config/running_containers with fingerprint=a669267f4b6be3a56d60d3a0bae23b6c3899de1f919e8923e315e4ad4c909288 I0423 20:43:30.459775 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 74.656323ms to process 2 records I0423 20:43:30.460981 1 tasks_processing.go:74] worker 32 stopped. I0423 20:43:30.460983 1 configmapobserver.go:84] configmaps "insights-config" not found I0423 20:43:30.460992 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 73.81909ms to process 0 records I0423 20:43:30.462454 1 tasks_processing.go:74] worker 51 stopped. E0423 20:43:30.462470 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0423 20:43:30.462478 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0423 20:43:30.462482 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0423 20:43:30.462491 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0423 20:43:30.462527 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0423 20:43:30.462534 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0423 20:43:30.462539 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0423 20:43:30.462543 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0423 20:43:30.462706 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0423 20:43:30.462731 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0423 20:43:30.462740 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 78.514787ms to process 7 records I0423 20:43:30.514792 1 tasks_processing.go:74] worker 40 stopped. I0423 20:43:30.514806 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 127.881909ms to process 0 records I0423 20:43:30.524074 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0423 20:43:30.525180 1 tasks_processing.go:74] worker 39 stopped. E0423 20:43:30.525196 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0423 20:43:30.525205 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2ps35p4e7fo08ot66mbftq9uvphot0ei-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2ps35p4e7fo08ot66mbftq9uvphot0ei-primary-cert-bundle-secret" not found I0423 20:43:30.525277 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=b2578031da027bf4d3e94babe2341b8632878142f88512bbb21a66c8936d9d31 I0423 20:43:30.525294 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 141.237779ms to process 1 records I0423 20:43:30.525618 1 base_controller.go:82] Caches are synced for LoggingSyncer I0423 20:43:30.525634 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... W0423 20:43:30.527597 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.10:54363->172.30.0.10:53: read: connection refused I0423 20:43:30.527609 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.10:54363->172.30.0.10:53: read: connection refused W0423 20:43:31.414265 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0423 20:43:31.618159 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0423 20:43:31.618174 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0423 20:43:31.619747 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-7mx7z pod in namespace openshift-dns (previous: false). I0423 20:43:31.842205 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0423 20:43:31.855594 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-7mx7z pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-7mx7z\" is waiting to start: ContainerCreating" I0423 20:43:31.855609 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-7mx7z\" is waiting to start: ContainerCreating" I0423 20:43:31.855617 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-7mx7z pod in namespace openshift-dns (previous: false). I0423 20:43:32.027502 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-7mx7z pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-7mx7z\" is waiting to start: ContainerCreating" I0423 20:43:32.027522 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-7mx7z\" is waiting to start: ContainerCreating" I0423 20:43:32.027533 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-j6z2f pod in namespace openshift-dns (previous: false). I0423 20:43:32.222716 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-j6z2f pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-j6z2f\" is waiting to start: ContainerCreating" I0423 20:43:32.222735 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-j6z2f\" is waiting to start: ContainerCreating" I0423 20:43:32.222744 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-j6z2f pod in namespace openshift-dns (previous: false). W0423 20:43:32.414538 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0423 20:43:32.421936 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-j6z2f pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-j6z2f\" is waiting to start: ContainerCreating" I0423 20:43:32.421950 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-j6z2f\" is waiting to start: ContainerCreating" I0423 20:43:32.421961 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-2dk8b pod in namespace openshift-dns (previous: false). I0423 20:43:32.443263 1 tasks_processing.go:74] worker 7 stopped. I0423 20:43:32.443310 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=6eea37c0b255e082cc72958f31e696690dacfef5b636e5be804d51cebcc47105 I0423 20:43:32.443356 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=023707bb8c395679623e99d508c6a7a59fd1fee722cebeaaabbdaabc67365470 I0423 20:43:32.443408 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0423 20:43:32.443441 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=4aa6b4be1708e689a5a9c07171940f614a541f76e26f1faf2594334079f9d8eb I0423 20:43:32.443458 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0423 20:43:32.443496 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=e2bfb9ac74cad76601d090545815ba1feaf93c60e30332d8bbb759191dcbda4f I0423 20:43:32.443527 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=332f31c862a80b5ef76a944b7763a22cde090a813f4553a77ecead4dceb27b8e I0423 20:43:32.443549 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=e5b5cdf618ef5108e6b3152bd8aeb34fe8ecbb0db4c167f311bbc25a33521a87 I0423 20:43:32.443564 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=de91166f05bac77f39dc53905ab4bfc2ca67cc08d2904626dea53adc99ca9232 I0423 20:43:32.443580 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=55c9f75b4a01773cfa3cfe0f37e4a0d558327939a2dc26dee7ce9064164c239a I0423 20:43:32.443594 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0423 20:43:32.443610 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=3e933c35103f2dbaffdb2d960530b43bf99bbf3490a19d961f074b2d20445d49 I0423 20:43:32.443621 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0423 20:43:32.443636 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=89c7f8e3098d74f081aabf079d88994156114f807eedf30140f118186f23b5d3 I0423 20:43:32.443646 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0423 20:43:32.443665 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=7b9f22b4d4c8db5a4f55465702bc1f9a254a68109fde579c3bbd36e8b551b6f6 I0423 20:43:32.443674 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0423 20:43:32.443690 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=1c8c6b6c63b004dafa0bedf4d83334a13bbdf6b2b4bfa1b291842489c91c4a65 I0423 20:43:32.443830 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=4ae8b0e30865b62aa30eb6e142156b3595cc8ddec52cce1ac2f382f1bb8974c1 I0423 20:43:32.443840 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0423 20:43:32.443846 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0423 20:43:32.443866 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0423 20:43:32.443890 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=59537336eac8b73c376c1249b2be60579f5a0ce89905216ac1491dec462a02cb I0423 20:43:32.443932 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=74339ef5c7959459c89abce55dc4c61e466048c725cefcb36322f79a73ac97ba I0423 20:43:32.443943 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0423 20:43:32.443962 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=72834d32287505ca89781ea50b1a0396818982c526dbd9ce1eba8f529947a649 I0423 20:43:32.443972 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0423 20:43:32.443985 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=aef5f5e63ade0180ca67c4e1c4e62970d34711600035803ebb874c91e77dba96 I0423 20:43:32.443997 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=0f3fd2901b3071868453e263793f63769f2c1d25c07ac5666f512e36663a2a2c I0423 20:43:32.444011 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=a32e2f0d4d09432c7fc31199be3bea9c6d1b0a775b55a40db010938173cc0c75 I0423 20:43:32.444027 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=25709263698bef205c5fec2e5f81d2b0b72c5d2cfc230098a9466e8e1f02496e I0423 20:43:32.444047 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=589da10cee5a9594020d9590040abb188e108ed70465cc1bd6531132151f8ebf I0423 20:43:32.444056 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0423 20:43:32.444083 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=4dfb7e859f415bf1f1ea3ff57636255284e6df0256ccf8ebcca94efe9fa0700a I0423 20:43:32.444100 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0423 20:43:32.444106 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0423 20:43:32.444112 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.059561122s to process 36 records I0423 20:43:32.624023 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0423 20:43:32.624039 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-jzbqs pod in namespace openshift-dns (previous: false). I0423 20:43:32.856565 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0423 20:43:32.856582 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-rr4wz pod in namespace openshift-dns (previous: false). I0423 20:43:33.034871 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0423 20:43:33.034890 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6c5ccb6fb-2t4mj pod in namespace openshift-image-registry (previous: false). I0423 20:43:33.222092 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6c5ccb6fb-2t4mj pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6c5ccb6fb-2t4mj\" is waiting to start: ContainerCreating" I0423 20:43:33.222109 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6c5ccb6fb-2t4mj\" is waiting to start: ContainerCreating" I0423 20:43:33.222119 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6c5ccb6fb-bgb65 pod in namespace openshift-image-registry (previous: false). W0423 20:43:33.414210 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0423 20:43:33.423298 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6c5ccb6fb-bgb65 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6c5ccb6fb-bgb65\" is waiting to start: ContainerCreating" I0423 20:43:33.423312 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6c5ccb6fb-bgb65\" is waiting to start: ContainerCreating" I0423 20:43:33.423321 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6d44d5bbf5-f4bml pod in namespace openshift-image-registry (previous: false). I0423 20:43:33.619478 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0423 20:43:33.619494 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-7qtq5 pod in namespace openshift-image-registry (previous: false). I0423 20:43:33.822747 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0423 20:43:33.822765 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-bxmzq pod in namespace openshift-image-registry (previous: false). I0423 20:43:34.025224 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0423 20:43:34.025245 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-dfcng pod in namespace openshift-image-registry (previous: false). I0423 20:43:34.224812 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0423 20:43:34.224830 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-67455d6b5-4c8wq pod in namespace openshift-ingress (previous: false). W0423 20:43:34.414586 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0423 20:43:34.423801 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-67455d6b5-4c8wq pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-67455d6b5-4c8wq\" is waiting to start: ContainerCreating" I0423 20:43:34.423817 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-67455d6b5-4c8wq\" is waiting to start: ContainerCreating" I0423 20:43:34.423827 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-67455d6b5-sw7sv pod in namespace openshift-ingress (previous: false). I0423 20:43:34.622050 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-67455d6b5-sw7sv pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-67455d6b5-sw7sv\" is waiting to start: ContainerCreating" I0423 20:43:34.622067 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-67455d6b5-sw7sv\" is waiting to start: ContainerCreating" I0423 20:43:34.622085 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7bcc69756c-9bl9j pod in namespace openshift-ingress (previous: false). I0423 20:43:34.832331 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-7bcc69756c-9bl9j pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-7bcc69756c-9bl9j\" is waiting to start: ContainerCreating" I0423 20:43:34.832348 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-7bcc69756c-9bl9j\" is waiting to start: ContainerCreating" I0423 20:43:34.832358 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-jsc4g pod in namespace openshift-ingress-canary (previous: false). I0423 20:43:35.033965 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-pqfrt pod in namespace openshift-ingress-canary (previous: false). I0423 20:43:35.222553 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-846d9b8bdc-6tf64 pod in namespace openshift-kube-storage-version-migrator (previous: false). W0423 20:43:35.410844 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0423 20:43:35.410868 1 tasks_processing.go:74] worker 19 stopped. E0423 20:43:35.410888 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0423 20:43:35.410905 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0423 20:43:35.410923 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0423 20:43:35.410933 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.025709725s to process 1 records I0423 20:43:35.425328 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-846d9b8bdc-6tf64 pod in namespace openshift-kube-storage-version-migrator (previous: false). I0423 20:43:35.624217 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-74478b59c6-xrzbn pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). I0423 20:43:35.826638 1 tasks_processing.go:74] worker 44 stopped. I0423 20:43:35.826728 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=2dcc2ebc025d0541b6a11a3a802f882c82e5287524ebbc21636c90b382914237 I0423 20:43:35.826777 1 recorder.go:75] Recording events/openshift-dns with fingerprint=ccb83cdb02b027e8f9b73d33de46058c4bd20055ce7696b386c714466d3aac02 I0423 20:43:35.826859 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=f7bbec3a2a6349e85b0616417da266c0872a9c7979ecabf4ed7aa877cb646f4f I0423 20:43:35.826887 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=3aec89d6508c9753344c6ae1dd2b7b3236d133d406901f28108d14646e36d03e I0423 20:43:35.826933 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=af11076fd6728d2a4d371d67603b116e7cbd0558bf5bf131b3ba7e3ec2d57467 I0423 20:43:35.826963 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=e2d2f4cad8c524ebe74853a135efe8f1eb3f87bfc75e9cc50c83b886a7ad100a I0423 20:43:35.826977 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator with fingerprint=8fdf1404d7edc2ee674327d960a9f4c22972a73cb532b7376669fa3451e0edd9 I0423 20:43:35.827024 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=2f122dd7880561764bf5453a61aef15c599b3aa151dd1f0de5ac0f78a5f6435d I0423 20:43:35.827031 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-jsc4g/serve-healthcheck-canary_current.log with fingerprint=6ae20c6913cff432533c0ee11002da2e240ec96e2268f9efe1ec3e21c7441ce7 I0423 20:43:35.827036 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-pqfrt/serve-healthcheck-canary_current.log with fingerprint=42d7f5ddf724ae164c4f304e23c4d293640e103a2a36114144bc2f05dae8636e I0423 20:43:35.827048 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-846d9b8bdc-6tf64/migrator_current.log with fingerprint=a900862cc1f862ded1d13e42834761bfc9f7ef5d367aef6697da1a0b740b18cf I0423 20:43:35.827055 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-846d9b8bdc-6tf64/graceful-termination_current.log with fingerprint=88e60f282cbb3b4a11c52cc28556155eb2060d83ebecd7c44ffd919d4a1b07c3 I0423 20:43:35.827127 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-74478b59c6-xrzbn/kube-storage-version-migrator-operator_current.log with fingerprint=1a7406161bd4323a5e953ca89b6e8342d688822e70147a6229d81a31d3616bdd I0423 20:43:35.827136 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 5.441921101s to process 13 records I0423 20:43:42.698107 1 configmapobserver.go:84] configmaps "insights-config" not found I0423 20:43:43.010676 1 tasks_processing.go:74] worker 0 stopped. I0423 20:43:43.010711 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0423 20:43:43.010723 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.62700225s to process 1 records I0423 20:43:43.072628 1 configmapobserver.go:84] configmaps "insights-config" not found I0423 20:43:43.277044 1 configmapobserver.go:84] configmaps "insights-config" not found I0423 20:43:43.791519 1 tasks_processing.go:74] worker 24 stopped. I0423 20:43:43.791783 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=37b78a794211255319f797e3e69a22df8f5a828f029dbfa0f940236c6e12eaab I0423 20:43:43.791801 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.406882576s to process 1 records E0423 20:43:43.791856 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.408s with: function \"machines\" failed with an error, function \"support_secret\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0423 20:43:43.792958 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "support_secret" failed with an error, function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0423 20:43:43.792974 1 periodic.go:216] Running workloads gatherer I0423 20:43:43.792988 1 tasks_processing.go:45] number of workers: 2 I0423 20:43:43.792999 1 tasks_processing.go:69] worker 1 listening for tasks. I0423 20:43:43.793003 1 tasks_processing.go:71] worker 1 working on workload_info task. I0423 20:43:43.793017 1 tasks_processing.go:69] worker 0 listening for tasks. I0423 20:43:43.793030 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0423 20:43:43.819722 1 tasks_processing.go:74] worker 0 stopped. I0423 20:43:43.819738 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 26.679705ms to process 0 records I0423 20:43:43.839719 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0423 20:43:43.847674 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (9ms) I0423 20:43:43.855655 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (8ms) I0423 20:43:43.864335 1 gather_workloads_info.go:387] No image sha256:e3732e356ae2324565c74cae57d5d016917314fa293ddaa3a68ee9ae030c6f07 (9ms) I0423 20:43:43.874268 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (10ms) I0423 20:43:43.882122 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (8ms) I0423 20:43:43.891744 1 gather_workloads_info.go:387] No image sha256:4733236617781e3469ffffb15e4daaa1f14ea8e1c52b426a3787a4f1f2945424 (10ms) I0423 20:43:43.901497 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (10ms) I0423 20:43:43.911476 1 gather_workloads_info.go:387] No image sha256:e1ba458cf6f0b3606c90880da72db8ab99cd11040bae84baebe3ff2e0d1ea075 (10ms) I0423 20:43:43.920149 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (9ms) I0423 20:43:43.928591 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (8ms) I0423 20:43:43.960566 1 gather_workloads_info.go:387] No image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (32ms) I0423 20:43:44.048925 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (88ms) I0423 20:43:44.147998 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (99ms) I0423 20:43:44.249718 1 gather_workloads_info.go:387] No image sha256:e8b96d9318b3b8c9ed0afe4e6381f635c6b0c2f20772044ac68001ed49af2c87 (102ms) I0423 20:43:44.348716 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (99ms) I0423 20:43:44.448624 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (100ms) I0423 20:43:44.548915 1 gather_workloads_info.go:387] No image sha256:d6fbe0075cbb12bfd287c973704fadf97154c7f73e370733d976a40835e9155a (100ms) I0423 20:43:44.648599 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (100ms) I0423 20:43:44.749263 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (101ms) I0423 20:43:44.848528 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (99ms) I0423 20:43:44.950697 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (102ms) I0423 20:43:45.049094 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (98ms) I0423 20:43:45.148563 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (99ms) I0423 20:43:45.249218 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (101ms) I0423 20:43:45.349428 1 gather_workloads_info.go:387] No image sha256:4b748615a43be416d52c33df03e2cdec89ededded1d6a2ade167c5a955d56e5f (100ms) I0423 20:43:45.449049 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (100ms) I0423 20:43:45.548748 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (100ms) I0423 20:43:45.649104 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (100ms) I0423 20:43:45.748576 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (99ms) I0423 20:43:45.849689 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (101ms) I0423 20:43:45.949900 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (100ms) I0423 20:43:46.048346 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (98ms) I0423 20:43:46.149590 1 gather_workloads_info.go:387] No image sha256:ce138e8cf5b96557b1864ef6f27c2608bdca59be2611804366cef7169c36291e (101ms) I0423 20:43:46.149621 1 tasks_processing.go:74] worker 1 stopped. E0423 20:43:46.149631 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0423 20:43:46.149871 1 recorder.go:75] Recording config/workload_info with fingerprint=a643f39b8c4502004511cc9fdb81150675084101a5544746997bbff902fc5bd5 I0423 20:43:46.149885 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.356611603s to process 1 records E0423 20:43:46.149909 1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.356s with: function \"workload_info\" failed with an error" I0423 20:43:46.151014 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0423 20:43:46.151027 1 periodic.go:216] Running conditional gatherer I0423 20:43:46.156807 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0423 20:43:46.163453 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.10:47147->172.30.0.10:53: read: connection refused E0423 20:43:46.163761 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0423 20:43:46.163818 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0423 20:43:46.169249 1 conditional_gatherer.go:392] cluster version is '4.21.9' E0423 20:43:46.169264 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0423 20:43:46.169271 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0423 20:43:46.169288 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0423 20:43:46.169293 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0423 20:43:46.169297 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0423 20:43:46.169304 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0423 20:43:46.169309 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0423 20:43:46.169314 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0423 20:43:46.169318 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0423 20:43:46.169346 1 tasks_processing.go:45] number of workers: 3 I0423 20:43:46.169362 1 tasks_processing.go:69] worker 2 listening for tasks. I0423 20:43:46.169380 1 tasks_processing.go:69] worker 0 listening for tasks. I0423 20:43:46.169386 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0423 20:43:46.169398 1 tasks_processing.go:69] worker 1 listening for tasks. I0423 20:43:46.169412 1 tasks_processing.go:71] worker 0 working on rapid_container_logs task. I0423 20:43:46.169415 1 tasks_processing.go:74] worker 1 stopped. I0423 20:43:46.169425 1 tasks_processing.go:71] worker 2 working on remote_configuration task. I0423 20:43:46.169490 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0423 20:43:46.169507 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.055µs to process 1 records I0423 20:43:46.169552 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0423 20:43:46.169563 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.385µs to process 1 records I0423 20:43:46.169572 1 tasks_processing.go:74] worker 2 stopped. I0423 20:43:46.169661 1 tasks_processing.go:74] worker 0 stopped. I0423 20:43:46.169673 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 243.19µs to process 0 records I0423 20:43:46.169690 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.10:47147->172.30.0.10:53: read: connection refused I0423 20:43:46.169707 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0423 20:43:46.190819 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=c976c452f7357f469c4d643cf2dd7dd252b7a6bc176061a14f192e95216f7cfc I0423 20:43:46.190938 1 diskrecorder.go:70] Writing 108 records to /var/lib/insights-operator/insights-2026-04-23-204346.tar.gz I0423 20:43:46.197590 1 diskrecorder.go:51] Wrote 108 records to disk in 6ms I0423 20:43:46.197619 1 periodic.go:285] Gathering cluster info every 2h0m0s I0423 20:43:46.197633 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0423 20:43:56.024863 1 configmapobserver.go:84] configmaps "insights-config" not found I0423 20:44:59.912906 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="61dbfb0c1bbe9b3a13a103906e865842188de79803b34119fecc2a83226b9029") W0423 20:44:59.912943 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0423 20:44:59.912996 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0423 20:44:59.913011 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="bf4c33b43ba1b63d2056dc67debdc3b4e7424a386a884532b958d36a942884ad") I0423 20:44:59.913027 1 base_controller.go:181] Shutting down ConfigController ... I0423 20:44:59.913051 1 periodic.go:177] Shutting down I0423 20:44:59.913061 1 base_controller.go:181] Shutting down LoggingSyncer ... I0423 20:44:59.913073 1 base_controller.go:123] Shutting down worker of ConfigController controller ... I0423 20:44:59.913072 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0423 20:44:59.913085 1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ... I0423 20:44:59.913081 1 base_controller.go:113] All ConfigController workers have been terminated I0423 20:44:59.913091 1 base_controller.go:113] All LoggingSyncer workers have been terminated I0423 20:44:59.913122 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="e5f5137aa34f2d1d600fff8e2406befdcfbfdb9db8c7b4f561305395b7782128") I0423 20:44:59.913138 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated"