I0507 14:40:00.160083 1 cmd.go:253] Using service-serving-cert provided certificates I0507 14:40:00.160499 1 observer_polling.go:159] Starting file observer I0507 14:40:00.775020 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0507 14:40:00.775205 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0507 14:40:00.775643 1 secure_serving.go:57] Forcing use of http/1.1 only W0507 14:40:00.775666 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0507 14:40:00.775673 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0507 14:40:00.775680 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0507 14:40:00.775684 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0507 14:40:00.775689 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0507 14:40:00.775693 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0507 14:40:00.775841 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0507 14:40:00.781108 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0507 14:40:00.781125 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0507 14:40:00.781166 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0507 14:40:00.781185 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0507 14:40:00.781171 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0507 14:40:00.781197 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0507 14:40:00.781426 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0507 14:40:00.781573 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0507 14:40:00.781650 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"d9e67393-e007-4cb4-a4d4-9e7b39ccaa28", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0507 14:40:00.781691 1 secure_serving.go:213] Serving securely on [::]:8443 I0507 14:40:00.781718 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0507 14:40:00.790751 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0507 14:40:00.790773 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0507 14:40:00.790887 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0507 14:40:00.796563 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 14:40:00.796579 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0507 14:40:00.802971 1 secretconfigobserver.go:119] support secret does not exist I0507 14:40:00.806873 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 14:40:00.810555 1 secretconfigobserver.go:119] support secret does not exist I0507 14:40:00.813068 1 recorder.go:176] Pruning old reports every 8h9m39s, max age is 288h0m0s I0507 14:40:00.817261 1 periodic.go:216] Running clusterconfig gatherer I0507 14:40:00.817275 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0507 14:40:00.817311 1 insightsreport.go:296] Starting report retriever I0507 14:40:00.817261 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0507 14:40:00.817316 1 tasks_processing.go:45] number of workers: 64 I0507 14:40:00.817317 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0507 14:40:00.817327 1 tasks_processing.go:69] worker 0 listening for tasks. I0507 14:40:00.817328 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0507 14:40:00.817337 1 tasks_processing.go:69] worker 6 listening for tasks. I0507 14:40:00.817346 1 tasks_processing.go:69] worker 1 listening for tasks. I0507 14:40:00.817354 1 tasks_processing.go:69] worker 2 listening for tasks. I0507 14:40:00.817359 1 tasks_processing.go:69] worker 23 listening for tasks. I0507 14:40:00.817362 1 tasks_processing.go:69] worker 3 listening for tasks. I0507 14:40:00.817365 1 tasks_processing.go:69] worker 7 listening for tasks. I0507 14:40:00.817370 1 tasks_processing.go:69] worker 4 listening for tasks. I0507 14:40:00.817374 1 tasks_processing.go:69] worker 8 listening for tasks. I0507 14:40:00.817375 1 tasks_processing.go:71] worker 4 working on machine_healthchecks task. I0507 14:40:00.817376 1 tasks_processing.go:69] worker 40 listening for tasks. I0507 14:40:00.817381 1 tasks_processing.go:69] worker 9 listening for tasks. I0507 14:40:00.817382 1 tasks_processing.go:69] worker 41 listening for tasks. I0507 14:40:00.817386 1 tasks_processing.go:69] worker 24 listening for tasks. I0507 14:40:00.817387 1 tasks_processing.go:69] worker 10 listening for tasks. I0507 14:40:00.817391 1 tasks_processing.go:69] worker 42 listening for tasks. I0507 14:40:00.817391 1 tasks_processing.go:69] worker 11 listening for tasks. I0507 14:40:00.817397 1 tasks_processing.go:69] worker 12 listening for tasks. I0507 14:40:00.817399 1 tasks_processing.go:69] worker 26 listening for tasks. I0507 14:40:00.817395 1 tasks_processing.go:69] worker 25 listening for tasks. I0507 14:40:00.817404 1 tasks_processing.go:69] worker 43 listening for tasks. I0507 14:40:00.817404 1 tasks_processing.go:69] worker 13 listening for tasks. I0507 14:40:00.817408 1 tasks_processing.go:69] worker 14 listening for tasks. I0507 14:40:00.817413 1 tasks_processing.go:71] worker 13 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0507 14:40:00.817410 1 tasks_processing.go:69] worker 5 listening for tasks. I0507 14:40:00.817424 1 tasks_processing.go:69] worker 30 listening for tasks. I0507 14:40:00.817426 1 tasks_processing.go:69] worker 21 listening for tasks. I0507 14:40:00.817414 1 tasks_processing.go:71] worker 43 working on authentication task. I0507 14:40:00.817433 1 tasks_processing.go:71] worker 26 working on node_logs task. I0507 14:40:00.817436 1 tasks_processing.go:71] worker 40 working on crds task. I0507 14:40:00.817439 1 tasks_processing.go:69] worker 15 listening for tasks. I0507 14:40:00.817445 1 tasks_processing.go:69] worker 33 listening for tasks. I0507 14:40:00.817438 1 tasks_processing.go:71] worker 10 working on ingress_certificates task. I0507 14:40:00.817450 1 tasks_processing.go:71] worker 41 working on node_features task. I0507 14:40:00.817460 1 tasks_processing.go:69] worker 16 listening for tasks. I0507 14:40:00.817458 1 tasks_processing.go:71] worker 9 working on schedulers task. I0507 14:40:00.817466 1 tasks_processing.go:69] worker 17 listening for tasks. I0507 14:40:00.817471 1 tasks_processing.go:71] worker 24 working on mutating_webhook_configurations task. I0507 14:40:00.817469 1 tasks_processing.go:71] worker 12 working on tsdb_status task. I0507 14:40:00.817492 1 tasks_processing.go:69] worker 22 listening for tasks. I0507 14:40:00.817507 1 tasks_processing.go:69] worker 36 listening for tasks. I0507 14:40:00.817515 1 tasks_processing.go:69] worker 37 listening for tasks. I0507 14:40:00.817415 1 tasks_processing.go:69] worker 19 listening for tasks. I0507 14:40:00.817420 1 tasks_processing.go:69] worker 20 listening for tasks. I0507 14:40:00.817421 1 tasks_processing.go:71] worker 8 working on oauths task. I0507 14:40:00.817528 1 tasks_processing.go:69] worker 38 listening for tasks. I0507 14:40:00.817535 1 tasks_processing.go:69] worker 35 listening for tasks. I0507 14:40:00.817427 1 tasks_processing.go:71] worker 11 working on openstack_controlplanes task. I0507 14:40:00.817544 1 tasks_processing.go:69] worker 50 listening for tasks. I0507 14:40:00.817546 1 tasks_processing.go:69] worker 53 listening for tasks. I0507 14:40:00.817427 1 tasks_processing.go:69] worker 18 listening for tasks. I0507 14:40:00.817552 1 tasks_processing.go:69] worker 46 listening for tasks. I0507 14:40:00.817551 1 tasks_processing.go:69] worker 57 listening for tasks. I0507 14:40:00.817562 1 tasks_processing.go:69] worker 51 listening for tasks. I0507 14:40:00.817557 1 tasks_processing.go:69] worker 59 listening for tasks. I0507 14:40:00.817567 1 tasks_processing.go:69] worker 48 listening for tasks. I0507 14:40:00.817570 1 tasks_processing.go:71] worker 1 working on nodenetworkconfigurationpolicies task. I0507 14:40:00.817572 1 tasks_processing.go:69] worker 61 listening for tasks. I0507 14:40:00.817578 1 tasks_processing.go:69] worker 49 listening for tasks. I0507 14:40:00.817574 1 tasks_processing.go:69] worker 45 listening for tasks. I0507 14:40:00.817571 1 tasks_processing.go:69] worker 52 listening for tasks. I0507 14:40:00.817585 1 tasks_processing.go:69] worker 56 listening for tasks. I0507 14:40:00.817590 1 tasks_processing.go:71] worker 23 working on install_plans task. I0507 14:40:00.817593 1 tasks_processing.go:69] worker 63 listening for tasks. I0507 14:40:00.817598 1 tasks_processing.go:71] worker 14 working on openshift_machine_api_events task. I0507 14:40:00.817601 1 tasks_processing.go:71] worker 22 working on machine_sets task. I0507 14:40:00.817603 1 tasks_processing.go:71] worker 5 working on nodenetworkstates task. I0507 14:40:00.817606 1 tasks_processing.go:71] worker 63 working on openstack_dataplanedeployments task. I0507 14:40:00.817424 1 tasks_processing.go:71] worker 42 working on version task. I0507 14:40:00.817438 1 tasks_processing.go:69] worker 32 listening for tasks. I0507 14:40:00.817761 1 tasks_processing.go:71] worker 32 working on sap_datahubs task. I0507 14:40:00.817578 1 tasks_processing.go:69] worker 54 listening for tasks. I0507 14:40:00.817419 1 tasks_processing.go:69] worker 29 listening for tasks. I0507 14:40:00.817597 1 tasks_processing.go:71] worker 30 working on cluster_apiserver task. I0507 14:40:00.817374 1 tasks_processing.go:71] worker 7 working on infrastructures task. I0507 14:40:00.817926 1 tasks_processing.go:71] worker 29 working on openstack_version task. I0507 14:40:00.817930 1 tasks_processing.go:71] worker 54 working on aggregated_monitoring_cr_names task. I0507 14:40:00.817532 1 tasks_processing.go:69] worker 39 listening for tasks. I0507 14:40:00.818057 1 tasks_processing.go:71] worker 39 working on ceph_cluster task. I0507 14:40:00.817671 1 tasks_processing.go:71] worker 49 working on storage_cluster task. I0507 14:40:00.817532 1 tasks_processing.go:69] worker 34 listening for tasks. I0507 14:40:00.817540 1 tasks_processing.go:71] worker 0 working on operators_pods_and_events task. I0507 14:40:00.817547 1 tasks_processing.go:69] worker 58 listening for tasks. I0507 14:40:00.817552 1 tasks_processing.go:69] worker 47 listening for tasks. I0507 14:40:00.817431 1 tasks_processing.go:71] worker 25 working on machine_autoscalers task. I0507 14:40:00.818158 1 tasks_processing.go:71] worker 47 working on machines task. I0507 14:40:00.818174 1 tasks_processing.go:71] worker 34 working on validating_webhook_configurations task. I0507 14:40:00.817414 1 tasks_processing.go:69] worker 28 listening for tasks. I0507 14:40:00.818199 1 tasks_processing.go:71] worker 28 working on pod_network_connectivity_checks task. I0507 14:40:00.818199 1 tasks_processing.go:71] worker 58 working on sap_config task. I0507 14:40:00.817565 1 tasks_processing.go:71] worker 6 working on openshift_logging task. I0507 14:40:00.817564 1 tasks_processing.go:69] worker 60 listening for tasks. I0507 14:40:00.818238 1 tasks_processing.go:71] worker 60 working on image_registries task. I0507 14:40:00.817566 1 tasks_processing.go:69] worker 44 listening for tasks. I0507 14:40:00.817584 1 tasks_processing.go:71] worker 3 working on support_secret task. I0507 14:40:00.818369 1 tasks_processing.go:71] worker 44 working on ingress task. I0507 14:40:00.817586 1 tasks_processing.go:69] worker 62 listening for tasks. I0507 14:40:00.818407 1 tasks_processing.go:71] worker 62 working on machine_configs task. I0507 14:40:00.817587 1 tasks_processing.go:71] worker 2 working on silenced_alerts task. I0507 14:40:00.817408 1 tasks_processing.go:69] worker 27 listening for tasks. I0507 14:40:00.818452 1 tasks_processing.go:71] worker 27 working on nodes task. I0507 14:40:00.817585 1 tasks_processing.go:69] worker 55 listening for tasks. I0507 14:40:00.817656 1 tasks_processing.go:71] worker 33 working on operators task. I0507 14:40:00.818477 1 tasks_processing.go:71] worker 55 working on container_images task. I0507 14:40:00.817659 1 tasks_processing.go:71] worker 61 working on certificate_signing_requests task. I0507 14:40:00.817659 1 tasks_processing.go:71] worker 46 working on cost_management_metrics_configs task. I0507 14:40:00.817661 1 tasks_processing.go:71] worker 21 working on metrics task. I0507 14:40:00.817661 1 tasks_processing.go:71] worker 45 working on monitoring_persistent_volumes task. I0507 14:40:00.817662 1 tasks_processing.go:71] worker 57 working on config_maps task. I0507 14:40:00.817663 1 tasks_processing.go:71] worker 36 working on feature_gates task. I0507 14:40:00.817667 1 tasks_processing.go:71] worker 59 working on dvo_metrics task. I0507 14:40:00.817666 1 tasks_processing.go:71] worker 15 working on olm_operators task. I0507 14:40:00.817666 1 tasks_processing.go:71] worker 48 working on jaegers task. I0507 14:40:00.817670 1 tasks_processing.go:71] worker 37 working on proxies task. I0507 14:40:00.817674 1 tasks_processing.go:71] worker 50 working on image_pruners task. I0507 14:40:00.817673 1 tasks_processing.go:71] worker 35 working on machine_config_pools task. I0507 14:40:00.817672 1 tasks_processing.go:71] worker 51 working on service_accounts task. I0507 14:40:00.817673 1 tasks_processing.go:71] worker 56 working on storage_classes task. I0507 14:40:00.817678 1 tasks_processing.go:71] worker 19 working on active_alerts task. I0507 14:40:00.817669 1 tasks_processing.go:71] worker 52 working on overlapping_namespace_uids task. I0507 14:40:00.817679 1 tasks_processing.go:71] worker 16 working on openstack_dataplanenodesets task. I0507 14:40:00.817681 1 tasks_processing.go:71] worker 38 working on pdbs task. I0507 14:40:00.817679 1 tasks_processing.go:71] worker 20 working on networks task. I0507 14:40:00.817686 1 tasks_processing.go:71] worker 17 working on clusterroles task. I0507 14:40:00.817687 1 tasks_processing.go:71] worker 18 working on container_runtime_configs task. I0507 14:40:00.817677 1 tasks_processing.go:71] worker 53 working on image task. I0507 14:40:00.817432 1 tasks_processing.go:69] worker 31 listening for tasks. I0507 14:40:00.819600 1 tasks_processing.go:71] worker 31 working on lokistack task. E0507 14:40:00.821016 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0507 14:40:00.821033 1 tasks_processing.go:71] worker 41 working on sap_pods task. I0507 14:40:00.821052 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 3.565779ms to process 0 records E0507 14:40:00.821066 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0507 14:40:00.821072 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 3.666172ms to process 0 records I0507 14:40:00.821113 1 tasks_processing.go:71] worker 4 working on qemu_kubevirt_launcher_logs task. E0507 14:40:00.823995 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.75.141:9091: connect: connection refused I0507 14:40:00.824013 1 tasks_processing.go:74] worker 12 stopped. E0507 14:40:00.823998 1 gather_active_alerts.go:64] Unable to retrieve most recent alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.192.219:9094: connect: connection refused E0507 14:40:00.824020 1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.75.141:9091: connect: connection refused I0507 14:40:00.824030 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 6.529381ms to process 0 records E0507 14:40:00.824034 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.75.141:9091: connect: connection refused E0507 14:40:00.824042 1 gather.go:140] gatherer "clusterconfig" function "active_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.192.219:9094: connect: connection refused E0507 14:40:00.824048 1 gather_silenced_alerts.go:52] Unable to retrieve silenced alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.192.219:9094: connect: connection refused I0507 14:40:00.824052 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 4.768521ms to process 0 records E0507 14:40:00.824067 1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.75.141:9091: connect: connection refused I0507 14:40:00.824089 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 5.398682ms to process 0 records E0507 14:40:00.824100 1 gather.go:140] gatherer "clusterconfig" function "silenced_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.192.219:9094: connect: connection refused I0507 14:40:00.824111 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 5.640819ms to process 0 records I0507 14:40:00.824113 1 tasks_processing.go:74] worker 21 stopped. I0507 14:40:00.824053 1 tasks_processing.go:74] worker 19 stopped. I0507 14:40:00.824119 1 tasks_processing.go:74] worker 2 stopped. I0507 14:40:00.824575 1 tasks_processing.go:74] worker 22 stopped. I0507 14:40:00.824587 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 6.969224ms to process 0 records I0507 14:40:00.824592 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 7.039214ms to process 0 records I0507 14:40:00.824600 1 tasks_processing.go:74] worker 11 stopped. I0507 14:40:00.824612 1 tasks_processing.go:74] worker 5 stopped. I0507 14:40:00.824630 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 6.999336ms to process 0 records I0507 14:40:00.824643 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 6.844615ms to process 0 records I0507 14:40:00.824651 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 7.021211ms to process 0 records I0507 14:40:00.824658 1 tasks_processing.go:74] worker 63 stopped. I0507 14:40:00.824660 1 tasks_processing.go:74] worker 32 stopped. I0507 14:40:00.825021 1 tasks_processing.go:74] worker 9 stopped. I0507 14:40:00.825021 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0507 14:40:00.825040 1 controller.go:368] The initial operator extension status is healthy I0507 14:40:00.825049 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0507 14:40:00.825053 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0507 14:40:00.825056 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0507 14:40:00.825071 1 controller.go:531] The operator is still being initialized I0507 14:40:00.825080 1 controller.go:554] The operator is healthy I0507 14:40:00.825112 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=78bc487172840979eba2633319948c1214c1caf837b91d79d70ec58d66dcb2b8 I0507 14:40:00.825134 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 7.546264ms to process 1 records I0507 14:40:00.825146 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0507 14:40:00.825135 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s W0507 14:40:00.825248 1 operator.go:328] started I0507 14:40:00.825263 1 tasks_processing.go:74] worker 43 stopped. I0507 14:40:00.825265 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0507 14:40:00.825376 1 recorder.go:75] Recording config/authentication with fingerprint=472803d4a160d507a5e9732ed6dbe320016addadadf5c00da53a52e1b1b01522 I0507 14:40:00.825392 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 7.584186ms to process 1 records I0507 14:40:00.827719 1 tasks_processing.go:74] worker 30 stopped. I0507 14:40:00.827851 1 recorder.go:75] Recording config/apiserver with fingerprint=1eeb5a76783aa6143aa0a4d3809542e06adce2b9eb4c6ff844489a8405b18404 I0507 14:40:00.827864 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 9.912081ms to process 1 records I0507 14:40:00.833470 1 tasks_processing.go:74] worker 25 stopped. I0507 14:40:00.833483 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 15.357582ms to process 0 records I0507 14:40:00.833489 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 15.25253ms to process 0 records I0507 14:40:00.833493 1 tasks_processing.go:74] worker 6 stopped. I0507 14:40:00.837480 1 tasks_processing.go:74] worker 3 stopped. E0507 14:40:00.837492 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0507 14:40:00.837498 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 19.172013ms to process 0 records I0507 14:40:00.837663 1 tasks_processing.go:74] worker 7 stopped. I0507 14:40:00.838121 1 recorder.go:75] Recording config/infrastructure with fingerprint=cc9f4e5a4d7c65e4207d6b3d2efba43b483d689e41b4f0d43541cdd92e68defa I0507 14:40:00.838134 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 19.836592ms to process 1 records I0507 14:40:00.838223 1 tasks_processing.go:74] worker 44 stopped. I0507 14:40:00.838246 1 recorder.go:75] Recording config/ingress with fingerprint=97b2066d52359c8efbe5dbcd09c924ec8bd270a073e579dd87ff0e6c3ab35516 I0507 14:40:00.838252 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 19.487997ms to process 1 records I0507 14:40:00.838332 1 tasks_processing.go:74] worker 8 stopped. I0507 14:40:00.838403 1 recorder.go:75] Recording config/oauth with fingerprint=aa6a5ae27a9736703b671554db9cb8b8105d1fb777cbf73acc3b9c0589217f64 I0507 14:40:00.838411 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 20.419894ms to process 1 records I0507 14:40:00.838491 1 tasks_processing.go:74] worker 60 stopped. I0507 14:40:00.838789 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=fd99f2a73f55e91b566815c917ac2592c80e24ee320e0a5c694c602c6116cd10 I0507 14:40:00.838799 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 20.026436ms to process 1 records I0507 14:40:00.840655 1 tasks_processing.go:74] worker 28 stopped. E0507 14:40:00.840669 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0507 14:40:00.840697 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 22.449838ms to process 0 records I0507 14:40:00.840704 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 22.591867ms to process 0 records I0507 14:40:00.840708 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 23.08086ms to process 0 records I0507 14:40:00.840712 1 tasks_processing.go:74] worker 1 stopped. I0507 14:40:00.840715 1 tasks_processing.go:74] worker 39 stopped. I0507 14:40:00.840757 1 tasks_processing.go:74] worker 29 stopped. I0507 14:40:00.840767 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 22.821356ms to process 0 records I0507 14:40:00.840798 1 tasks_processing.go:74] worker 47 stopped. E0507 14:40:00.840815 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0507 14:40:00.840827 1 gather.go:177] gatherer "clusterconfig" function "machines" took 22.623572ms to process 0 records I0507 14:40:00.840837 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 22.62294ms to process 0 records I0507 14:40:00.840844 1 tasks_processing.go:74] worker 58 stopped. I0507 14:40:00.841795 1 tasks_processing.go:74] worker 35 stopped. I0507 14:40:00.841805 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 22.656538ms to process 0 records I0507 14:40:00.841816 1 tasks_processing.go:74] worker 26 stopped. I0507 14:40:00.841825 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 24.373394ms to process 0 records E0507 14:40:00.841832 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0507 14:40:00.841853 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0507 14:40:00.841864 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 23.407958ms to process 1 records I0507 14:40:00.841870 1 tasks_processing.go:74] worker 62 stopped. I0507 14:40:00.842034 1 tasks_processing.go:74] worker 34 stopped. I0507 14:40:00.842183 1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=875a309b8f223c2d14433f4b5b040cdf4f92c5966ff2de16f90caf05ea160262 I0507 14:40:00.842242 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=63c007e18da1c1911aa760d03379a8bf3445b782dcd6fe9402753a32c5da9bbd I0507 14:40:00.842314 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=ef35bd81f48139bb68cb065de0322a9ddd2ce2ed0a36f1346570e34415a59041 I0507 14:40:00.842337 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=7dd291b57d83debdaf156e212c93b137aa4752dcc1ddbc6fdec56a21d42e1082 I0507 14:40:00.842359 1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=6a0123ef9bb2af5fd7bf9c9462937b70a13277d51423eedb116e3da77f023e50 I0507 14:40:00.842388 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=e15c0b1db32e10d66539bf217dfd86a4ed54f286ec8e2b5939bf586aec146f88 I0507 14:40:00.842418 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=ebbc34cc0e30d13a8a17afc4d725d35a45435e150c6bacb39e0b38088d4aca01 I0507 14:40:00.842450 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=630750c1ccbbddf3b7e8d2077b3fc934d40528e1fbb036cd1f32c49c223a5d90 I0507 14:40:00.842480 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=93dcfdb49a455957aed5eefb0ef492600ebddd7e108254490c9dba42b2930ca4 I0507 14:40:00.842518 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=710070f0afbfa8bf41717e4242f87101699f9ce1b097b2847cc3db3114875793 I0507 14:40:00.842546 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=774547c3b22efe6ec1ca7dd7b9635587e7890a1955a13f86906846743b151980 I0507 14:40:00.842579 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=d1cb858a21a5d53fb3bd3c434229b02450b097c8fe7b44676d5845355d44657e I0507 14:40:00.842608 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=3596e8175ac33de06e2db71bfc7ce09b93010b7dbd2463770fdcbc83bd9ddf96 I0507 14:40:00.842616 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 23.846237ms to process 13 records I0507 14:40:00.842705 1 tasks_processing.go:74] worker 27 stopped. I0507 14:40:00.842869 1 recorder.go:75] Recording config/node/ip-10-0-0-60.ec2.internal with fingerprint=c8fe41d5e5a7cfb352701e4e3e1268fec3ff269f12c795cb1d952554517674bf I0507 14:40:00.842950 1 recorder.go:75] Recording config/node/ip-10-0-1-137.ec2.internal with fingerprint=c295a52ac9b6e9e51ec2faf674860b7ca156d4ff307cbadb416f4e74ede25f8c I0507 14:40:00.843000 1 recorder.go:75] Recording config/node/ip-10-0-2-231.ec2.internal with fingerprint=ece0250cb54d3b9aed8315bbd447edc37016013b3f2b9eb81a067919bdfef80c I0507 14:40:00.843008 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 23.580193ms to process 3 records I0507 14:40:00.844252 1 tasks_processing.go:74] worker 61 stopped. I0507 14:40:00.844267 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 25.756742ms to process 0 records I0507 14:40:00.844343 1 tasks_processing.go:74] worker 24 stopped. I0507 14:40:00.844637 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=7192d87da4d04658ed03c431228a94cc363ae4d66a2cd62eb215f95312c77905 I0507 14:40:00.844776 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=ac4c741dcc0f20ae0f737bacde60d03546ebd5951d142be12365d53fb9d548d1 I0507 14:40:00.844852 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=ae50c7e1b1a4a2c0fdd3e0a13af0b08b113868687ff6e950008b2f7b4f6fe868 I0507 14:40:00.844906 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 26.776414ms to process 3 records I0507 14:40:00.844937 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 26.673068ms to process 0 records I0507 14:40:00.844965 1 tasks_processing.go:74] worker 14 stopped. I0507 14:40:00.846763 1 tasks_processing.go:74] worker 50 stopped. I0507 14:40:00.846862 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=1ea4381ed72b5e1f5f2227e5517e659c95886be0470655d2e7d7f3f2e8263e37 I0507 14:40:00.846877 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 27.739529ms to process 1 records I0507 14:40:00.848456 1 tasks_processing.go:74] worker 16 stopped. I0507 14:40:00.848478 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 29.169168ms to process 0 records I0507 14:40:00.848598 1 tasks_processing.go:74] worker 37 stopped. I0507 14:40:00.848665 1 recorder.go:75] Recording config/proxy with fingerprint=d311faa604beab10e6fa4f1777d9f146594a3dca5190a05e130b712f21a65955 I0507 14:40:00.848682 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 29.591716ms to process 1 records I0507 14:40:00.857880 1 tasks_processing.go:74] worker 48 stopped. I0507 14:40:00.857893 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 38.919181ms to process 0 records I0507 14:40:00.858009 1 tasks_processing.go:74] worker 46 stopped. I0507 14:40:00.858022 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 39.501033ms to process 0 records I0507 14:40:00.859588 1 tasks_processing.go:74] worker 49 stopped. I0507 14:40:00.859603 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 41.510298ms to process 0 records I0507 14:40:00.859907 1 tasks_processing.go:74] worker 45 stopped. I0507 14:40:00.859921 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 41.21111ms to process 0 records I0507 14:40:00.861771 1 tasks_processing.go:74] worker 31 stopped. I0507 14:40:00.861786 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 42.162426ms to process 0 records I0507 14:40:00.861797 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 42.247834ms to process 0 records I0507 14:40:00.861804 1 tasks_processing.go:74] worker 18 stopped. I0507 14:40:00.861880 1 tasks_processing.go:74] worker 41 stopped. I0507 14:40:00.861888 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 40.842401ms to process 0 records I0507 14:40:00.862226 1 tasks_processing.go:74] worker 52 stopped. I0507 14:40:00.862248 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0507 14:40:00.862257 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 42.952457ms to process 1 records W0507 14:40:00.864432 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 14:40:00.865850 1 tasks_processing.go:74] worker 42 stopped. I0507 14:40:00.866608 1 recorder.go:75] Recording config/version with fingerprint=39addcef7456aa0faf166ce80c01ace9bc095271ac25a84995a9b1785d740293 I0507 14:40:00.866672 1 recorder.go:75] Recording config/id with fingerprint=e398fc34e75682b693f5deaa88af9d1945f4df3550c210f810bb23dd1a0eec66 I0507 14:40:00.866688 1 gather.go:177] gatherer "clusterconfig" function "version" took 48.230803ms to process 2 records I0507 14:40:00.866855 1 recorder.go:75] Recording config/image with fingerprint=cb617f42d1683f54bdf80e0a09949b85354fd09eb9a5baa36f1cae2c48b52fe1 I0507 14:40:00.866868 1 gather.go:177] gatherer "clusterconfig" function "image" took 46.420998ms to process 1 records I0507 14:40:00.866873 1 tasks_processing.go:74] worker 53 stopped. I0507 14:40:00.866883 1 tasks_processing.go:74] worker 20 stopped. I0507 14:40:00.867129 1 recorder.go:75] Recording config/network with fingerprint=f3c7f6fe380a239ecd5a1eff60dbc7c2db0938b343bdeed2abd190facca0fc23 I0507 14:40:00.867152 1 gather.go:177] gatherer "clusterconfig" function "networks" took 47.540853ms to process 1 records I0507 14:40:00.872031 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0507 14:40:00.872051 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0507 14:40:00.872056 1 controller.go:254] Source scaController *sca.Controller is not ready I0507 14:40:00.872060 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0507 14:40:00.872063 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0507 14:40:00.872079 1 controller.go:531] The operator is still being initialized I0507 14:40:00.872085 1 controller.go:554] The operator is healthy I0507 14:40:00.872138 1 gather_logs.go:145] no pods in namespace were found I0507 14:40:00.872152 1 tasks_processing.go:74] worker 4 stopped. I0507 14:40:00.872161 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 51.027727ms to process 0 records I0507 14:40:00.872596 1 tasks_processing.go:74] worker 56 stopped. I0507 14:40:00.872672 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=5efbac2a116ef562f4fe04ddc03f7f4f8e21747bf089411a131cae583da98e41 I0507 14:40:00.872687 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=c970dd5b880c3871dc8f4b29d612497f96da168e8585d760d10b095e330e6af6 I0507 14:40:00.872693 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 53.352602ms to process 2 records I0507 14:40:00.872748 1 tasks_processing.go:74] worker 38 stopped. I0507 14:40:00.872781 1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=2d20b1590e1f54cb7d9e0408b6d6d52363c5186c19b34d3a5fa8fd0fc78c4478 I0507 14:40:00.872798 1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=ee2e0738cdc4501efd5b56b2e9272a0489c4a718186045c1503fc47b00a0a396 I0507 14:40:00.872810 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=f313b208e1597134d67a5c859532b09288ccd0b5c622fd4ed615d1769433afaf I0507 14:40:00.872824 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=e8eac6d0528f4be806f0a0dcddd258078562d14c78a5b31aaab72f2306449a6e I0507 14:40:00.872838 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=b7e793ab4bde9335b74489bdba7be63952550e6dac415edcf9d1194b11d77140 I0507 14:40:00.872853 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=6cedbcc726560255c54044cc5efdfc0e14cc2f4d04fb649722f9b8eddf4d11bf I0507 14:40:00.872866 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=d2ecd0888f76945e5729a9760977c91ea78acca6debbec2bbac68d8c3a45673d I0507 14:40:00.872882 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=1f0b55d5daeda415555d3d6b0d8f59b0f17084cc678cd8b7245d6418f79be3ad I0507 14:40:00.872899 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=28a255ddaddca9d1e2d3a6b40affab7432d0cea6bb195e3d7957d07978cd1ddc I0507 14:40:00.872923 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=94405b4fefcf57e71149da6570ad41c36a2736841df1060261db8b02e6099d2d I0507 14:40:00.872931 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 53.347941ms to process 10 records I0507 14:40:00.872940 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 54.784138ms to process 0 records I0507 14:40:00.872946 1 tasks_processing.go:74] worker 54 stopped. I0507 14:40:00.873955 1 tasks_processing.go:74] worker 36 stopped. I0507 14:40:00.874110 1 recorder.go:75] Recording config/featuregate with fingerprint=21646047e5d33473435647848adfb78562c05c9526912e6e8c1c26359e47454a I0507 14:40:00.874128 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 55.154059ms to process 1 records I0507 14:40:00.874414 1 tasks_processing.go:74] worker 40 stopped. I0507 14:40:00.875179 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=bdf8c5f1439762f0775b3601a1c1f3198dc8edd97356242da30f970fb93926a9 I0507 14:40:00.875507 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=cb7f9d0450c34ab7af242201429436ac6c225b426fe04f0a58273af46ea3e214 I0507 14:40:00.875521 1 gather.go:177] gatherer "clusterconfig" function "crds" took 56.963293ms to process 2 records I0507 14:40:00.881291 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0507 14:40:00.881347 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0507 14:40:00.881352 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0507 14:40:00.881368 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0507 14:40:00.885683 1 tasks_processing.go:74] worker 15 stopped. I0507 14:40:00.885769 1 recorder.go:75] Recording config/olm_operators with fingerprint=b3f5290e18c7214af2197f377b6010ac3182c13ca585fecbab0a07b4c740aca4 I0507 14:40:00.885785 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 66.749558ms to process 1 records I0507 14:40:00.887272 1 tasks_processing.go:74] worker 17 stopped. I0507 14:40:00.887555 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=558bb7d792bd2c82ecb62d895badca7026a736998e814a35edd33de44fac8432 I0507 14:40:00.887753 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=b7c363d44df03d6177813e53624515391457576601fd3d246a1919455490f980 I0507 14:40:00.887797 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 67.809001ms to process 2 records I0507 14:40:00.890930 1 base_controller.go:82] Caches are synced for ConfigController I0507 14:40:00.890950 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0507 14:40:00.899699 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 14:40:00.903456 1 tasks_processing.go:74] worker 57 stopped. E0507 14:40:00.903471 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0507 14:40:00.903478 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0507 14:40:00.903482 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0507 14:40:00.903493 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0507 14:40:00.903529 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0507 14:40:00.903536 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0507 14:40:00.903540 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0507 14:40:00.903551 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0507 14:40:00.903602 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0507 14:40:00.903610 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0507 14:40:00.903615 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 84.732655ms to process 7 records I0507 14:40:00.904685 1 tasks_processing.go:74] worker 55 stopped. I0507 14:40:00.905922 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-66dbbb6468-m9pnt with fingerprint=12bc6667b324ba324a241e2c4de0ca2d242476ba30b0f92849cf44a901dc63e7 I0507 14:40:00.906194 1 recorder.go:75] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-tml4k with fingerprint=4442cf697453ccc660f942b9ca27a004ef20dfcff71c56fb9151d0b57fe60259 I0507 14:40:00.906261 1 recorder.go:75] Recording config/running_containers with fingerprint=5159eb301334480cf9b6c5b01b6ccac9461547d55fa29b01edca2f04b8c43642 I0507 14:40:00.906271 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 86.19007ms to process 3 records I0507 14:40:00.906817 1 tasks_processing.go:74] worker 10 stopped. E0507 14:40:00.906833 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0507 14:40:00.906841 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2q552nne5p4mvs6dsntuvoi35hamtftd-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2q552nne5p4mvs6dsntuvoi35hamtftd-primary-cert-bundle-secret" not found I0507 14:40:00.906899 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=af0c76b41e56da9b2c176a07940789214836f103ea6ca876d3836b4f7a1e9be8 I0507 14:40:00.906915 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 89.358586ms to process 1 records I0507 14:40:00.906932 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 89.438217ms to process 0 records I0507 14:40:00.906942 1 tasks_processing.go:74] worker 13 stopped. I0507 14:40:00.926130 1 base_controller.go:82] Caches are synced for LoggingSyncer I0507 14:40:00.926143 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0507 14:40:00.936705 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0507 14:40:00.940758 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0507 14:40:01.019611 1 cluster_transfer.go:102] no available accepted cluster transfer I0507 14:40:01.019629 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0507 14:40:01.029111 1 sca.go:266] etc-pki-entitlement secret successfully created I0507 14:40:01.029129 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I0507 14:40:01.152677 1 gather_cluster_operator_pods_and_events.go:121] Found 12 pods with 15 containers I0507 14:40:01.152692 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1677721 bytes I0507 14:40:01.153720 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-dgj97 pod in namespace openshift-dns (previous: false). I0507 14:40:01.163262 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-dgj97 pod in namespace openshift-dns (previous: false). I0507 14:40:01.287023 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-vfq56 pod in namespace openshift-dns (previous: false). I0507 14:40:01.508860 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-vfq56 pod in namespace openshift-dns (previous: false). I0507 14:40:01.686629 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-vng7m pod in namespace openshift-dns (previous: false). W0507 14:40:01.865042 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 14:40:01.906502 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-vng7m pod in namespace openshift-dns (previous: false). I0507 14:40:02.088952 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-24f6n pod in namespace openshift-dns (previous: false). I0507 14:40:02.289508 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-fbqbg pod in namespace openshift-dns (previous: false). I0507 14:40:02.486986 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-htbg8 pod in namespace openshift-dns (previous: false). I0507 14:40:02.688806 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-57f57cbbf5-2s5dj pod in namespace openshift-ingress (previous: false). W0507 14:40:02.864855 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 14:40:02.887819 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-844d74d666-cjxgz pod in namespace openshift-ingress (previous: false). I0507 14:40:03.087169 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-844d74d666-gq5tz pod in namespace openshift-ingress (previous: false). I0507 14:40:03.287284 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-l2dwm pod in namespace openshift-ingress-canary (previous: false). I0507 14:40:03.298510 1 tasks_processing.go:74] worker 33 stopped. I0507 14:40:03.298618 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=181983db24e84121f1c10ca9885055cc4bc4e692bf3d868a0926cef4c8ad9a6a I0507 14:40:03.298664 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I0507 14:40:03.298716 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=48a559274e09f28bd65df0aa18b197257882db83fbd8fcdd6a029a03181097c7 I0507 14:40:03.298759 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0507 14:40:03.298782 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=03ec9ebce911dd428c7c741f23567778fe07757aa2635750f27ff7e8870f47c8 I0507 14:40:03.298798 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0507 14:40:03.298818 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=584f1b860786bc1c349edf850255ffa1b2cac308c11545a173e5ecf1de491305 I0507 14:40:03.298848 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=a5b3ce78bab525f337fc39bf58b49c63c54173465291edce707a4b7130367903 I0507 14:40:03.298872 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=3883a9d4bc281b36db56705f8b6d86b7c416b9b874b3381d675476c39e44e7c1 I0507 14:40:03.298901 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=b882beae2dc23ef641835236fa77ee4cefaff4eb74659589edc9e7b4f7c792d6 I0507 14:40:03.299175 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=fa77adaa01d96b357c01b0a26a8cb93376f119fa44178a0073b6d6b61f1b65a4 I0507 14:40:03.299194 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=a9575809a2e21eac9dcfe36be6cee52de711eacddef9add0f73fdaccf06e7239 I0507 14:40:03.299202 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0507 14:40:03.299218 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=78119a37f22fd676e1eede75d9afac30b1d848539b0b4862cc76b8a9c64f7144 I0507 14:40:03.299228 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0507 14:40:03.299246 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=9e4352f6968cf3e346fb93ae10ae5cdfcf580809db7b86926c8f8fe533550767 I0507 14:40:03.299254 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0507 14:40:03.299273 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=74b2787b2e044c65f7ef67299f54b65897dd2aa3b77a77a0777cca3088cf6820 I0507 14:40:03.299282 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0507 14:40:03.299303 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=066c8a32e3946d8a910e5bbffc5b593f49c3bf0d599dc7be3e38c261864d7b73 I0507 14:40:03.299427 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=7593f4d892eb6a2fc86add859cad5f76f55518a7dd57d975bea77c2e4d05b4e9 I0507 14:40:03.299437 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0507 14:40:03.299450 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0507 14:40:03.299472 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0507 14:40:03.299496 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=0d3e2be73265475a10d94201d59067ddfbed123706b2dca4ccc94aaab7482c53 I0507 14:40:03.299525 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=41c1b9ab4e8f4422be4796e3e3fcefbbfcb7b260f7d770e87ab0974e227c8107 I0507 14:40:03.299535 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0507 14:40:03.299551 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=4494683ab2ba3e55277c85dd89b32e890ed6830056e86726181115d2a439abfa I0507 14:40:03.299558 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0507 14:40:03.299575 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=b8b535badde22590ce55e390423b05fcce1966deadc708fc560691891de967f4 I0507 14:40:03.299585 1 recorder.go:75] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0507 14:40:03.299597 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=d48e0abea04e7ade99ceeb51703abc6013deb7c09b89ebf13ec0bff84bff9eba I0507 14:40:03.299612 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=422b9d5a208a2ee18653590329844f08fef17379d9ede54ef8391dfcf8e510cd I0507 14:40:03.299625 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=76c428d2e133d677d778accb318b5f8e108d73bf37ab1d6c765a8700f2b52df4 I0507 14:40:03.299646 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=219f470afd44b77ee75a0149e059efba03f1647f6e5ad6c8ba5f2279641faaca I0507 14:40:03.299656 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0507 14:40:03.299684 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=77c44b72082e49137eba67b103051a1fdb37ccbd5de89e42738dbca76e505b93 I0507 14:40:03.299701 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0507 14:40:03.299711 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0507 14:40:03.299718 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.480029188s to process 39 records I0507 14:40:03.487784 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-mwscd pod in namespace openshift-ingress-canary (previous: false). I0507 14:40:03.688544 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-mz65w pod in namespace openshift-ingress-canary (previous: false). W0507 14:40:03.864642 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0507 14:40:03.886652 1 tasks_processing.go:74] worker 0 stopped. I0507 14:40:03.886759 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=584ec2df3485109596590b7ca98c2b8460c1d7186e878936e908ac15648f0e39 I0507 14:40:03.886853 1 recorder.go:75] Recording events/openshift-dns with fingerprint=e2a29471786a727ad28f0667de5bcfa15545550edd329927783c2badb9f1b726 I0507 14:40:03.886883 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=677610c37707c9471fa19e56ad50ca33aeede5672fc543fb728a83cfa4b06b76 I0507 14:40:03.886953 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=836f311a591bf42e84f491379af5c16a2acfda910cfde7bcc40520691e302436 I0507 14:40:03.886991 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=ebc61d1b93cad37e67009bf309e77157c3567d4396ec2c0dcc4617ec50f0b158 I0507 14:40:03.887000 1 recorder.go:75] Recording config/pod/openshift-dns/logs/dns-default-dgj97/dns_current.log with fingerprint=5366c32600fc238e6dda13f2097dc9fc38a5c46c42e680cda38e4bea3bdf8e7a I0507 14:40:03.887006 1 recorder.go:75] Recording config/pod/openshift-dns/logs/dns-default-dgj97/kube-rbac-proxy_current.log with fingerprint=88fdf64c6f0d5aa4612cb9e0d250d88ae281c01575d843b8bb5c4001be31e379 I0507 14:40:03.887012 1 recorder.go:75] Recording config/pod/openshift-dns/logs/dns-default-vfq56/dns_current.log with fingerprint=507838cf2e6176dc6f41acad5f3db2b6d46ea840c063de2b3cd505a5427ca024 I0507 14:40:03.887018 1 recorder.go:75] Recording config/pod/openshift-dns/logs/dns-default-vfq56/kube-rbac-proxy_current.log with fingerprint=6c411b957ef487b7b31e1e8c175c3c3088592a7c2a1f8ae4ba5310e85033beb7 I0507 14:40:03.887024 1 recorder.go:75] Recording config/pod/openshift-dns/logs/dns-default-vng7m/dns_current.log with fingerprint=0d2504e66136f531c70d90f57ecee6fcc2735c8d34519a2e171a54eda94626e2 I0507 14:40:03.887031 1 recorder.go:75] Recording config/pod/openshift-dns/logs/dns-default-vng7m/kube-rbac-proxy_current.log with fingerprint=f632c65b0253f06198af6c205a468fa32e3137744f4d95ab2cfba5815679d4a8 I0507 14:40:03.887063 1 recorder.go:75] Recording config/pod/openshift-dns/logs/node-resolver-24f6n/dns-node-resolver_current.log with fingerprint=30c176d9f6b0d8908711efe008165b4b14757492aaa14a3fe68f56fbefd8fa9f I0507 14:40:03.887070 1 recorder.go:75] Recording config/pod/openshift-dns/logs/node-resolver-fbqbg/dns-node-resolver_current.log with fingerprint=47ac3a93af442b518f3b669e99a9efc478ae4c7197bae6db671eb48af2f0ea80 I0507 14:40:03.887074 1 recorder.go:75] Recording config/pod/openshift-dns/logs/node-resolver-htbg8/dns-node-resolver_current.log with fingerprint=2cab44e7d4f122b117249c4f07009c6cec39caf429bcc6edbe9c6314f3e17934 I0507 14:40:03.887091 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-57f57cbbf5-2s5dj/router_current.log with fingerprint=f1bea809d5b717f291d4f42bb21eba0d8d73a0758bd4945b81db8b8ceb43c8a9 I0507 14:40:03.887109 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-844d74d666-cjxgz/router_current.log with fingerprint=4aab3fa9011d4ee2ec83705e0a27e85c8398f136d38733bca1fa832c04bf5392 I0507 14:40:03.887126 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-844d74d666-gq5tz/router_current.log with fingerprint=b08264da8618fd4bfd31af8768750a12b4e5ef28c1bf2dabe6740a97acbf8bc8 I0507 14:40:03.887130 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-l2dwm/serve-healthcheck-canary_current.log with fingerprint=bbeb0b42c336a41bb41e4b8f66c4115622423d19cd1d846aae4a29456c0a640b I0507 14:40:03.887133 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-mwscd/serve-healthcheck-canary_current.log with fingerprint=0aa5a9b1c58bcd9599887d23ef8c2d933a6331b709083699ef3b44ee3e82a549 I0507 14:40:03.887137 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-mz65w/serve-healthcheck-canary_current.log with fingerprint=b06417e3b3986857968c2b5517ef2d635cf50fa54803f849b4b3e9ddc8dfc1ad I0507 14:40:03.887143 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 3.068561311s to process 20 records W0507 14:40:04.864821 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0507 14:40:05.863190 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0507 14:40:05.863215 1 tasks_processing.go:74] worker 59 stopped. E0507 14:40:05.863227 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0507 14:40:05.863238 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0507 14:40:05.863256 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.044389288s to process 1 records I0507 14:40:13.656177 1 tasks_processing.go:74] worker 23 stopped. I0507 14:40:13.656217 1 recorder.go:75] Recording config/installplans with fingerprint=95dfd5f33a9a46199239158a0ec0183b629818eca24ae41f4d706d7a3d604aec I0507 14:40:13.656230 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.838569314s to process 1 records I0507 14:40:14.424687 1 tasks_processing.go:74] worker 51 stopped. I0507 14:40:14.424988 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=60cf7c92813366cf47e5b7fc386c82c00b6c4f395901a511340826e94e3650c4 I0507 14:40:14.425008 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.605444618s to process 1 records E0507 14:40:14.425083 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.607s with: function \"machine_healthchecks\" failed with an error, function \"tsdb_status\" failed with an error, function \"active_alerts\" failed with an error, function \"metrics\" failed with an error, function \"silenced_alerts\" failed with an error, function \"support_secret\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0507 14:40:14.426180 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "tsdb_status" failed with an error, function "active_alerts" failed with an error, function "metrics" failed with an error, function "silenced_alerts" failed with an error, function "support_secret" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0507 14:40:14.426195 1 periodic.go:216] Running workloads gatherer I0507 14:40:14.426211 1 tasks_processing.go:45] number of workers: 2 I0507 14:40:14.426217 1 tasks_processing.go:69] worker 1 listening for tasks. I0507 14:40:14.426221 1 tasks_processing.go:71] worker 1 working on workload_info task. I0507 14:40:14.426228 1 tasks_processing.go:69] worker 0 listening for tasks. I0507 14:40:14.426240 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0507 14:40:14.432235 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-137.ec2.internal... I0507 14:40:14.432251 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-231.ec2.internal... I0507 14:40:14.432239 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-60.ec2.internal... I0507 14:40:14.450444 1 tasks_processing.go:74] worker 0 stopped. I0507 14:40:14.450462 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 24.19219ms to process 0 records I0507 14:40:18.634150 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 4s I0507 14:40:18.658824 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 25s for image data I0507 14:40:18.667033 1 gather_workloads_info.go:387] No image sha256:3a1c7ec9bb0db343348170a70697ea3209ed81e22f1259ff694190e5d04ef250 (9ms) I0507 14:40:18.675453 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (8ms) I0507 14:40:18.684540 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (9ms) I0507 14:40:18.693516 1 gather_workloads_info.go:387] No image sha256:5940cc34b322325618929b1e0eb3864dae73d54c8f5b474e218dfb28123a61c7 (9ms) I0507 14:40:18.702712 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (9ms) I0507 14:40:18.711800 1 gather_workloads_info.go:387] No image sha256:0acfe677ed58031f8381cb8a4f2d8917ec4cfa95485e2a46529dffae54c75ace (9ms) I0507 14:40:18.721248 1 gather_workloads_info.go:387] No image sha256:48f5559439bea030a6423652da448c25fff0c62ba293eb521843c1a8eb89ddb0 (9ms) I0507 14:40:18.730623 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (9ms) I0507 14:40:18.739328 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (9ms) I0507 14:40:18.747994 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (9ms) I0507 14:40:18.767286 1 gather_workloads_info.go:398] Found image sha256:23204877f166455ce8f9de9b91a467eeda576f172d5f96124a68aa986c4775d6 (19ms) I0507 14:40:18.867413 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (100ms) I0507 14:40:18.968318 1 gather_workloads_info.go:387] No image sha256:17aefdc2f4752c23dc8f0947bb01fc34635822eeb18f2d8a5eddf8211b84d450 (101ms) I0507 14:40:19.067914 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (100ms) I0507 14:40:19.168847 1 gather_workloads_info.go:398] Found image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (101ms) I0507 14:40:19.266585 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (98ms) I0507 14:40:19.367441 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (101ms) I0507 14:40:19.467651 1 gather_workloads_info.go:387] No image sha256:15e1b5f763553e86d0230a751b0783e3b990438fd07cf96eed164bccb72ed564 (100ms) I0507 14:40:19.568252 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (101ms) I0507 14:40:19.667981 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (100ms) I0507 14:40:19.767790 1 gather_workloads_info.go:387] No image sha256:9ef6dc311b880a6442b7a3a19006ddd955c7da36850bf000f5c9b68fd0862dd4 (100ms) I0507 14:40:19.870078 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (102ms) I0507 14:40:19.971524 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (101ms) I0507 14:40:20.066883 1 gather_workloads_info.go:387] No image sha256:53ff8efdd8f563421ebc1859ab021a3bbc1306f82d4ff5d9c21bc60ec5f57898 (95ms) I0507 14:40:20.167406 1 gather_workloads_info.go:387] No image sha256:5d6a2b8d2508c7da71192661e7c0dcf1335f48b6336a20189abffbe79eeff962 (101ms) I0507 14:40:20.269625 1 gather_workloads_info.go:387] No image sha256:52db05084f2a2e7d7bf4040e4865df88ec4074efbbe59a78d861be2c5ab2aa40 (102ms) I0507 14:40:20.367619 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (98ms) I0507 14:40:20.467763 1 gather_workloads_info.go:387] No image sha256:1eb6a6ee3c66ac15be6bc21bb6015c595c11c15b9dfd21bd9f5ce7f7b990ebaa (100ms) I0507 14:40:20.567610 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (100ms) I0507 14:40:20.668430 1 gather_workloads_info.go:387] No image sha256:d6fbe0075cbb12bfd287c973704fadf97154c7f73e370733d976a40835e9155a (101ms) I0507 14:40:20.767200 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (99ms) I0507 14:40:20.867246 1 gather_workloads_info.go:387] No image sha256:9d6d63dce784df5863e6a0ba4c11317a26c9d756d4e62d47759c97190a71cce5 (100ms) I0507 14:40:20.968130 1 gather_workloads_info.go:387] No image sha256:3380fecebaeee139c1607fbcd9346cebc92806679568e2244a8905ef0f52aad2 (101ms) I0507 14:40:21.067939 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (100ms) I0507 14:40:21.167098 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (99ms) I0507 14:40:21.267817 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (101ms) I0507 14:40:21.367516 1 gather_workloads_info.go:387] No image sha256:572ebf7c7fab1a518582f3ca46c866730423cce6e8a19f614dc15fd61bf0c65a (100ms) I0507 14:40:21.467448 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (100ms) I0507 14:40:21.566456 1 gather_workloads_info.go:387] No image sha256:5ff204630794311b0b37fa7b197b933ad85d76a481bf7cdb3bcbada08f0cdcbf (99ms) I0507 14:40:21.667136 1 gather_workloads_info.go:387] No image sha256:e1ba458cf6f0b3606c90880da72db8ab99cd11040bae84baebe3ff2e0d1ea075 (101ms) I0507 14:40:21.767905 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (101ms) I0507 14:40:21.867939 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (100ms) I0507 14:40:21.967947 1 gather_workloads_info.go:387] No image sha256:0b2e6536a0ca3afc5e64a218087a6287c74b77a359075a385f1949ca5bd51b22 (100ms) I0507 14:40:22.067780 1 gather_workloads_info.go:387] No image sha256:8f881f6f0498eaba860d711dc8e9dc066db8728f22abedb82e1dc9a8e1c30046 (100ms) I0507 14:40:22.167704 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (100ms) I0507 14:40:22.267864 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (100ms) I0507 14:40:22.369208 1 gather_workloads_info.go:387] No image sha256:15928a5b803fa00781b408dbc4c3bfa7c5287b18584ba31f817def8a4430c725 (101ms) I0507 14:40:22.467676 1 gather_workloads_info.go:387] No image sha256:bdeb1c455cffccdb6c90db238e9d371de06340b1d6105d47f66d87293f878ac1 (98ms) I0507 14:40:22.566935 1 gather_workloads_info.go:387] No image sha256:6c6d412ccf0c3d6a14645a79df6c4658c0f8725d7954cb83c3d2f0116499345a (99ms) I0507 14:40:22.566966 1 tasks_processing.go:74] worker 1 stopped. I0507 14:40:22.567314 1 recorder.go:75] Recording config/workload_info with fingerprint=e8f485e964f78b405fce1bb187f31cd4a8a3cf331821a0b944f168d4a7b7d3be I0507 14:40:22.567330 1 gather.go:177] gatherer "workloads" function "workload_info" took 8.140738256s to process 1 records I0507 14:40:22.567343 1 periodic.go:263] Periodic gather workloads completed in 8.141s I0507 14:40:22.567352 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0507 14:40:22.567357 1 periodic.go:216] Running conditional gatherer I0507 14:40:22.572412 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0507 14:40:22.751284 1 conditional_gatherer.go:338] updating alerts cache for conditional gatherer E0507 14:40:22.753901 1 conditional_gatherer.go:324] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp 172.30.75.141:9091: connect: connection refused I0507 14:40:22.753971 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0507 14:40:22.760600 1 conditional_gatherer.go:392] cluster version is '4.21.9' E0507 14:40:22.760614 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 14:40:22.760620 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 14:40:22.760623 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 14:40:22.760626 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 14:40:22.760629 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 14:40:22.760632 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 14:40:22.760635 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 14:40:22.760638 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 14:40:22.760642 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0507 14:40:22.760645 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0507 14:40:22.760660 1 tasks_processing.go:45] number of workers: 3 I0507 14:40:22.760668 1 tasks_processing.go:69] worker 2 listening for tasks. I0507 14:40:22.760672 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0507 14:40:22.760681 1 tasks_processing.go:69] worker 0 listening for tasks. I0507 14:40:22.760691 1 tasks_processing.go:69] worker 1 listening for tasks. I0507 14:40:22.760697 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0507 14:40:22.760702 1 tasks_processing.go:74] worker 1 stopped. I0507 14:40:22.760706 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0507 14:40:22.760776 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=9fafdcbf373f1f367f1d69551ea59114592cce1681189be0f3dde774e0530661 I0507 14:40:22.760790 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 993ns to process 1 records I0507 14:40:22.760822 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0507 14:40:22.760830 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.811µs to process 1 records I0507 14:40:22.760836 1 tasks_processing.go:74] worker 0 stopped. I0507 14:40:22.760989 1 tasks_processing.go:74] worker 2 stopped. I0507 14:40:22.761004 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 272.419µs to process 0 records I0507 14:40:22.761019 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=Succeeded message= I0507 14:40:22.761038 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I0507 14:40:22.788867 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=a27f7f2ee6fcc2740cfd983942c7774c264fa43b2047b6aa038c05f7335e5a1c I0507 14:40:22.789005 1 diskrecorder.go:70] Writing 129 records to /var/lib/insights-operator/insights-2026-05-07-144022.tar.gz I0507 14:40:22.796872 1 diskrecorder.go:51] Wrote 129 records to disk in 7ms I0507 14:40:22.796906 1 periodic.go:285] Gathering cluster info every 2h0m0s I0507 14:40:22.796928 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0507 14:41:30.818463 1 diskrecorder.go:223] Found files to send: insights-2026-05-07-144022.tar.gz I0507 14:41:30.818492 1 insightsuploader.go:150] Checking archives to upload periodically every 15m16.448207899s I0507 14:41:30.818501 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0507 14:41:30.832206 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0507 14:41:31.013559 1 requests.go:87] Successfully reported id=2026-05-07T14:41:30Z x-rh-insights-request-id=8fe06c21e1ca4f7990bdc0bd5fb7d644, wrote=58420 I0507 14:41:31.013681 1 insightsuploader.go:187] Uploaded report successfully in 195.172698ms I0507 14:41:31.013704 1 controller.go:129] Initializing last reported time to 2026-05-07T14:41:30Z I0507 14:41:31.013778 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0507 14:41:31.013790 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0507 14:41:31.013798 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0507 14:41:31.019224 1 controller.go:554] The operator is healthy I0507 14:42:00.836868 1 controller.go:554] The operator is healthy I0507 14:42:36.766569 1 insightsreport.go:137] Pulling report from smart-proxy I0507 14:42:36.766601 1 insightsreport.go:149] Retrieving report I0507 14:42:36.774173 1 requests.go:110] Retrieving report for cluster: c2120eb4-c5a9-42fa-b5b5-7b1facb44b28 I0507 14:42:36.774184 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/c2120eb4-c5a9-42fa-b5b5-7b1facb44b28/reports I0507 14:42:36.777242 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/c2120eb4-c5a9-42fa-b5b5-7b1facb44b28/reports I0507 14:42:36.995068 1 insightsreport.go:184] Report retrieved I0507 14:42:37.024820 1 insightsreport.go:239] Report retrieved correctly I0507 14:44:00.831796 1 controller.go:554] The operator is healthy I0507 14:45:00.810953 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0507 14:45:00.816155 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 14:45:00.816173 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0507 14:45:00.819822 1 secretconfigobserver.go:119] support secret does not exist I0507 14:46:00.833202 1 controller.go:554] The operator is healthy I0507 14:48:00.834569 1 controller.go:554] The operator is healthy I0507 14:50:00.812886 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 14:50:00.816933 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 14:50:00.820038 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0507 14:50:00.824225 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 14:50:00.824242 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0507 14:50:00.827978 1 secretconfigobserver.go:119] support secret does not exist I0507 14:50:00.830575 1 controller.go:554] The operator is healthy I0507 14:52:00.833466 1 controller.go:554] The operator is healthy I0507 14:54:00.835186 1 controller.go:554] The operator is healthy I0507 14:55:00.828377 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0507 14:55:00.836257 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 14:55:00.836275 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0507 14:55:00.839810 1 secretconfigobserver.go:119] support secret does not exist I0507 14:56:00.834664 1 controller.go:554] The operator is healthy I0507 14:56:52.463556 1 insightsuploader.go:146] Nothing to report since 2026-05-07T14:41:30Z I0507 14:58:00.834937 1 controller.go:554] The operator is healthy I0507 15:00:00.812629 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 15:00:00.816559 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 15:00:00.830994 1 controller.go:554] The operator is healthy I0507 15:00:00.840822 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0507 15:00:00.845001 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 15:00:00.845016 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0507 15:00:00.848309 1 secretconfigobserver.go:119] support secret does not exist I0507 15:02:00.835091 1 controller.go:554] The operator is healthy I0507 15:04:00.835422 1 controller.go:554] The operator is healthy I0507 15:05:00.849271 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0507 15:05:00.854092 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 15:05:00.854113 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0507 15:05:00.858065 1 secretconfigobserver.go:119] support secret does not exist I0507 15:06:00.834386 1 controller.go:554] The operator is healthy I0507 15:08:00.831462 1 controller.go:554] The operator is healthy I0507 15:10:00.809594 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 15:10:00.813359 1 configmapobserver.go:84] configmaps "insights-config" not found I0507 15:10:00.831023 1 controller.go:554] The operator is healthy I0507 15:10:00.858838 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0507 15:10:00.863139 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0507 15:10:00.863157 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0507 15:10:00.866771 1 secretconfigobserver.go:119] support secret does not exist I0507 15:12:00.831109 1 controller.go:554] The operator is healthy I0507 15:12:30.189504 1 insightsuploader.go:146] Nothing to report since 2026-05-07T14:41:30Z