I0506 03:05:17.314082 1 cmd.go:253] Using service-serving-cert provided certificates I0506 03:05:17.314682 1 observer_polling.go:159] Starting file observer I0506 03:05:18.134148 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0506 03:05:18.134455 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0506 03:05:18.135367 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0506 03:05:18.135378 1 secure_serving.go:57] Forcing use of http/1.1 only W0506 03:05:18.135415 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0506 03:05:18.135423 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0506 03:05:18.135429 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0506 03:05:18.135433 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0506 03:05:18.135437 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0506 03:05:18.135441 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0506 03:05:18.139063 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0506 03:05:18.139146 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"036a5d91-afd7-46b1-a315-004535d274e4", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0506 03:05:18.139698 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0506 03:05:18.139710 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0506 03:05:18.139722 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0506 03:05:18.139730 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0506 03:05:18.139741 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0506 03:05:18.139722 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0506 03:05:18.140036 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0506 03:05:18.140366 1 secure_serving.go:213] Serving securely on [::]:8443 I0506 03:05:18.140393 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0506 03:05:18.148501 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0506 03:05:18.148524 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0506 03:05:18.148638 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0506 03:05:18.152778 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0506 03:05:18.152806 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0506 03:05:18.156928 1 secretconfigobserver.go:119] support secret does not exist I0506 03:05:18.161021 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0506 03:05:18.164807 1 secretconfigobserver.go:119] support secret does not exist I0506 03:05:18.168812 1 recorder.go:161] Pruning old reports every 8h6m45s, max age is 288h0m0s I0506 03:05:18.173423 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0506 03:05:18.173435 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0506 03:05:18.173445 1 insightsreport.go:296] Starting report retriever I0506 03:05:18.173445 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0506 03:05:18.173453 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0506 03:05:18.173464 1 periodic.go:209] Running clusterconfig gatherer I0506 03:05:18.173511 1 tasks_processing.go:45] number of workers: 64 I0506 03:05:18.173551 1 tasks_processing.go:69] worker 12 listening for tasks. I0506 03:05:18.173564 1 tasks_processing.go:69] worker 4 listening for tasks. I0506 03:05:18.173552 1 tasks_processing.go:69] worker 3 listening for tasks. I0506 03:05:18.173571 1 tasks_processing.go:71] worker 4 working on metrics task. I0506 03:05:18.173575 1 tasks_processing.go:69] worker 28 listening for tasks. I0506 03:05:18.173589 1 tasks_processing.go:69] worker 30 listening for tasks. I0506 03:05:18.173579 1 tasks_processing.go:69] worker 0 listening for tasks. I0506 03:05:18.173597 1 tasks_processing.go:69] worker 21 listening for tasks. I0506 03:05:18.173598 1 tasks_processing.go:69] worker 2 listening for tasks. I0506 03:05:18.173596 1 tasks_processing.go:69] worker 20 listening for tasks. I0506 03:05:18.173580 1 tasks_processing.go:69] worker 29 listening for tasks. I0506 03:05:18.173611 1 tasks_processing.go:69] worker 23 listening for tasks. I0506 03:05:18.173611 1 tasks_processing.go:69] worker 57 listening for tasks. I0506 03:05:18.173604 1 tasks_processing.go:69] worker 22 listening for tasks. I0506 03:05:18.173604 1 tasks_processing.go:69] worker 48 listening for tasks. I0506 03:05:18.173611 1 tasks_processing.go:69] worker 56 listening for tasks. I0506 03:05:18.173625 1 tasks_processing.go:69] worker 50 listening for tasks. I0506 03:05:18.173589 1 tasks_processing.go:69] worker 1 listening for tasks. I0506 03:05:18.173609 1 tasks_processing.go:69] worker 47 listening for tasks. I0506 03:05:18.173618 1 tasks_processing.go:69] worker 49 listening for tasks. I0506 03:05:18.173620 1 tasks_processing.go:69] worker 58 listening for tasks. I0506 03:05:18.173638 1 tasks_processing.go:69] worker 25 listening for tasks. I0506 03:05:18.173641 1 tasks_processing.go:69] worker 41 listening for tasks. I0506 03:05:18.173641 1 tasks_processing.go:69] worker 39 listening for tasks. I0506 03:05:18.173639 1 tasks_processing.go:69] worker 15 listening for tasks. I0506 03:05:18.173625 1 tasks_processing.go:69] worker 31 listening for tasks. I0506 03:05:18.173657 1 tasks_processing.go:69] worker 53 listening for tasks. I0506 03:05:18.173656 1 tasks_processing.go:69] worker 27 listening for tasks. I0506 03:05:18.173626 1 tasks_processing.go:69] worker 59 listening for tasks. I0506 03:05:18.173665 1 tasks_processing.go:69] worker 36 listening for tasks. I0506 03:05:18.173630 1 tasks_processing.go:69] worker 14 listening for tasks. I0506 03:05:18.173668 1 tasks_processing.go:69] worker 55 listening for tasks. I0506 03:05:18.173672 1 tasks_processing.go:69] worker 19 listening for tasks. I0506 03:05:18.173670 1 tasks_processing.go:69] worker 63 listening for tasks. I0506 03:05:18.173677 1 tasks_processing.go:69] worker 6 listening for tasks. I0506 03:05:18.173677 1 tasks_processing.go:69] worker 45 listening for tasks. I0506 03:05:18.173681 1 tasks_processing.go:69] worker 38 listening for tasks. I0506 03:05:18.173683 1 tasks_processing.go:69] worker 5 listening for tasks. I0506 03:05:18.173685 1 tasks_processing.go:69] worker 46 listening for tasks. I0506 03:05:18.173686 1 tasks_processing.go:69] worker 11 listening for tasks. I0506 03:05:18.173633 1 tasks_processing.go:69] worker 40 listening for tasks. I0506 03:05:18.173695 1 tasks_processing.go:71] worker 2 working on ingress task. I0506 03:05:18.173694 1 tasks_processing.go:69] worker 7 listening for tasks. I0506 03:05:18.173633 1 tasks_processing.go:69] worker 60 listening for tasks. I0506 03:05:18.173704 1 tasks_processing.go:69] worker 9 listening for tasks. I0506 03:05:18.173704 1 tasks_processing.go:71] worker 20 working on mutating_webhook_configurations task. I0506 03:05:18.173706 1 tasks_processing.go:71] worker 29 working on authentication task. I0506 03:05:18.173715 1 tasks_processing.go:71] worker 3 working on pdbs task. I0506 03:05:18.173718 1 tasks_processing.go:71] worker 0 working on operators_pods_and_events task. I0506 03:05:18.173721 1 tasks_processing.go:71] worker 21 working on sap_config task. I0506 03:05:18.173720 1 tasks_processing.go:71] worker 28 working on machines task. I0506 03:05:18.173726 1 tasks_processing.go:71] worker 48 working on clusterroles task. I0506 03:05:18.173724 1 tasks_processing.go:71] worker 9 working on proxies task. I0506 03:05:18.173571 1 tasks_processing.go:71] worker 12 working on infrastructures task. I0506 03:05:18.173911 1 tasks_processing.go:71] worker 45 working on lokistack task. I0506 03:05:18.173925 1 tasks_processing.go:71] worker 1 working on schedulers task. I0506 03:05:18.173930 1 tasks_processing.go:71] worker 31 working on openshift_machine_api_events task. I0506 03:05:18.173932 1 tasks_processing.go:71] worker 59 working on operators task. I0506 03:05:18.173935 1 tasks_processing.go:71] worker 36 working on dvo_metrics task. I0506 03:05:18.173978 1 tasks_processing.go:71] worker 14 working on sap_pods task. I0506 03:05:18.173991 1 tasks_processing.go:71] worker 47 working on support_secret task. I0506 03:05:18.174098 1 tasks_processing.go:71] worker 53 working on storage_classes task. I0506 03:05:18.173718 1 tasks_processing.go:71] worker 57 working on openstack_dataplanenodesets task. I0506 03:05:18.173641 1 tasks_processing.go:69] worker 61 listening for tasks. I0506 03:05:18.174403 1 tasks_processing.go:71] worker 61 working on cluster_apiserver task. I0506 03:05:18.173647 1 tasks_processing.go:69] worker 51 listening for tasks. I0506 03:05:18.173648 1 tasks_processing.go:69] worker 26 listening for tasks. I0506 03:05:18.173650 1 tasks_processing.go:69] worker 16 listening for tasks. I0506 03:05:18.173651 1 tasks_processing.go:69] worker 52 listening for tasks. I0506 03:05:18.173655 1 tasks_processing.go:69] worker 42 listening for tasks. I0506 03:05:18.173657 1 tasks_processing.go:69] worker 17 listening for tasks. I0506 03:05:18.173663 1 tasks_processing.go:69] worker 54 listening for tasks. I0506 03:05:18.173662 1 tasks_processing.go:69] worker 62 listening for tasks. I0506 03:05:18.173662 1 tasks_processing.go:69] worker 43 listening for tasks. I0506 03:05:18.173664 1 tasks_processing.go:69] worker 18 listening for tasks. I0506 03:05:18.173663 1 tasks_processing.go:69] worker 35 listening for tasks. I0506 03:05:18.173670 1 tasks_processing.go:69] worker 44 listening for tasks. I0506 03:05:18.173674 1 tasks_processing.go:69] worker 37 listening for tasks. I0506 03:05:18.173632 1 tasks_processing.go:69] worker 24 listening for tasks. I0506 03:05:18.173679 1 tasks_processing.go:69] worker 8 listening for tasks. I0506 03:05:18.173689 1 tasks_processing.go:69] worker 10 listening for tasks. I0506 03:05:18.173700 1 tasks_processing.go:71] worker 23 working on feature_gates task. I0506 03:05:18.173694 1 tasks_processing.go:69] worker 33 listening for tasks. I0506 03:05:18.173678 1 tasks_processing.go:69] worker 32 listening for tasks. I0506 03:05:18.173714 1 tasks_processing.go:71] worker 7 working on version task. I0506 03:05:18.174530 1 tasks_processing.go:71] worker 49 working on qemu_kubevirt_launcher_logs task. I0506 03:05:18.174579 1 tasks_processing.go:71] worker 44 working on openstack_version task. I0506 03:05:18.174587 1 tasks_processing.go:71] worker 52 working on silenced_alerts task. I0506 03:05:18.174592 1 tasks_processing.go:71] worker 8 working on nodenetworkconfigurationpolicies task. I0506 03:05:18.174601 1 tasks_processing.go:71] worker 54 working on networks task. I0506 03:05:18.174739 1 tasks_processing.go:71] worker 10 working on install_plans task. I0506 03:05:18.174774 1 tasks_processing.go:71] worker 33 working on nodenetworkstates task. I0506 03:05:18.174582 1 tasks_processing.go:71] worker 16 working on tsdb_status task. I0506 03:05:18.174882 1 tasks_processing.go:71] worker 40 working on machine_sets task. I0506 03:05:18.174964 1 tasks_processing.go:71] worker 37 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0506 03:05:18.175380 1 tasks_processing.go:71] worker 42 working on active_alerts task. I0506 03:05:18.175406 1 tasks_processing.go:71] worker 24 working on crds task. I0506 03:05:18.175447 1 tasks_processing.go:71] worker 17 working on openstack_dataplanedeployments task. I0506 03:05:18.175556 1 tasks_processing.go:71] worker 62 working on jaegers task. I0506 03:05:18.174562 1 tasks_processing.go:71] worker 32 working on cost_management_metrics_configs task. I0506 03:05:18.175566 1 tasks_processing.go:71] worker 43 working on pod_network_connectivity_checks task. I0506 03:05:18.173709 1 tasks_processing.go:69] worker 34 listening for tasks. I0506 03:05:18.173720 1 tasks_processing.go:71] worker 46 working on service_accounts task. I0506 03:05:18.176668 1 tasks_processing.go:71] worker 34 working on container_runtime_configs task. I0506 03:05:18.173722 1 tasks_processing.go:71] worker 22 working on machine_autoscalers task. I0506 03:05:18.173622 1 tasks_processing.go:69] worker 13 listening for tasks. I0506 03:05:18.173898 1 tasks_processing.go:71] worker 63 working on nodes task. I0506 03:05:18.177459 1 tasks_processing.go:71] worker 13 working on sap_datahubs task. I0506 03:05:18.173901 1 tasks_processing.go:71] worker 38 working on config_maps task. I0506 03:05:18.173902 1 tasks_processing.go:71] worker 55 working on machine_config_pools task. I0506 03:05:18.173906 1 tasks_processing.go:71] worker 6 working on validating_webhook_configurations task. I0506 03:05:18.173903 1 tasks_processing.go:71] worker 27 working on machine_configs task. I0506 03:05:18.173911 1 tasks_processing.go:71] worker 58 working on storage_cluster task. I0506 03:05:18.173907 1 tasks_processing.go:71] worker 19 working on image_registries task. I0506 03:05:18.173915 1 tasks_processing.go:71] worker 25 working on aggregated_monitoring_cr_names task. I0506 03:05:18.173917 1 tasks_processing.go:71] worker 56 working on image task. I0506 03:05:18.173918 1 tasks_processing.go:71] worker 11 working on ingress_certificates task. I0506 03:05:18.173919 1 tasks_processing.go:71] worker 41 working on ceph_cluster task. I0506 03:05:18.173921 1 tasks_processing.go:71] worker 50 working on oauths task. I0506 03:05:18.173922 1 tasks_processing.go:71] worker 39 working on certificate_signing_requests task. I0506 03:05:18.173926 1 tasks_processing.go:71] worker 15 working on image_pruners task. I0506 03:05:18.173922 1 tasks_processing.go:71] worker 5 working on openstack_controlplanes task. I0506 03:05:18.174568 1 tasks_processing.go:71] worker 51 working on machine_healthchecks task. I0506 03:05:18.174572 1 tasks_processing.go:71] worker 26 working on overlapping_namespace_uids task. I0506 03:05:18.174575 1 tasks_processing.go:71] worker 35 working on monitoring_persistent_volumes task. I0506 03:05:18.174577 1 tasks_processing.go:71] worker 18 working on olm_operators task. I0506 03:05:18.173714 1 tasks_processing.go:71] worker 30 working on node_logs task. I0506 03:05:18.173714 1 tasks_processing.go:71] worker 60 working on openshift_logging task. I0506 03:05:18.178820 1 tasks_processing.go:71] worker 21 working on container_images task. I0506 03:05:18.178828 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 5.088959ms to process 0 records I0506 03:05:18.179084 1 tasks_processing.go:74] worker 28 stopped. E0506 03:05:18.179106 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0506 03:05:18.179117 1 gather.go:177] gatherer "clusterconfig" function "machines" took 5.350939ms to process 0 records I0506 03:05:18.179714 1 tasks_processing.go:74] worker 57 stopped. I0506 03:05:18.179735 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 5.416655ms to process 0 records I0506 03:05:18.180045 1 tasks_processing.go:74] worker 44 stopped. I0506 03:05:18.180101 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 5.453141ms to process 0 records I0506 03:05:18.180450 1 tasks_processing.go:74] worker 14 stopped. I0506 03:05:18.180505 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 6.445553ms to process 0 records E0506 03:05:18.184385 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: no such host I0506 03:05:18.184401 1 tasks_processing.go:74] worker 16 stopped. E0506 03:05:18.184407 1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: no such host I0506 03:05:18.184416 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 9.554726ms to process 0 records E0506 03:05:18.184424 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: no such host I0506 03:05:18.184440 1 tasks_processing.go:74] worker 4 stopped. E0506 03:05:18.184446 1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: no such host I0506 03:05:18.184461 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 10.862244ms to process 0 records E0506 03:05:18.184490 1 gather_silenced_alerts.go:52] Unable to retrieve silenced alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp: lookup alertmanager-main.openshift-monitoring.svc on 172.30.0.10:53: no such host I0506 03:05:18.184513 1 tasks_processing.go:74] worker 52 stopped. E0506 03:05:18.184514 1 gather_active_alerts.go:64] Unable to retrieve most recent alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp: lookup alertmanager-main.openshift-monitoring.svc on 172.30.0.10:53: no such host E0506 03:05:18.184528 1 gather.go:140] gatherer "clusterconfig" function "silenced_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp: lookup alertmanager-main.openshift-monitoring.svc on 172.30.0.10:53: no such host I0506 03:05:18.184556 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 9.913462ms to process 0 records E0506 03:05:18.184574 1 gather.go:140] gatherer "clusterconfig" function "active_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp: lookup alertmanager-main.openshift-monitoring.svc on 172.30.0.10:53: no such host I0506 03:05:18.184591 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 9.1312ms to process 0 records I0506 03:05:18.184604 1 tasks_processing.go:74] worker 42 stopped. I0506 03:05:18.186747 1 tasks_processing.go:74] worker 40 stopped. I0506 03:05:18.186764 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 11.846214ms to process 0 records I0506 03:05:18.186876 1 tasks_processing.go:74] worker 45 stopped. I0506 03:05:18.186892 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 12.943502ms to process 0 records I0506 03:05:18.187048 1 tasks_processing.go:74] worker 12 stopped. I0506 03:05:18.187196 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0506 03:05:18.187214 1 controller.go:326] The initial operator extension status is healthy I0506 03:05:18.187223 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0506 03:05:18.187227 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0506 03:05:18.187230 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0506 03:05:18.187245 1 controller.go:489] The operator is still being initialized I0506 03:05:18.187272 1 controller.go:512] The operator is healthy I0506 03:05:18.187335 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0506 03:05:18.187350 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0506 03:05:18.187509 1 operator.go:288] started I0506 03:05:18.187537 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0506 03:05:18.187826 1 recorder.go:75] Recording config/infrastructure with fingerprint=35c3d22b5fb4f0ed7aff0743ac3feddf19372773148732c818ed59c1b67226cc I0506 03:05:18.187846 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 13.11915ms to process 1 records I0506 03:05:18.190018 1 tasks_processing.go:74] worker 17 stopped. I0506 03:05:18.190033 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 14.554027ms to process 0 records I0506 03:05:18.190046 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 16.08965ms to process 0 records I0506 03:05:18.190055 1 tasks_processing.go:74] worker 31 stopped. I0506 03:05:18.190172 1 tasks_processing.go:74] worker 47 stopped. E0506 03:05:18.190189 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0506 03:05:18.190200 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 16.171092ms to process 0 records I0506 03:05:18.190244 1 tasks_processing.go:74] worker 5 stopped. I0506 03:05:18.190280 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 12.564433ms to process 0 records I0506 03:05:18.190302 1 tasks_processing.go:74] worker 43 stopped. E0506 03:05:18.190312 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0506 03:05:18.190325 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 13.762776ms to process 0 records I0506 03:05:18.190407 1 tasks_processing.go:74] worker 9 stopped. I0506 03:05:18.190420 1 recorder.go:75] Recording config/proxy with fingerprint=144735bd5274dafda659826d0ffc08fea7519d545e8e951377950f826ca9de9b I0506 03:05:18.190432 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 16.570125ms to process 1 records I0506 03:05:18.190438 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 12.675721ms to process 0 records I0506 03:05:18.190444 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 15.730941ms to process 0 records I0506 03:05:18.190446 1 tasks_processing.go:74] worker 58 stopped. I0506 03:05:18.190448 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 15.551173ms to process 0 records I0506 03:05:18.190457 1 tasks_processing.go:74] worker 8 stopped. I0506 03:05:18.190452 1 tasks_processing.go:74] worker 33 stopped. I0506 03:05:18.190465 1 tasks_processing.go:74] worker 32 stopped. I0506 03:05:18.190460 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 14.284441ms to process 0 records I0506 03:05:18.190591 1 tasks_processing.go:74] worker 23 stopped. I0506 03:05:18.190790 1 recorder.go:75] Recording config/featuregate with fingerprint=01dcd1639c54cf7bf80d9f3b1085bca942759f72b821b0d40afb4943df412089 I0506 03:05:18.190807 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 16.1268ms to process 1 records I0506 03:05:18.190895 1 tasks_processing.go:74] worker 2 stopped. I0506 03:05:18.190996 1 recorder.go:75] Recording config/ingress with fingerprint=cb1cd6a8cffaa0f490fe7a42d1c4940d8460a30a80628530f7bb07739434f03e I0506 03:05:18.191023 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 16.919206ms to process 1 records I0506 03:05:18.191106 1 tasks_processing.go:74] worker 61 stopped. I0506 03:05:18.191178 1 recorder.go:75] Recording config/apiserver with fingerprint=81da3f84671f505fbf45aec739c2ead0e56dfe4542d8150500789bb09bf0d613 I0506 03:05:18.191191 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 16.223731ms to process 1 records I0506 03:05:18.191277 1 tasks_processing.go:74] worker 29 stopped. I0506 03:05:18.191398 1 recorder.go:75] Recording config/authentication with fingerprint=1b92311e58c37932f36acdd80eb83b9946ea5c1f7ef3974247e3ea4ba08e4c30 I0506 03:05:18.191412 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 17.02935ms to process 1 records I0506 03:05:18.193435 1 tasks_processing.go:74] worker 13 stopped. I0506 03:05:18.193449 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 15.893799ms to process 0 records I0506 03:05:18.193473 1 tasks_processing.go:74] worker 51 stopped. E0506 03:05:18.193484 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0506 03:05:18.193490 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 15.794523ms to process 0 records I0506 03:05:18.193497 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 16.746047ms to process 0 records I0506 03:05:18.193502 1 tasks_processing.go:74] worker 22 stopped. I0506 03:05:18.193586 1 tasks_processing.go:74] worker 3 stopped. I0506 03:05:18.193672 1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=2938317d05b973fbf51e301a351591eadbdeb6215ff287cf66c09b1462b7f288 I0506 03:05:18.193697 1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=d095510083d9073d2829f1e5130515cea0ff25e34367837376ef6fe612ba2c34 I0506 03:05:18.193722 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=f02a79bb934e0f5903d2a012eedcaac76ddedf90be157bfd41c2fc0665d477e5 I0506 03:05:18.193748 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=87f5335ec3797fe6ee535229efbe7d9fcdcdc7d0d0e620f6cb1ce1b4e5a84f40 I0506 03:05:18.193771 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=a88f3cb46a92e2adccdf6f8448bc4a4fc3b9538a6aed2f010990f5da215a4441 I0506 03:05:18.193795 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=f2d278b15c26b99bf8777fa717303995eacfdd3976a849add0810cb8b5ca1b86 I0506 03:05:18.193806 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 19.857387ms to process 6 records I0506 03:05:18.193898 1 tasks_processing.go:74] worker 56 stopped. I0506 03:05:18.193907 1 recorder.go:75] Recording config/image with fingerprint=0cc742fb3a80ac5b43980144f2f68c06adea650b476cb81056cc4f080f108b7e I0506 03:05:18.193915 1 gather.go:177] gatherer "clusterconfig" function "image" took 16.039253ms to process 1 records I0506 03:05:18.193994 1 tasks_processing.go:74] worker 54 stopped. I0506 03:05:18.194029 1 recorder.go:75] Recording config/network with fingerprint=64f1197e0575e5f8fba115d7759d0619776703666ab9e60bf8a8405bb9c6ed72 I0506 03:05:18.194037 1 gather.go:177] gatherer "clusterconfig" function "networks" took 19.14141ms to process 1 records W0506 03:05:18.195811 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0506 03:05:18.197237 1 tasks_processing.go:74] worker 50 stopped. I0506 03:05:18.197522 1 recorder.go:75] Recording config/oauth with fingerprint=e344fea9a13472ffe890c4e86709bdd5db1fda3bc1b27df30f9c7906b166acf5 I0506 03:05:18.197547 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 19.564441ms to process 1 records I0506 03:05:18.201780 1 tasks_processing.go:74] worker 41 stopped. I0506 03:05:18.201794 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 24.115383ms to process 0 records I0506 03:05:18.202549 1 gather_logs.go:145] no pods in namespace were found I0506 03:05:18.202568 1 tasks_processing.go:74] worker 49 stopped. I0506 03:05:18.202588 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 27.982398ms to process 0 records I0506 03:05:18.202739 1 tasks_processing.go:74] worker 30 stopped. I0506 03:05:18.202755 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 25.051302ms to process 0 records I0506 03:05:18.202781 1 tasks_processing.go:74] worker 60 stopped. I0506 03:05:18.202788 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 25.09423ms to process 0 records I0506 03:05:18.202795 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 26.103065ms to process 0 records I0506 03:05:18.202801 1 tasks_processing.go:74] worker 34 stopped. I0506 03:05:18.202821 1 tasks_processing.go:74] worker 62 stopped. I0506 03:05:18.202833 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 26.979969ms to process 0 records I0506 03:05:18.203068 1 tasks_processing.go:74] worker 63 stopped. I0506 03:05:18.203679 1 recorder.go:75] Recording config/node/ip-10-0-0-139.ec2.internal with fingerprint=acae11c7cf955736d30e82809c02dfd90183b3d6e2704a8bae983c3d0d02a75b I0506 03:05:18.203807 1 recorder.go:75] Recording config/node/ip-10-0-1-59.ec2.internal with fingerprint=7aca1d28d1adb66c373087cb9bd1cae828b489e2d8ce2ac8e9592956fee2f76e I0506 03:05:18.203820 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 25.676732ms to process 2 records I0506 03:05:18.203968 1 tasks_processing.go:74] worker 15 stopped. I0506 03:05:18.204234 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=512f724d3f16d00a4b12259a8a7052d6f04a52af8d39602e1d29e1aa2cc36d66 I0506 03:05:18.204287 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 25.548321ms to process 1 records I0506 03:05:18.204500 1 tasks_processing.go:74] worker 19 stopped. I0506 03:05:18.205172 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=f9228f990e07a9c832400b11e83e8bbc4889d4e1e5faf779cbe896584b30ed39 I0506 03:05:18.206289 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 26.235ms to process 1 records I0506 03:05:18.206439 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=fb90c715b820a70e8ba3ef647a095b6797f5c3d6178306ce1bde5786e4769a1e I0506 03:05:18.206456 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 32.397894ms to process 1 records I0506 03:05:18.206458 1 tasks_processing.go:74] worker 1 stopped. I0506 03:05:18.207921 1 tasks_processing.go:74] worker 53 stopped. I0506 03:05:18.208029 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=7a970730dcf9cc2761837ee8916651795208d013893135c6e6867e3ded5a09d7 I0506 03:05:18.208048 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=43b24f0032dbed8227c33bc57f30f39ee88ea87f511a406119d8586d3f9a2a58 I0506 03:05:18.208057 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 33.805907ms to process 2 records I0506 03:05:18.208125 1 tasks_processing.go:74] worker 48 stopped. I0506 03:05:18.208307 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0506 03:05:18.208322 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0506 03:05:18.208327 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0506 03:05:18.208332 1 controller.go:212] Source scaController *sca.Controller is not ready I0506 03:05:18.208336 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0506 03:05:18.208359 1 controller.go:489] The operator is still being initialized I0506 03:05:18.208367 1 controller.go:512] The operator is healthy I0506 03:05:18.208434 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=39de4fc9faed2c940c620dc09d3521a683219bac9a6952fbd8f09ae66e75ff7f I0506 03:05:18.208632 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=7410d39521b42745d16f681e45851eca28c4a85dc0c38cef1685fad299e3070a I0506 03:05:18.208648 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 34.388372ms to process 2 records I0506 03:05:18.208662 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 30.755942ms to process 0 records I0506 03:05:18.208670 1 tasks_processing.go:74] worker 55 stopped. I0506 03:05:18.210329 1 tasks_processing.go:74] worker 39 stopped. I0506 03:05:18.210347 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 32.644144ms to process 0 records I0506 03:05:18.210368 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0506 03:05:18.210380 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 32.671725ms to process 1 records I0506 03:05:18.210391 1 tasks_processing.go:74] worker 26 stopped. I0506 03:05:18.210680 1 tasks_processing.go:74] worker 35 stopped. I0506 03:05:18.210697 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 32.996416ms to process 0 records I0506 03:05:18.212166 1 tasks_processing.go:74] worker 24 stopped. I0506 03:05:18.213316 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=3219da47dda2efc8cf40555e0cc4e076c5826baf067aa28d8ced8f693459304a I0506 03:05:18.214466 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=211750ba553f2d45eab73c30e66eb22c7f0619e1ef7e90ba5bae0f81291d274c I0506 03:05:18.214502 1 gather.go:177] gatherer "clusterconfig" function "crds" took 36.747933ms to process 2 records I0506 03:05:18.214575 1 tasks_processing.go:74] worker 6 stopped. I0506 03:05:18.215063 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=9dbcb87da52465789fc8b5c638db71589ee9756f13ca7014ece354d6e9ab1cf5 I0506 03:05:18.215998 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=f974cab1c4fa9423f7a51bb9b0cfd20e0ab24251c83eb6feca6b520fc99c1a6f I0506 03:05:18.216174 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=be21f2bafd811ba23690838bf7ab016f8283ac1ceac6d4340f09bf9bd84ea047 I0506 03:05:18.216232 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=71cd7500ed8ce764bce41c4fd252b0f1fec0ce747847b5be71911cbe1484ed17 I0506 03:05:18.216428 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=9061f2033f5093130330eca1c9b7b995725d7847c4ce9593f6e6574f93800e4d I0506 03:05:18.216680 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=ebfa95bc6ee08fa1b246c400ded6310a70020606be70d7ea0f65db868b6b04a2 I0506 03:05:18.216802 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=c42ee231782ed22eb46fe14447ee851e26ff092d9462b0a52fce1f6d3b599917 I0506 03:05:18.216950 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=f7df4b40b1ef821a84c222a460b7b1770e4dc44825638123b1e510204bfa797a I0506 03:05:18.217041 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=0ad6016c36fe342744b88baf7011dafc7eb78d1a7256f25eb571847276a74d03 I0506 03:05:18.217156 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=5d733521df0c74042835cc18c891498b80dc8fc428994d0b6b370bd1fc6b007b I0506 03:05:18.217356 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=6d3c9a57bd0b59ef5f4e35cd93877829d0a12958c7205206330ae0ccf1b5b463 I0506 03:05:18.217380 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 35.541269ms to process 11 records I0506 03:05:18.217461 1 tasks_processing.go:74] worker 7 stopped. I0506 03:05:18.218204 1 recorder.go:75] Recording config/version with fingerprint=a1046330dd99e2ed8d9579db1596a62f8812485e35b93134cd38ebfde60f71be I0506 03:05:18.218224 1 recorder.go:75] Recording config/id with fingerprint=228f4a33c6c02b267cd91111b7f20b03e21405507e6b86c41079804ebf1af732 I0506 03:05:18.218233 1 gather.go:177] gatherer "clusterconfig" function "version" took 39.169142ms to process 2 records I0506 03:05:18.223960 1 tasks_processing.go:74] worker 27 stopped. I0506 03:05:18.223997 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0506 03:05:18.224016 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 46.301125ms to process 1 records I0506 03:05:18.224178 1 tasks_processing.go:74] worker 20 stopped. I0506 03:05:18.224387 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=b0d24d3ca8bc24e45104ce3cb9f08f028685530b5edefc721d8c038584d917bd I0506 03:05:18.224479 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=5228464ff6ec45aac469a2316f3ebe8e9b248f0dbc082d76c437f30aaa0eab74 I0506 03:05:18.224528 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=bcc92121faafdd4cab1de3da46cdca3dd692b92da30acc9340bf6d8ff1bce2fc I0506 03:05:18.224539 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 50.45069ms to process 3 records I0506 03:05:18.224713 1 tasks_processing.go:74] worker 18 stopped. I0506 03:05:18.224777 1 recorder.go:75] Recording config/olm_operators with fingerprint=8d7fe922beefeacde996e3cfc687e8f51fcbb3866d4ee7406f3d1d0ec30cc613 I0506 03:05:18.224789 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 47.019156ms to process 1 records I0506 03:05:18.226396 1 tasks_processing.go:74] worker 37 stopped. I0506 03:05:18.226415 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 51.415675ms to process 0 records I0506 03:05:18.228051 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0506 03:05:18.230625 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 52.890012ms to process 0 records I0506 03:05:18.230864 1 tasks_processing.go:74] worker 25 stopped. I0506 03:05:18.235527 1 tasks_processing.go:74] worker 21 stopped. I0506 03:05:18.237186 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-575cd97545-twgts with fingerprint=191677c929a1219d9783140fc5039f94fa4d5dba379b80c301a2a1f24496faa4 I0506 03:05:18.237292 1 recorder.go:75] Recording config/running_containers with fingerprint=7e7671161eed368f14a2a8879208b45dd905e8f375f31dde8648d99cc94b96e8 I0506 03:05:18.237305 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 56.599092ms to process 2 records I0506 03:05:18.240073 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0506 03:05:18.240080 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0506 03:05:18.240093 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0506 03:05:18.249424 1 base_controller.go:82] Caches are synced for ConfigController I0506 03:05:18.249437 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0506 03:05:18.253806 1 configmapobserver.go:84] configmaps "insights-config" not found I0506 03:05:18.256270 1 tasks_processing.go:74] worker 38 stopped. E0506 03:05:18.256294 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0506 03:05:18.256303 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0506 03:05:18.256308 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0506 03:05:18.256321 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0506 03:05:18.256362 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0506 03:05:18.256373 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0506 03:05:18.256379 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0506 03:05:18.256392 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0506 03:05:18.256458 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0506 03:05:18.256469 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0506 03:05:18.256477 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 78.672782ms to process 7 records I0506 03:05:18.288027 1 base_controller.go:82] Caches are synced for LoggingSyncer I0506 03:05:18.288052 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0506 03:05:18.290359 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0506 03:05:18.294649 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0506 03:05:18.301271 1 cluster_transfer.go:102] no available accepted cluster transfer I0506 03:05:18.301286 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0506 03:05:18.330967 1 tasks_processing.go:74] worker 11 stopped. E0506 03:05:18.330991 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0506 03:05:18.331000 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2q45oqblirj1dttrkl2v26ci3lb7781m-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2q45oqblirj1dttrkl2v26ci3lb7781m-primary-cert-bundle-secret" not found I0506 03:05:18.331093 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=bc605534fb56af14ecfbf1bf0f8452c13284b31d153d44c3f264861ed4d9f92e I0506 03:05:18.331112 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 153.293463ms to process 1 records I0506 03:05:18.405385 1 sca.go:266] etc-pki-entitlement secret successfully created I0506 03:05:18.405407 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I0506 03:05:18.612884 1 gather_cluster_operator_pods_and_events.go:121] Found 12 pods with 12 containers I0506 03:05:18.612901 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 2097152 bytes I0506 03:05:18.613744 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for networking-console-plugin container networking-console-plugin-6ddbfdf749-4swc4 pod in namespace openshift-network-console (previous: false). I0506 03:05:18.819776 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for networking-console-plugin container networking-console-plugin-6ddbfdf749-7z2jn pod in namespace openshift-network-console (previous: false). I0506 03:05:19.016885 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console-operator container console-operator-575cd97545-twgts pod in namespace openshift-console-operator (previous: true). W0506 03:05:19.195703 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0506 03:05:19.216813 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console-operator container console-operator-575cd97545-twgts pod in namespace openshift-console-operator (previous: false). I0506 03:05:19.421836 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-5776f48f67-67p4k pod in namespace openshift-console (previous: false). I0506 03:05:19.617854 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-7df78c49f5-5prt6 pod in namespace openshift-console (previous: false). I0506 03:05:19.813077 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0506 03:05:19.813098 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-7df78c49f5-j8w7n pod in namespace openshift-console (previous: false). I0506 03:05:20.013641 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0506 03:05:20.013658 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for download-server container downloads-56cb7c9577-bq8cr pod in namespace openshift-console (previous: false). W0506 03:05:20.196083 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0506 03:05:20.212755 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0506 03:05:20.212770 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for download-server container downloads-56cb7c9577-qm8gc pod in namespace openshift-console (previous: false). I0506 03:05:20.418485 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for downloads-56cb7c9577-qm8gc pod in namespace openshift-console for failing operator download-server (previous: false): "container \"download-server\" in pod \"downloads-56cb7c9577-qm8gc\" is waiting to start: ContainerCreating" I0506 03:05:20.418504 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"download-server\" in pod \"downloads-56cb7c9577-qm8gc\" is waiting to start: ContainerCreating" I0506 03:05:20.418517 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-577f6d9bbc-7f888 pod in namespace openshift-ingress (previous: false). I0506 03:05:20.612607 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0506 03:05:20.612625 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-577f6d9bbc-r97mn pod in namespace openshift-ingress (previous: false). I0506 03:05:20.638232 1 tasks_processing.go:74] worker 59 stopped. I0506 03:05:20.638389 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=ea59fdf8c1648f1995a712a1de591614e30d89b904742f3df5fa07efdd7e87bb I0506 03:05:20.638438 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=b1d3a57201f472fba248e6e22732d03f4ebac77f3d7204455295e9c6f31f376a I0506 03:05:20.638475 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=53fa693d3e8475cc1ba05fe1324df25f3cb51bba186f88e7fd5a6ba10be4f5eb I0506 03:05:20.638485 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0506 03:05:20.638506 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=28e75c88ccc0625d842ad753a0baca554f7e72c5d74696dabfe64d474f84a069 I0506 03:05:20.638519 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0506 03:05:20.638539 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=e5c6e5b077784cf51c43d844a8928a222b49bc6b90b1a010050653206d3655b1 I0506 03:05:20.638575 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=51855b1380447b476d37ebde9ce143f24cf34a7e736c99cb9b9ae7a071f25f25 I0506 03:05:20.638598 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=ad82c5fd0371c31b0ad8054c5a6fdaf9804091047b15c65869697c85bae42ac6 I0506 03:05:20.638643 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=13286edec56d70144c1dbf98203f1256860ce4039ab91ecf84d574d83634acef I0506 03:05:20.638937 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=997ad26016e7bddf64590b8b02f5e0c85dda61eababbeb9e4939a341fb548056 I0506 03:05:20.638960 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=11eb2e615d0a37294c0409ce2870ed22668f0a06aa8ee80d3606df141393c7a5 I0506 03:05:20.638967 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0506 03:05:20.638984 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=7b0091cac72db4b0e5d5b6754ad6d5c9e7de3bdf3bc0d05e6593b4185a2f9297 I0506 03:05:20.638994 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0506 03:05:20.639010 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=d090640b6ed7c34cc3273a10a802cd968296c8067355b0bcda27182a72be4d90 I0506 03:05:20.639019 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0506 03:05:20.639038 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=c284506f5048c9dfaf7dd8216d1a318adfcbd4a55226b94fc3f436c27731ada0 I0506 03:05:20.639047 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0506 03:05:20.639067 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=3442167afc403b84b074c4e90a9f6e338ec4511ad01f7a50c93f5da187d58c9e I0506 03:05:20.639177 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=665fbb5741dc69cf46a62d8f20b0e1660cfba4977346195c4c07c7a5948bd378 I0506 03:05:20.639187 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0506 03:05:20.639195 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0506 03:05:20.639215 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0506 03:05:20.639235 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=903e6aee0e7a706019c26b3661bf72a5b673858fcb886615c9b22818f6052f1a I0506 03:05:20.639281 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=1d6c08d745203e229fe7cfa829f589d3ccfea028e8293f707e587c487e9de6b2 I0506 03:05:20.639291 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0506 03:05:20.639306 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=3cd3b0a7fb66e53304d8fa8042ca7a7194893da7f65a7d9d24649c7604258e5a I0506 03:05:20.639313 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0506 03:05:20.639331 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=db4e8107f48cb5cb38189ecb2319b034304d6fd32cfac8ce6c375ded326273ec I0506 03:05:20.639340 1 recorder.go:75] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0506 03:05:20.639353 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=1f5bb50864c32cd6528d118fdc3195bdfd69f04272dd8ce6ce90f3b5c1def31a I0506 03:05:20.639365 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=5cb5d415ee30b3bfbfe1ecbbbea6e029b7972ff0f7181d45a6074cb2f085632c I0506 03:05:20.639380 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=4e01a00cc2a64c3909a5ba79ab8ac3ab4134351abf51bc1a5b28836cc500f1d3 I0506 03:05:20.639402 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=0f63e078829cb4844f89ccef6fcbe4c11e4141c2bc3ab23ee00bca27c6ecea36 I0506 03:05:20.639410 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0506 03:05:20.639431 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=8250606e0bea3d193e15d149ddc37753f57bec15b2f752681d3c2b7f698c0bdf I0506 03:05:20.639448 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0506 03:05:20.639454 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0506 03:05:20.639460 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.464279543s to process 39 records I0506 03:05:20.818850 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-685c994f87-m2t8m pod in namespace openshift-ingress (previous: false). I0506 03:05:21.017713 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-7xn5j pod in namespace openshift-ingress-canary (previous: false). W0506 03:05:21.196232 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0506 03:05:21.219970 1 tasks_processing.go:74] worker 0 stopped. I0506 03:05:21.220201 1 recorder.go:75] Recording events/openshift-network-console with fingerprint=1ad80c0c25ebb5b1a33998114e9981ff06f157fb4cb3ee28cb685dcc214c32f1 I0506 03:05:21.220353 1 recorder.go:75] Recording events/openshift-console-operator with fingerprint=3ab15c36043dfd4f4bf4e6dd3cc2d602c244dd0222add9658020398ebab41976 I0506 03:05:21.220414 1 recorder.go:75] Recording events/openshift-console with fingerprint=6aa367da3d7883b63bc6c01137a98d0c5c30f53746b164dd972496dbba5cf373 I0506 03:05:21.220450 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=5ce2358d3e862edb5583c23772e3e045707fba0a5137d7ccb446bb68fcf0d87c I0506 03:05:21.220526 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=0e7296bcbe32156a28dc7c601b9ea03759e1834b203fad67fe58fccc62ae358c I0506 03:05:21.220557 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=011119ec12bf0715290c2c6928a1995c2cfdf233469625a0f3f07c9f5c36dbb9 I0506 03:05:21.220572 1 recorder.go:75] Recording config/pod/openshift-network-console/logs/networking-console-plugin-6ddbfdf749-4swc4/networking-console-plugin_current.log with fingerprint=5f8da4568bb130245e4879cb8d38dfc97332de160bea801d9ded56afc9ddbed8 I0506 03:05:21.220583 1 recorder.go:75] Recording config/pod/openshift-network-console/logs/networking-console-plugin-6ddbfdf749-7z2jn/networking-console-plugin_current.log with fingerprint=d7c77621d61c6642987bcb28e2703b3954bd63635509c43dd4ec8d5cff8da743 I0506 03:05:21.220729 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-575cd97545-twgts with fingerprint=191677c929a1219d9783140fc5039f94fa4d5dba379b80c301a2a1f24496faa4 E0506 03:05:21.220755 1 gather.go:161] error recording gatherer "clusterconfig" function "operators_pods_and_events" result "config/pod/openshift-console-operator/console-operator-575cd97545-twgts.json" because of the error: the record with the same name "config/pod/openshift-console-operator/console-operator-575cd97545-twgts.json" was already recorded and had the fingerprint "191677c929a1219d9783140fc5039f94fa4d5dba379b80c301a2a1f24496faa4", overwriting with the record having fingerprint "191677c929a1219d9783140fc5039f94fa4d5dba379b80c301a2a1f24496faa4" W0506 03:05:21.220775 1 gather.go:155] issue recording gatherer "clusterconfig" function "operators_pods_and_events" result "config/pod/openshift-console-operator/console-operator-575cd97545-twgts.json" because of the warning: warning: the record with the same fingerprint "191677c929a1219d9783140fc5039f94fa4d5dba379b80c301a2a1f24496faa4" was already recorded at path "config/pod/openshift-console-operator/console-operator-575cd97545-twgts.json", recording another one with a different path "config/pod/openshift-console-operator/console-operator-575cd97545-twgts.json" I0506 03:05:21.220805 1 recorder.go:75] Recording config/pod/openshift-console-operator/logs/console-operator-575cd97545-twgts/console-operator_previous.log with fingerprint=3101bdda683ffd5129712d241169426e56dc98a7182df2bc4e22240fdd62efd8 I0506 03:05:21.220956 1 recorder.go:75] Recording config/pod/openshift-console-operator/logs/console-operator-575cd97545-twgts/console-operator_current.log with fingerprint=2c739b0eff5ebc06431b92b326b4058463b43a989273bcf62e41e453a0e78378 I0506 03:05:21.220982 1 recorder.go:75] Recording config/pod/openshift-console/logs/console-5776f48f67-67p4k/console_current.log with fingerprint=533165dad7c843fa32df01d4f301906f37747c74d8f19287bb2c652f5fa1370d I0506 03:05:21.221013 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-577f6d9bbc-r97mn/router_current.log with fingerprint=65c1036bf5220b5657014f3e966911c3196658a125944a42c709a4f1307918a1 I0506 03:05:21.221041 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-685c994f87-m2t8m/router_current.log with fingerprint=6c16c01cf4fb5b1c642bf36cda51d7e75cc99a4c2fd0ca238f2bfbf77aa90a99 I0506 03:05:21.221050 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-7xn5j/serve-healthcheck-canary_current.log with fingerprint=d1bab1ce439a2c9cbfb155f22ee3631bc0639e326120790edf3b7d5a98ca74ee I0506 03:05:21.221059 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 3.046219434s to process 15 records W0506 03:05:22.195412 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0506 03:05:23.195560 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0506 03:05:23.195585 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0506 03:05:23.195602 1 tasks_processing.go:74] worker 36 stopped. E0506 03:05:23.195613 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0506 03:05:23.195625 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0506 03:05:23.195634 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.021651432s to process 1 records I0506 03:05:31.015907 1 tasks_processing.go:74] worker 10 stopped. I0506 03:05:31.015949 1 recorder.go:75] Recording config/installplans with fingerprint=95dfd5f33a9a46199239158a0ec0183b629818eca24ae41f4d706d7a3d604aec I0506 03:05:31.015960 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.841146151s to process 1 records I0506 03:05:31.784770 1 tasks_processing.go:74] worker 46 stopped. I0506 03:05:31.785201 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=5991659fe0409186a08b20dae99ef601d1844f1bf734983e7c2865b0a253752a I0506 03:05:31.785224 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.608103873s to process 1 records E0506 03:05:31.785316 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.611s with: function \"machines\" failed with an error, function \"tsdb_status\" failed with an error, function \"metrics\" failed with an error, function \"silenced_alerts\" failed with an error, function \"active_alerts\" failed with an error, function \"support_secret\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, unable to record function \"operators_pods_and_events\" record \"config/pod/openshift-console-operator/console-operator-575cd97545-twgts.json\", function \"dvo_metrics\" failed with an error" I0506 03:05:31.786446 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "tsdb_status" failed with an error, function "metrics" failed with an error, function "silenced_alerts" failed with an error, function "active_alerts" failed with an error, function "support_secret" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_healthchecks" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, unable to record function "operators_pods_and_events" record "config/pod/openshift-console-operator/console-operator-575cd97545-twgts.json", function "dvo_metrics" failed with an error I0506 03:05:31.786461 1 periodic.go:209] Running workloads gatherer I0506 03:05:31.786478 1 tasks_processing.go:45] number of workers: 2 I0506 03:05:31.786493 1 tasks_processing.go:69] worker 1 listening for tasks. I0506 03:05:31.786499 1 tasks_processing.go:71] worker 1 working on workload_info task. I0506 03:05:31.786502 1 tasks_processing.go:69] worker 0 listening for tasks. I0506 03:05:31.786514 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0506 03:05:31.791763 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-59.ec2.internal... I0506 03:05:31.810805 1 tasks_processing.go:74] worker 0 stopped. I0506 03:05:31.810824 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 24.272619ms to process 0 records I0506 03:05:35.841921 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 4s I0506 03:05:35.860697 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0506 03:05:35.868473 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (9ms) I0506 03:05:35.875784 1 gather_workloads_info.go:387] No image sha256:eff3318d5ac1d3a141221b536233305f54b3334fab56e5f8ba20ef8a9ed21429 (7ms) I0506 03:05:35.883427 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (8ms) I0506 03:05:35.891985 1 gather_workloads_info.go:387] No image sha256:80748ba08e1c264a8c105e7f607eff386a66378e024443a844993ee9292858c1 (9ms) I0506 03:05:35.899089 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (7ms) I0506 03:05:35.906733 1 gather_workloads_info.go:398] Found image sha256:da4f8a01ef5d0607cf76fa7b219fafdb6020cb4cf9a0a88cfe76d292c1a561fc (8ms) I0506 03:05:35.913730 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (7ms) I0506 03:05:35.921099 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (7ms) I0506 03:05:35.928135 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (7ms) I0506 03:05:35.935486 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (7ms) I0506 03:05:35.968456 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (33ms) I0506 03:05:36.069103 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (101ms) I0506 03:05:36.169216 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (100ms) I0506 03:05:36.268621 1 gather_workloads_info.go:387] No image sha256:50197f22710766515f67944a779e00dd9ae3d17b18732d7324a970353b11f292 (99ms) I0506 03:05:36.369301 1 gather_workloads_info.go:398] Found image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (101ms) I0506 03:05:36.469105 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (100ms) I0506 03:05:36.568707 1 gather_workloads_info.go:387] No image sha256:ef2bfb546cd8aac31b7671585f718f44b268ed43a9c8562016ab741558a7dfa1 (100ms) I0506 03:05:36.668144 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (99ms) I0506 03:05:36.768806 1 gather_workloads_info.go:387] No image sha256:3d6ea9e1633f38070718a1357fcb80e6cb3932aafcc4d65e659795b186c5da15 (101ms) I0506 03:05:36.869061 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (100ms) I0506 03:05:36.968368 1 gather_workloads_info.go:387] No image sha256:fac526ab9335a9a8decb028a30673f4ae718deae8da114f36103b6438ba6458f (99ms) I0506 03:05:37.070245 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (102ms) I0506 03:05:37.169563 1 gather_workloads_info.go:387] No image sha256:fab570ecdc9c3620b032bc4c5b44240f5ebac0bb9e48dfeea32bcd36eb462e5a (99ms) I0506 03:05:37.269755 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (100ms) I0506 03:05:37.368968 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (99ms) I0506 03:05:37.470171 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (101ms) I0506 03:05:37.575841 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (106ms) I0506 03:05:37.675806 1 gather_workloads_info.go:387] No image sha256:76cc47f3775560477ec548c7b6fddbd99112ad6604f790697eef546576051fb7 (100ms) I0506 03:05:37.769783 1 gather_workloads_info.go:387] No image sha256:a505dd5b62d744c2cfda2666b5e21e0a4704354a3114488bd3291456085e1e33 (94ms) I0506 03:05:37.869309 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (100ms) I0506 03:05:37.968963 1 gather_workloads_info.go:387] No image sha256:3612c5a433effd17b7aff7ff6edf4fb27b61153908e3a0294158e4886a1d600d (100ms) I0506 03:05:38.068423 1 gather_workloads_info.go:387] No image sha256:d3209a996e5ce362136e70a0bcf06d89973905de73e234b644d8ae8886d067f1 (99ms) I0506 03:05:38.168395 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (100ms) I0506 03:05:38.269550 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (101ms) I0506 03:05:38.368986 1 gather_workloads_info.go:387] No image sha256:25bda9d34e23ba6bc9df5cf7104bdb237269740a3a76ee025f88b34e68b7e2b5 (99ms) I0506 03:05:38.469797 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (101ms) I0506 03:05:38.568511 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (99ms) I0506 03:05:38.668357 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (100ms) I0506 03:05:38.771952 1 gather_workloads_info.go:398] Found image sha256:32d4561d4bf1b3c4e3a7878f918f9c1422bab85bdf8711fbdf905d59692fee81 (104ms) I0506 03:05:38.868757 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (97ms) I0506 03:05:38.969162 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (100ms) I0506 03:05:39.068062 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (99ms) I0506 03:05:39.168586 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (101ms) I0506 03:05:39.268685 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (100ms) I0506 03:05:39.370305 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (102ms) I0506 03:05:39.370338 1 tasks_processing.go:74] worker 1 stopped. I0506 03:05:39.370579 1 recorder.go:75] Recording config/workload_info with fingerprint=b40241cb80978ca152243cc403d1c076e3b776bdc37da76ce0a4e4ec5c347a1b I0506 03:05:39.370594 1 gather.go:177] gatherer "workloads" function "workload_info" took 7.58383144s to process 1 records I0506 03:05:39.370606 1 periodic.go:256] Periodic gather workloads completed in 7.584s I0506 03:05:39.370614 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0506 03:05:39.370618 1 periodic.go:209] Running conditional gatherer I0506 03:05:39.376686 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0506 03:05:39.583876 1 conditional_gatherer.go:338] updating alerts cache for conditional gatherer E0506 03:05:39.586331 1 conditional_gatherer.go:324] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: no such host I0506 03:05:39.586406 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0506 03:05:39.592953 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0506 03:05:39.592971 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 03:05:39.592977 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 03:05:39.592980 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 03:05:39.592983 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 03:05:39.592986 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 03:05:39.592989 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 03:05:39.592991 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 03:05:39.592994 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 03:05:39.592997 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0506 03:05:39.593001 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0506 03:05:39.593014 1 tasks_processing.go:45] number of workers: 3 I0506 03:05:39.593023 1 tasks_processing.go:69] worker 2 listening for tasks. I0506 03:05:39.593027 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0506 03:05:39.593035 1 tasks_processing.go:69] worker 0 listening for tasks. I0506 03:05:39.593040 1 tasks_processing.go:69] worker 1 listening for tasks. I0506 03:05:39.593046 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0506 03:05:39.593047 1 tasks_processing.go:74] worker 1 stopped. I0506 03:05:39.593058 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0506 03:05:39.593105 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=9fafdcbf373f1f367f1d69551ea59114592cce1681189be0f3dde774e0530661 I0506 03:05:39.593146 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 877ns to process 1 records I0506 03:05:39.593181 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0506 03:05:39.593188 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.079µs to process 1 records I0506 03:05:39.593194 1 tasks_processing.go:74] worker 0 stopped. I0506 03:05:39.593327 1 tasks_processing.go:74] worker 2 stopped. I0506 03:05:39.593340 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 251.673µs to process 0 records I0506 03:05:39.593356 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=Succeeded message= I0506 03:05:39.593371 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I0506 03:05:39.624699 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=4aca1315ca65bb61b1a8ada751bd2693d2345cb704c656f1fa27fb91c24d3d28 I0506 03:05:39.624824 1 diskrecorder.go:70] Writing 115 records to /var/lib/insights-operator/insights-2026-05-06-030539.tar.gz I0506 03:05:39.632392 1 diskrecorder.go:51] Wrote 115 records to disk in 7ms I0506 03:05:39.632420 1 periodic.go:278] Gathering cluster info every 2h0m0s I0506 03:05:39.632432 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0506 03:06:48.173988 1 diskrecorder.go:223] Found files to send: insights-2026-05-06-030539.tar.gz I0506 03:06:48.174016 1 insightsuploader.go:150] Checking archives to upload periodically every 16m21.54130703s I0506 03:06:48.174025 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0506 03:06:48.186873 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0506 03:06:48.516795 1 requests.go:87] Successfully reported id=2026-05-06T03:06:48Z x-rh-insights-request-id=7f19436abf984a7eb72cbb2fc26a8e1b, wrote=59868 I0506 03:06:48.516860 1 insightsuploader.go:187] Uploaded report successfully in 342.827865ms I0506 03:06:48.516882 1 controller.go:128] Initializing last reported time to 2026-05-06T03:06:48Z I0506 03:06:48.516899 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0506 03:06:48.516905 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0506 03:06:48.516913 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0506 03:06:48.522366 1 controller.go:512] The operator is healthy I0506 03:07:18.194324 1 controller.go:512] The operator is healthy I0506 03:07:49.932686 1 insightsreport.go:137] Pulling report from smart-proxy I0506 03:07:49.932709 1 insightsreport.go:149] Retrieving report I0506 03:07:49.939412 1 requests.go:110] Retrieving report for cluster: 485a3459-fad0-4cb8-a022-6b659e97d9c2 I0506 03:07:49.939423 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/485a3459-fad0-4cb8-a022-6b659e97d9c2/reports I0506 03:07:49.942178 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/485a3459-fad0-4cb8-a022-6b659e97d9c2/reports I0506 03:07:50.309053 1 insightsreport.go:184] Report retrieved I0506 03:07:50.337006 1 insightsreport.go:239] Report retrieved correctly I0506 03:09:18.194399 1 controller.go:512] The operator is healthy I0506 03:10:18.165422 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0506 03:10:18.172625 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0506 03:10:18.172643 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0506 03:10:18.176465 1 secretconfigobserver.go:119] support secret does not exist I0506 03:11:18.194765 1 controller.go:512] The operator is healthy I0506 03:13:18.197725 1 controller.go:512] The operator is healthy I0506 03:15:18.163484 1 configmapobserver.go:84] configmaps "insights-config" not found I0506 03:15:18.167443 1 configmapobserver.go:84] configmaps "insights-config" not found I0506 03:15:18.177537 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0506 03:15:18.181568 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0506 03:15:18.181583 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0506 03:15:18.185158 1 secretconfigobserver.go:119] support secret does not exist I0506 03:15:18.193141 1 controller.go:512] The operator is healthy I0506 03:17:18.203973 1 controller.go:512] The operator is healthy I0506 03:19:18.194400 1 controller.go:512] The operator is healthy I0506 03:20:18.186040 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0506 03:20:18.191652 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0506 03:20:18.191671 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0506 03:20:18.195470 1 secretconfigobserver.go:119] support secret does not exist I0506 03:21:18.228840 1 controller.go:512] The operator is healthy I0506 03:23:15.059350 1 insightsuploader.go:146] Nothing to report since 2026-05-06T03:06:48Z I0506 03:23:18.197277 1 controller.go:512] The operator is healthy I0506 03:25:18.167545 1 configmapobserver.go:84] configmaps "insights-config" not found I0506 03:25:18.171773 1 configmapobserver.go:84] configmaps "insights-config" not found I0506 03:25:18.193187 1 controller.go:512] The operator is healthy I0506 03:25:18.196078 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0506 03:25:18.200332 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0506 03:25:18.200348 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0506 03:25:18.204103 1 secretconfigobserver.go:119] support secret does not exist I0506 03:27:18.196861 1 controller.go:512] The operator is healthy I0506 03:29:18.196836 1 controller.go:512] The operator is healthy I0506 03:30:18.204951 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0506 03:30:18.213343 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0506 03:30:18.213365 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0506 03:30:18.217156 1 secretconfigobserver.go:119] support secret does not exist I0506 03:31:18.197906 1 controller.go:512] The operator is healthy I0506 03:33:18.198849 1 controller.go:512] The operator is healthy I0506 03:35:18.169818 1 configmapobserver.go:84] configmaps "insights-config" not found I0506 03:35:18.193235 1 controller.go:512] The operator is healthy I0506 03:35:18.217360 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0506 03:35:18.221589 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0506 03:35:18.221611 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0506 03:35:18.225342 1 secretconfigobserver.go:119] support secret does not exist I0506 03:37:18.197608 1 controller.go:512] The operator is healthy I0506 03:38:54.658942 1 insightsuploader.go:146] Nothing to report since 2026-05-06T03:06:48Z I0506 03:39:18.195043 1 controller.go:512] The operator is healthy I0506 03:40:18.225663 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0506 03:40:18.230499 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0506 03:40:18.230522 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0506 03:40:18.234470 1 secretconfigobserver.go:119] support secret does not exist I0506 03:41:18.194563 1 controller.go:512] The operator is healthy I0506 03:43:18.194390 1 controller.go:512] The operator is healthy