I0405 15:05:56.071020 1 cmd.go:253] Using service-serving-cert provided certificates I0405 15:05:56.071519 1 observer_polling.go:159] Starting file observer I0405 15:05:56.562948 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0405 15:05:56.563162 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0405 15:05:56.563828 1 secure_serving.go:57] Forcing use of http/1.1 only I0405 15:05:56.563786 1 simple_featuregate_reader.go:171] Starting feature-gate-detector W0405 15:05:56.563854 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0405 15:05:56.563865 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0405 15:05:56.563869 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0405 15:05:56.563875 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0405 15:05:56.563880 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0405 15:05:56.563884 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0405 15:05:56.568449 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0405 15:05:56.568491 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"67bc4ef7-622d-4612-ad8d-7d5bf18946f6", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0405 15:05:56.569676 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0405 15:05:56.569703 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0405 15:05:56.570203 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0405 15:05:56.570244 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0405 15:05:56.570268 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0405 15:05:56.570288 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0405 15:05:56.570520 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0405 15:05:56.570592 1 secure_serving.go:213] Serving securely on [::]:8443 I0405 15:05:56.570624 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0405 15:05:56.573702 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0405 15:05:56.573731 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0405 15:05:56.573828 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0405 15:05:56.578887 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0405 15:05:56.578903 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0405 15:05:56.583320 1 secretconfigobserver.go:119] support secret does not exist I0405 15:05:56.588266 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0405 15:05:56.592783 1 secretconfigobserver.go:119] support secret does not exist I0405 15:05:56.594855 1 recorder.go:161] Pruning old reports every 7h38m9s, max age is 288h0m0s I0405 15:05:56.599870 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0405 15:05:56.599884 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0405 15:05:56.599899 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0405 15:05:56.599907 1 insightsreport.go:296] Starting report retriever I0405 15:05:56.599907 1 periodic.go:209] Running clusterconfig gatherer I0405 15:05:56.599915 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0405 15:05:56.599947 1 tasks_processing.go:45] number of workers: 64 I0405 15:05:56.599971 1 tasks_processing.go:69] worker 3 listening for tasks. I0405 15:05:56.599980 1 tasks_processing.go:69] worker 0 listening for tasks. I0405 15:05:56.599981 1 tasks_processing.go:69] worker 17 listening for tasks. I0405 15:05:56.599986 1 tasks_processing.go:69] worker 2 listening for tasks. I0405 15:05:56.599989 1 tasks_processing.go:71] worker 0 working on lokistack task. I0405 15:05:56.599992 1 tasks_processing.go:69] worker 41 listening for tasks. I0405 15:05:56.599992 1 tasks_processing.go:69] worker 1 listening for tasks. I0405 15:05:56.599989 1 tasks_processing.go:71] worker 17 working on openstack_version task. I0405 15:05:56.600011 1 tasks_processing.go:69] worker 19 listening for tasks. I0405 15:05:56.600014 1 tasks_processing.go:69] worker 56 listening for tasks. I0405 15:05:56.600017 1 tasks_processing.go:69] worker 42 listening for tasks. I0405 15:05:56.600020 1 tasks_processing.go:69] worker 20 listening for tasks. I0405 15:05:56.600022 1 tasks_processing.go:69] worker 54 listening for tasks. I0405 15:05:56.600026 1 tasks_processing.go:69] worker 55 listening for tasks. I0405 15:05:56.600009 1 tasks_processing.go:69] worker 53 listening for tasks. I0405 15:05:56.600031 1 tasks_processing.go:69] worker 57 listening for tasks. I0405 15:05:56.600035 1 tasks_processing.go:69] worker 44 listening for tasks. I0405 15:05:56.600037 1 tasks_processing.go:69] worker 58 listening for tasks. I0405 15:05:56.600031 1 tasks_processing.go:69] worker 21 listening for tasks. I0405 15:05:56.600021 1 tasks_processing.go:69] worker 59 listening for tasks. I0405 15:05:56.600028 1 tasks_processing.go:69] worker 43 listening for tasks. I0405 15:05:56.600046 1 tasks_processing.go:69] worker 49 listening for tasks. I0405 15:05:56.600035 1 tasks_processing.go:69] worker 22 listening for tasks. I0405 15:05:56.600050 1 tasks_processing.go:69] worker 33 listening for tasks. I0405 15:05:56.600037 1 tasks_processing.go:69] worker 10 listening for tasks. I0405 15:05:56.600041 1 tasks_processing.go:69] worker 23 listening for tasks. I0405 15:05:56.600056 1 tasks_processing.go:69] worker 34 listening for tasks. I0405 15:05:56.600057 1 tasks_processing.go:69] worker 13 listening for tasks. I0405 15:05:56.600059 1 tasks_processing.go:69] worker 6 listening for tasks. I0405 15:05:56.600061 1 tasks_processing.go:69] worker 51 listening for tasks. I0405 15:05:56.600065 1 tasks_processing.go:69] worker 25 listening for tasks. I0405 15:05:56.600065 1 tasks_processing.go:69] worker 32 listening for tasks. I0405 15:05:56.600072 1 tasks_processing.go:69] worker 26 listening for tasks. I0405 15:05:56.600073 1 tasks_processing.go:69] worker 7 listening for tasks. I0405 15:05:56.600075 1 tasks_processing.go:69] worker 40 listening for tasks. I0405 15:05:56.600078 1 tasks_processing.go:69] worker 38 listening for tasks. I0405 15:05:56.600080 1 tasks_processing.go:69] worker 27 listening for tasks. I0405 15:05:56.600046 1 tasks_processing.go:69] worker 24 listening for tasks. I0405 15:05:56.600084 1 tasks_processing.go:69] worker 31 listening for tasks. I0405 15:05:56.600088 1 tasks_processing.go:69] worker 30 listening for tasks. I0405 15:05:56.600091 1 tasks_processing.go:69] worker 16 listening for tasks. I0405 15:05:56.600090 1 tasks_processing.go:69] worker 9 listening for tasks. I0405 15:05:56.600094 1 tasks_processing.go:69] worker 15 listening for tasks. I0405 15:05:56.600096 1 tasks_processing.go:69] worker 46 listening for tasks. I0405 15:05:56.600101 1 tasks_processing.go:71] worker 1 working on machine_healthchecks task. I0405 15:05:56.600101 1 tasks_processing.go:71] worker 56 working on overlapping_namespace_uids task. I0405 15:05:56.600108 1 tasks_processing.go:71] worker 49 working on operators_pods_and_events task. I0405 15:05:56.600107 1 tasks_processing.go:71] worker 42 working on sap_datahubs task. I0405 15:05:56.600113 1 tasks_processing.go:71] worker 55 working on storage_cluster task. I0405 15:05:56.600135 1 tasks_processing.go:71] worker 33 working on storage_classes task. I0405 15:05:56.600108 1 tasks_processing.go:71] worker 54 working on ingress_certificates task. I0405 15:05:56.600140 1 tasks_processing.go:71] worker 10 working on aggregated_monitoring_cr_names task. I0405 15:05:56.600143 1 tasks_processing.go:71] worker 27 working on clusterroles task. I0405 15:05:56.600149 1 tasks_processing.go:71] worker 6 working on machine_sets task. I0405 15:05:56.600151 1 tasks_processing.go:71] worker 53 working on ceph_cluster task. I0405 15:05:56.600106 1 tasks_processing.go:71] worker 13 working on nodes task. I0405 15:05:56.600391 1 tasks_processing.go:71] worker 30 working on authentication task. I0405 15:05:56.600459 1 tasks_processing.go:71] worker 9 working on mutating_webhook_configurations task. I0405 15:05:56.600533 1 tasks_processing.go:71] worker 21 working on support_secret task. I0405 15:05:56.600564 1 tasks_processing.go:71] worker 15 working on image task. I0405 15:05:56.600402 1 tasks_processing.go:71] worker 16 working on cost_management_metrics_configs task. I0405 15:05:56.600048 1 tasks_processing.go:69] worker 11 listening for tasks. I0405 15:05:56.600135 1 tasks_processing.go:71] worker 23 working on container_images task. I0405 15:05:56.600787 1 tasks_processing.go:71] worker 26 working on pod_network_connectivity_checks task. I0405 15:05:56.600811 1 tasks_processing.go:71] worker 7 working on proxies task. I0405 15:05:56.600135 1 tasks_processing.go:71] worker 46 working on openshift_machine_api_events task. I0405 15:05:56.600918 1 tasks_processing.go:71] worker 11 working on olm_operators task. I0405 15:05:56.599998 1 tasks_processing.go:69] worker 18 listening for tasks. I0405 15:05:56.600061 1 tasks_processing.go:69] worker 48 listening for tasks. I0405 15:05:56.600050 1 tasks_processing.go:69] worker 5 listening for tasks. I0405 15:05:56.600053 1 tasks_processing.go:69] worker 12 listening for tasks. I0405 15:05:56.600055 1 tasks_processing.go:69] worker 50 listening for tasks. I0405 15:05:56.600044 1 tasks_processing.go:69] worker 14 listening for tasks. I0405 15:05:56.600045 1 tasks_processing.go:69] worker 4 listening for tasks. I0405 15:05:56.600061 1 tasks_processing.go:69] worker 28 listening for tasks. I0405 15:05:56.600062 1 tasks_processing.go:69] worker 35 listening for tasks. I0405 15:05:56.600065 1 tasks_processing.go:69] worker 52 listening for tasks. I0405 15:05:56.600067 1 tasks_processing.go:69] worker 39 listening for tasks. I0405 15:05:56.601104 1 tasks_processing.go:71] worker 51 working on qemu_kubevirt_launcher_logs task. I0405 15:05:56.600073 1 tasks_processing.go:69] worker 62 listening for tasks. I0405 15:05:56.601319 1 tasks_processing.go:71] worker 50 working on openstack_dataplanenodesets task. I0405 15:05:56.600074 1 tasks_processing.go:69] worker 36 listening for tasks. I0405 15:05:56.600079 1 tasks_processing.go:69] worker 29 listening for tasks. I0405 15:05:56.600079 1 tasks_processing.go:69] worker 60 listening for tasks. I0405 15:05:56.600083 1 tasks_processing.go:69] worker 8 listening for tasks. I0405 15:05:56.600088 1 tasks_processing.go:69] worker 45 listening for tasks. I0405 15:05:56.600087 1 tasks_processing.go:69] worker 61 listening for tasks. I0405 15:05:56.600088 1 tasks_processing.go:69] worker 63 listening for tasks. I0405 15:05:56.601385 1 tasks_processing.go:71] worker 14 working on service_accounts task. I0405 15:05:56.601390 1 tasks_processing.go:71] worker 63 working on networks task. I0405 15:05:56.601405 1 tasks_processing.go:71] worker 28 working on dvo_metrics task. I0405 15:05:56.601411 1 tasks_processing.go:71] worker 4 working on pdbs task. I0405 15:05:56.601423 1 tasks_processing.go:71] worker 35 working on infrastructures task. I0405 15:05:56.601589 1 tasks_processing.go:71] worker 61 working on install_plans task. I0405 15:05:56.601597 1 tasks_processing.go:71] worker 29 working on ingress task. I0405 15:05:56.601636 1 tasks_processing.go:71] worker 36 working on openstack_controlplanes task. I0405 15:05:56.601670 1 tasks_processing.go:71] worker 8 working on active_alerts task. I0405 15:05:56.601420 1 tasks_processing.go:71] worker 52 working on schedulers task. I0405 15:05:56.600094 1 tasks_processing.go:69] worker 37 listening for tasks. I0405 15:05:56.602178 1 tasks_processing.go:71] worker 37 working on config_maps task. I0405 15:05:56.600100 1 tasks_processing.go:71] worker 2 working on machines task. I0405 15:05:56.600100 1 tasks_processing.go:71] worker 41 working on oauths task. I0405 15:05:56.600101 1 tasks_processing.go:71] worker 19 working on version task. I0405 15:05:56.600109 1 tasks_processing.go:71] worker 44 working on feature_gates task. I0405 15:05:56.600112 1 tasks_processing.go:71] worker 22 working on openstack_dataplanedeployments task. I0405 15:05:56.600109 1 tasks_processing.go:71] worker 20 working on certificate_signing_requests task. I0405 15:05:56.600143 1 tasks_processing.go:71] worker 38 working on container_runtime_configs task. I0405 15:05:56.600173 1 tasks_processing.go:71] worker 57 working on image_pruners task. I0405 15:05:56.600616 1 tasks_processing.go:71] worker 34 working on machine_autoscalers task. I0405 15:05:56.600634 1 tasks_processing.go:71] worker 24 working on cluster_apiserver task. I0405 15:05:56.600640 1 tasks_processing.go:71] worker 59 working on machine_config_pools task. I0405 15:05:56.600643 1 tasks_processing.go:71] worker 43 working on sap_pods task. I0405 15:05:56.600376 1 tasks_processing.go:71] worker 58 working on nodenetworkstates task. I0405 15:05:56.600719 1 tasks_processing.go:71] worker 32 working on image_registries task. I0405 15:05:56.600737 1 tasks_processing.go:71] worker 25 working on metrics task. I0405 15:05:56.600743 1 tasks_processing.go:71] worker 31 working on tsdb_status task. I0405 15:05:56.600812 1 tasks_processing.go:71] worker 40 working on validating_webhook_configurations task. I0405 15:05:56.601218 1 tasks_processing.go:71] worker 39 working on nodenetworkconfigurationpolicies task. I0405 15:05:56.601228 1 tasks_processing.go:71] worker 18 working on openshift_logging task. I0405 15:05:56.601232 1 tasks_processing.go:71] worker 48 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0405 15:05:56.601240 1 tasks_processing.go:71] worker 5 working on operators task. I0405 15:05:56.601244 1 tasks_processing.go:71] worker 12 working on sap_config task. I0405 15:05:56.601374 1 tasks_processing.go:71] worker 62 working on crds task. I0405 15:05:56.601514 1 tasks_processing.go:71] worker 45 working on machine_configs task. I0405 15:05:56.600095 1 tasks_processing.go:69] worker 47 listening for tasks. I0405 15:05:56.603352 1 tasks_processing.go:71] worker 47 working on monitoring_persistent_volumes task. I0405 15:05:56.600093 1 tasks_processing.go:71] worker 3 working on silenced_alerts task. I0405 15:05:56.601580 1 tasks_processing.go:71] worker 60 working on jaegers task. I0405 15:05:56.604066 1 tasks_processing.go:71] worker 53 working on node_logs task. I0405 15:05:56.604131 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 3.903268ms to process 0 records I0405 15:05:56.604586 1 tasks_processing.go:74] worker 1 stopped. E0405 15:05:56.604603 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0405 15:05:56.604614 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 4.46911ms to process 0 records I0405 15:05:56.605579 1 tasks_processing.go:74] worker 17 stopped. I0405 15:05:56.605592 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 5.560314ms to process 0 records I0405 15:05:56.605599 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 5.421238ms to process 0 records I0405 15:05:56.605604 1 tasks_processing.go:74] worker 6 stopped. I0405 15:05:56.605680 1 tasks_processing.go:74] worker 16 stopped. I0405 15:05:56.605692 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 5.011537ms to process 0 records I0405 15:05:56.606295 1 tasks_processing.go:74] worker 30 stopped. I0405 15:05:56.606511 1 recorder.go:75] Recording config/authentication with fingerprint=c7372ca226b780168a8768f654f61416cae71fa1025a2dadf37b64302d063aa5 I0405 15:05:56.606529 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 5.840649ms to process 1 records I0405 15:05:56.606539 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 6.43867ms to process 0 records I0405 15:05:56.606549 1 tasks_processing.go:74] worker 0 stopped. I0405 15:05:56.606559 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0405 15:05:56.606572 1 controller.go:326] The initial operator extension status is healthy I0405 15:05:56.606584 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0405 15:05:56.606589 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0405 15:05:56.606594 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0405 15:05:56.606614 1 controller.go:489] The operator is still being initialized I0405 15:05:56.606626 1 controller.go:512] The operator is healthy I0405 15:05:56.606702 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0405 15:05:56.606706 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0405 15:05:56.606817 1 operator.go:288] started I0405 15:05:56.606837 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0405 15:05:56.606849 1 tasks_processing.go:74] worker 42 stopped. I0405 15:05:56.606858 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 6.698486ms to process 0 records I0405 15:05:56.606965 1 tasks_processing.go:74] worker 15 stopped. I0405 15:05:56.607043 1 recorder.go:75] Recording config/image with fingerprint=e9d78eb4624fbdb89f1844ca8b25810f79f44c4d96a8209ff6b808d076d85baa I0405 15:05:56.607055 1 gather.go:177] gatherer "clusterconfig" function "image" took 6.335342ms to process 1 records E0405 15:05:56.607163 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.142.222:9091: connect: connection refused E0405 15:05:56.607162 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.142.222:9091: connect: connection refused I0405 15:05:56.607175 1 tasks_processing.go:74] worker 31 stopped. E0405 15:05:56.607179 1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.142.222:9091: connect: connection refused I0405 15:05:56.607189 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 4.641294ms to process 0 records E0405 15:05:56.607201 1 gather_silenced_alerts.go:52] Unable to retrieve silenced alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.173.117:9094: connect: connection refused E0405 15:05:56.607197 1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.142.222:9091: connect: connection refused I0405 15:05:56.607214 1 tasks_processing.go:74] worker 25 stopped. I0405 15:05:56.607216 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 4.658958ms to process 0 records E0405 15:05:56.607217 1 gather_active_alerts.go:64] Unable to retrieve most recent alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.173.117:9094: connect: connection refused E0405 15:05:56.607235 1 gather.go:140] gatherer "clusterconfig" function "silenced_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.173.117:9094: connect: connection refused I0405 15:05:56.607244 1 tasks_processing.go:74] worker 3 stopped. I0405 15:05:56.607245 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 3.850498ms to process 0 records E0405 15:05:56.607254 1 gather.go:140] gatherer "clusterconfig" function "active_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.173.117:9094: connect: connection refused I0405 15:05:56.607261 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 5.322719ms to process 0 records I0405 15:05:56.607268 1 tasks_processing.go:74] worker 8 stopped. I0405 15:05:56.620939 1 tasks_processing.go:74] worker 50 stopped. I0405 15:05:56.620951 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 19.521379ms to process 0 records I0405 15:05:56.620958 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 20.818413ms to process 0 records I0405 15:05:56.620964 1 tasks_processing.go:74] worker 55 stopped. I0405 15:05:56.620990 1 tasks_processing.go:74] worker 9 stopped. I0405 15:05:56.621196 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=bbc4c52e5afa7c738b37811cc00689c93143fe572d90e14f8466f3ad9bdc4a6d I0405 15:05:56.621228 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=056e7bb50ea530a7a98f9af2de9e23fd58aaba72b158c6e86817fdd4cdf3beee I0405 15:05:56.621253 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=25be4ed822e1e89e1d73a18e5e96d16fd6f046c087f067a6f3a63495042cbb8c I0405 15:05:56.621261 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 20.480262ms to process 3 records I0405 15:05:56.629069 1 tasks_processing.go:74] worker 33 stopped. I0405 15:05:56.629182 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=624f4dd5dbc302fb101eadf899477740b19f69a87d5c8f5720f7b914572ade89 I0405 15:05:56.629198 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=010827301e33c23131b05dfb2fa4ce70cb9d3747f2e5bf1987d24180259a7c70 I0405 15:05:56.629204 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 28.924494ms to process 2 records I0405 15:05:56.629214 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 27.425096ms to process 0 records E0405 15:05:56.629219 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0405 15:05:56.629224 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 28.538662ms to process 0 records I0405 15:05:56.629231 1 tasks_processing.go:74] worker 21 stopped. I0405 15:05:56.629232 1 tasks_processing.go:74] worker 36 stopped. I0405 15:05:56.629362 1 tasks_processing.go:74] worker 38 stopped. I0405 15:05:56.629372 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 27.092224ms to process 0 records I0405 15:05:56.629419 1 tasks_processing.go:74] worker 39 stopped. I0405 15:05:56.629432 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 26.805847ms to process 0 records I0405 15:05:56.629449 1 tasks_processing.go:74] worker 26 stopped. E0405 15:05:56.629459 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0405 15:05:56.629464 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 28.617183ms to process 0 records I0405 15:05:56.629562 1 tasks_processing.go:74] worker 7 stopped. I0405 15:05:56.629628 1 recorder.go:75] Recording config/proxy with fingerprint=85fe10e7d348c3ef5ba41fa671ae4e3c82151fc90ec29be02c722a3e9026165a I0405 15:05:56.629640 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 28.677459ms to process 1 records I0405 15:05:56.629651 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 26.889354ms to process 0 records I0405 15:05:56.629664 1 tasks_processing.go:74] worker 18 stopped. I0405 15:05:56.629731 1 tasks_processing.go:74] worker 29 stopped. I0405 15:05:56.629775 1 recorder.go:75] Recording config/ingress with fingerprint=a70d90090cb0f83a32bacbfc4b9339faa2a969ba48180c714cea25a3c6398d8d I0405 15:05:56.629786 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 28.003404ms to process 1 records I0405 15:05:56.629791 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 27.356504ms to process 0 records I0405 15:05:56.629803 1 tasks_processing.go:74] worker 22 stopped. I0405 15:05:56.629975 1 tasks_processing.go:74] worker 35 stopped. I0405 15:05:56.630229 1 gather_logs.go:145] no pods in namespace were found I0405 15:05:56.630883 1 recorder.go:75] Recording config/infrastructure with fingerprint=1bca209831f331cf8e70bfee804823556e4bf3fe53d980d65bf28e9424ca5cc9 I0405 15:05:56.630910 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 28.04411ms to process 1 records I0405 15:05:56.631025 1 tasks_processing.go:74] worker 24 stopped. I0405 15:05:56.631156 1 recorder.go:75] Recording config/apiserver with fingerprint=864f8453dd2bf533871117fc9f2ca717be6acf4d83ca5fbc3ab45994502de2c9 I0405 15:05:56.631214 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 27.461367ms to process 1 records I0405 15:05:56.631402 1 tasks_processing.go:74] worker 41 stopped. I0405 15:05:56.632195 1 recorder.go:75] Recording config/oauth with fingerprint=b36b5b42c221073d8671cae7858830338f3b82068c5159acb20d4e9160c1ba21 I0405 15:05:56.632216 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 27.698005ms to process 1 records I0405 15:05:56.632288 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=e9822bef96acc3c5339350767b1cda0adc340cfe2f152274315c671ae9a0706f I0405 15:05:56.632358 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 27.933156ms to process 1 records I0405 15:05:56.632309 1 tasks_processing.go:74] worker 52 stopped. I0405 15:05:56.632369 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 29.142682ms to process 0 records I0405 15:05:56.632425 1 tasks_processing.go:74] worker 51 stopped. I0405 15:05:56.632494 1 tasks_processing.go:74] worker 63 stopped. I0405 15:05:56.632543 1 recorder.go:75] Recording config/network with fingerprint=20d0bbe47509812ff33a3168fe98ca1d575008679a623b48bbc06175a71352fe I0405 15:05:56.632603 1 gather.go:177] gatherer "clusterconfig" function "networks" took 29.481185ms to process 1 records I0405 15:05:56.632688 1 tasks_processing.go:74] worker 43 stopped. I0405 15:05:56.632705 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 30.273831ms to process 0 records I0405 15:05:56.632745 1 tasks_processing.go:74] worker 2 stopped. E0405 15:05:56.632757 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0405 15:05:56.632773 1 gather.go:177] gatherer "clusterconfig" function "machines" took 30.521497ms to process 0 records I0405 15:05:56.632788 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 31.861314ms to process 0 records I0405 15:05:56.632796 1 tasks_processing.go:74] worker 46 stopped. I0405 15:05:56.632812 1 tasks_processing.go:74] worker 34 stopped. I0405 15:05:56.632821 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 30.53316ms to process 0 records I0405 15:05:56.632829 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 29.439173ms to process 0 records I0405 15:05:56.632856 1 tasks_processing.go:74] worker 60 stopped. I0405 15:05:56.632936 1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=5903d92e38b48acaddfcf6452a4c113fcd8815cff8b19fae5d508f4e64b2094d I0405 15:05:56.632955 1 tasks_processing.go:74] worker 4 stopped. I0405 15:05:56.632971 1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=ba7af75e460761f7758ed266e383bf2e6f97b24b9643505f98f304ba42a82689 I0405 15:05:56.632998 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=77b555600326ddea79704a8a369f07226f9fcb0e14275d3091ab071be209db49 I0405 15:05:56.633020 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=a7bed6c34d2741c3e28db54af0a91027fbd2212396e4350757f7dd23cc6b490f I0405 15:05:56.633047 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=3498ab481d17c470a16a09fa373f363829f0cbb06e0a109e2a70076429c028d9 I0405 15:05:56.633074 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=4658a0c57e52b79ca2984a5cbc2a01ead770c6eb39fb0af99507c5c74ea8a8fe I0405 15:05:56.633099 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=becbaf1dd58580b60ba051a62da8bac6de6d822e41cc2e259cedaa212774873c I0405 15:05:56.633141 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=f093e26957efd0dfa90aa77afbf412ac22b95d6a5d80ce93ab746f9ff8ff558a I0405 15:05:56.633172 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=cf007557e0bdfdb7e90ce6b76b155362ecd19eb0b859adebb8e63e5833bda1ff I0405 15:05:56.633194 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=dcb1b4f6863d9a1ad9e70dde674811b0cd2af24529188613655b2611c7827b17 I0405 15:05:56.633205 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 31.40951ms to process 10 records I0405 15:05:56.633322 1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=29abae732a8bdf8e3782b8ce4b450d2dbf6d78e3d5449fc83d1a2e6fd4a27aab I0405 15:05:56.633341 1 tasks_processing.go:74] worker 40 stopped. I0405 15:05:56.633401 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=cd3fb2380b4c1e9c3f9aafab65d32d139e2ee552faaea70a1845c80790b44229 I0405 15:05:56.633527 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=63db237fcaf7cb7fd7da6ff3bfc67b182f307777a60a7483e6a8a790196d6e5a I0405 15:05:56.633569 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=62e8c614d0a05a64296d848b6311bc5d781264e7ab558d255490077fb02f9dc5 I0405 15:05:56.633604 1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=b2649611da4c73ecbcf25f65d80935be1ecddbd0e5617230a8431a86914f997c I0405 15:05:56.633654 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=b9d18f7c5a2d4f2f8946dff11ad9145469e065f5cbb50999fb386227b5e5cf61 I0405 15:05:56.633695 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=90df2a93ed936d6decde54c0549f58f12c319fe2c2614f62906b5d624fb4c372 I0405 15:05:56.633735 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=2340ca69e465610ff084f97dcfd2eefc0e7bc723a20ae98f29a07d9a3b21e043 I0405 15:05:56.633769 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=3ef37e601767fbb6313230f6d489aa89292caf16f456aaa20843a703620aa179 I0405 15:05:56.633823 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=799c8b62031b388d4c6a0275d1b0a6a20872e328b6a391d235fc8f7496a2d622 I0405 15:05:56.633877 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=1ad8e2738dfeece464c0c747492d55b7bb566b6c10c15a2f854d58d1f6390add I0405 15:05:56.633904 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=897c2d9e5dd12d6d25a1f64cacac5bc4519cee1d5b68be9f7a40fe42f8fd32fe I0405 15:05:56.633931 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=c174683b39d13ba7f751dfafffcd26efc784920027dbf3e7a99cc77b00cf3175 I0405 15:05:56.633938 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 30.463378ms to process 13 records I0405 15:05:56.634030 1 tasks_processing.go:74] worker 57 stopped. I0405 15:05:56.634177 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=1dd10f42e27e1bbdd6dc7339048e1a5a83e3b3dd5e5a0e0ae9d168e72b459962 I0405 15:05:56.634192 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 30.997942ms to process 1 records I0405 15:05:56.634200 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 30.107967ms to process 0 records I0405 15:05:56.634222 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0405 15:05:56.634224 1 tasks_processing.go:74] worker 47 stopped. I0405 15:05:56.634234 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 33.601482ms to process 1 records I0405 15:05:56.634241 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 30.962357ms to process 0 records I0405 15:05:56.634251 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 31.658185ms to process 0 records I0405 15:05:56.634256 1 tasks_processing.go:74] worker 56 stopped. I0405 15:05:56.634256 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 31.873675ms to process 0 records I0405 15:05:56.634263 1 tasks_processing.go:74] worker 58 stopped. I0405 15:05:56.634265 1 tasks_processing.go:74] worker 59 stopped. I0405 15:05:56.634267 1 tasks_processing.go:74] worker 12 stopped. I0405 15:05:56.634355 1 tasks_processing.go:74] worker 53 stopped. I0405 15:05:56.634366 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 30.27502ms to process 0 records I0405 15:05:56.635306 1 tasks_processing.go:74] worker 44 stopped. I0405 15:05:56.635543 1 recorder.go:75] Recording config/featuregate with fingerprint=316cd4c430bf64b21824777d582251b2d8c66950a20892fc2f20867b6099cf9a I0405 15:05:56.635600 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 33.0472ms to process 1 records I0405 15:05:56.635635 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0405 15:05:56.635697 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0405 15:05:56.635725 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0405 15:05:56.635751 1 controller.go:212] Source scaController *sca.Controller is not ready I0405 15:05:56.635777 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0405 15:05:56.635867 1 controller.go:489] The operator is still being initialized I0405 15:05:56.635899 1 controller.go:512] The operator is healthy I0405 15:05:56.635752 1 tasks_processing.go:74] worker 13 stopped. I0405 15:05:56.636778 1 recorder.go:75] Recording config/node/ip-10-0-0-121.ec2.internal with fingerprint=f10935924c6caab7718ad6d24ae3fea2030b157b0b0d9d8331d64038393db547 I0405 15:05:56.637872 1 recorder.go:75] Recording config/node/ip-10-0-1-216.ec2.internal with fingerprint=58c456ca839f28b9c3511275d99552aee531ff929834969592fd2eb7e6db4502 I0405 15:05:56.637952 1 recorder.go:75] Recording config/node/ip-10-0-2-78.ec2.internal with fingerprint=1b8476f3da0d7e1a03cee9fd12db81f50737dbb41d335705e420260bfe0645a0 I0405 15:05:56.637965 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 35.038289ms to process 3 records I0405 15:05:56.638145 1 tasks_processing.go:74] worker 27 stopped. I0405 15:05:56.638168 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=fe9201fdcac024fee43b6899387979c4124b9eb7a12c3425b4bf060da83f740e I0405 15:05:56.638293 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=b1d4ab07e58010eaf178eb2ac02559e1c793ccebcc36d46ab687499e4b8c4837 I0405 15:05:56.638305 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 35.899314ms to process 2 records I0405 15:05:56.638431 1 tasks_processing.go:74] worker 32 stopped. I0405 15:05:56.638763 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=906b9cdf3adbdaa59e26f4277650fb6865f538706d14bdb14e47afc6e0216955 I0405 15:05:56.638781 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 33.808559ms to process 1 records W0405 15:05:56.639093 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0405 15:05:56.639876 1 tasks_processing.go:74] worker 20 stopped. I0405 15:05:56.639895 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 37.600108ms to process 0 records I0405 15:05:56.644967 1 tasks_processing.go:74] worker 62 stopped. I0405 15:05:56.645706 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=a823030c90eafe1cf09f8ee1c3b2d41ccaa23e8cecb51ba08ed5765a869393a7 I0405 15:05:56.646138 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=662437693ea823e57401514adc6d4f73dcc2c4210bc71e9f25180f829b3021f6 I0405 15:05:56.646204 1 gather.go:177] gatherer "clusterconfig" function "crds" took 41.747634ms to process 2 records I0405 15:05:56.646417 1 tasks_processing.go:74] worker 19 stopped. I0405 15:05:56.646731 1 recorder.go:75] Recording config/version with fingerprint=c507f234ee8a5f53cfaa3d93fd9853c0e5f55584e57268c35455c774bbd30c3f I0405 15:05:56.646756 1 recorder.go:75] Recording config/id with fingerprint=ce3735bef51404cd93ff960b44486f978f3e794cc75a977151c46643eac34dc1 I0405 15:05:56.646764 1 gather.go:177] gatherer "clusterconfig" function "version" took 43.693845ms to process 2 records I0405 15:05:56.646803 1 tasks_processing.go:74] worker 11 stopped. I0405 15:05:56.646932 1 recorder.go:75] Recording config/olm_operators with fingerprint=8f82c1ff8ab9526a6a83c3faad735e61eb111f8e10548375f0a66a8fbfac8613 I0405 15:05:56.646948 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 45.873309ms to process 1 records I0405 15:05:56.651776 1 tasks_processing.go:74] worker 10 stopped. I0405 15:05:56.651791 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 51.618952ms to process 0 records I0405 15:05:56.654295 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0405 15:05:56.656495 1 tasks_processing.go:74] worker 45 stopped. I0405 15:05:56.656525 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0405 15:05:56.656624 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 53.205295ms to process 1 records I0405 15:05:56.663636 1 tasks_processing.go:74] worker 23 stopped. I0405 15:05:56.664847 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-575cd97545-w2qcb with fingerprint=dcd44cb996435419b13e62eb8ec631209ef101cd2d4d5464ea8a78d746a98f2a I0405 15:05:56.664926 1 recorder.go:75] Recording config/running_containers with fingerprint=2968998a16a61c99bcedb5e15b927c40eb3c9f6e0347299a20366ca6438253d4 I0405 15:05:56.664936 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 62.857076ms to process 2 records I0405 15:05:56.666164 1 tasks_processing.go:74] worker 48 stopped. I0405 15:05:56.666178 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 63.110768ms to process 0 records I0405 15:05:56.666192 1 tasks_processing.go:74] worker 37 stopped. E0405 15:05:56.666202 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0405 15:05:56.666208 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0405 15:05:56.666211 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0405 15:05:56.666220 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0405 15:05:56.666244 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0405 15:05:56.666253 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0405 15:05:56.666269 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0405 15:05:56.666276 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0405 15:05:56.666319 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0405 15:05:56.666327 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0405 15:05:56.666332 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 64.006413ms to process 7 records I0405 15:05:56.668215 1 tasks_processing.go:74] worker 54 stopped. E0405 15:05:56.668230 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0405 15:05:56.668237 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pg2fk914niovfrjknfofsnhjcuj998d-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pg2fk914niovfrjknfofsnhjcuj998d-primary-cert-bundle-secret" not found I0405 15:05:56.668292 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=f256a6095f06eed0b101392a594b1188ec5f7b3aff36ee3cd10bdbf7b1b7557e I0405 15:05:56.668308 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 68.064447ms to process 1 records I0405 15:05:56.669859 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0405 15:05:56.670395 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0405 15:05:56.670406 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0405 15:05:56.673934 1 base_controller.go:82] Caches are synced for ConfigController I0405 15:05:56.673946 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0405 15:05:56.678527 1 configmapobserver.go:84] configmaps "insights-config" not found I0405 15:05:56.707015 1 base_controller.go:82] Caches are synced for LoggingSyncer I0405 15:05:56.707029 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0405 15:05:56.707056 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0405 15:05:56.757402 1 cluster_transfer.go:102] no available accepted cluster transfer I0405 15:05:56.757416 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0405 15:05:56.911360 1 sca.go:266] etc-pki-entitlement secret successfully created I0405 15:05:56.911374 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I0405 15:05:57.444259 1 gather_cluster_operator_pods_and_events.go:121] Found 33 pods with 78 containers I0405 15:05:57.444272 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 322638 bytes I0405 15:05:57.444328 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for init-config-reloader container alertmanager-main-0 pod in namespace openshift-monitoring (previous: false). W0405 15:05:57.637946 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0405 15:05:57.669677 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for alertmanager container alertmanager-main-0 pod in namespace openshift-monitoring (previous: false). I0405 15:05:57.849897 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for config-reloader container alertmanager-main-0 pod in namespace openshift-monitoring (previous: false). I0405 15:05:58.055968 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-web container alertmanager-main-0 pod in namespace openshift-monitoring (previous: false). I0405 15:05:58.249794 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container alertmanager-main-0 pod in namespace openshift-monitoring (previous: false). I0405 15:05:58.450849 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-metric container alertmanager-main-0 pod in namespace openshift-monitoring (previous: false). W0405 15:05:58.637048 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0405 15:05:58.649250 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prom-label-proxy container alertmanager-main-0 pod in namespace openshift-monitoring (previous: false). I0405 15:05:58.849309 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for init-config-reloader container alertmanager-main-1 pod in namespace openshift-monitoring (previous: false). I0405 15:05:59.065268 1 tasks_processing.go:74] worker 5 stopped. I0405 15:05:59.065384 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=3eb851e1147222863c3fd37e162613499aebe796f7e0fe29454f13d03064d566 I0405 15:05:59.065429 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I0405 15:05:59.065450 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=59fccadacf38589c6b40ea803f41a59ad1a8fe42fe73f5511835096c7e826cc3 I0405 15:05:59.065460 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0405 15:05:59.065482 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=67b9f1d50274ea10e8f302432df15270c615c1b8ddf6233cb6886a84f33ecbb1 I0405 15:05:59.065498 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0405 15:05:59.065519 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=51f028538be68069c70c4f8ceeab60bac800dfa77026f64b211d9b923dac29ae I0405 15:05:59.065547 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=a0b535a8a5449ce0798cbd087a6e9f53fd750429ce5b3bbd932ded79beb41295 I0405 15:05:59.065570 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=40d1122f08dd3f58d8773f0daa4571d482dc6de783b686d1c6d48056bf31a14d I0405 15:05:59.065600 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=caae423dff4702b55e4dddee957b1767df7d0736cfaf7c014ce6899cc88ffe57 I0405 15:05:59.065860 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=91f716b9dba9f88a5080f9d818d42f8db8c6f4348a649927de53df14bc7d3cf1 I0405 15:05:59.065879 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=9e113b33d92371f90d85510ca049f33509661875a0695b6cc1dbde6cafa7ca13 I0405 15:05:59.065888 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0405 15:05:59.065905 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=cfadd39103ff92521bc483071113270181d2c83760f614d2af5be42be37a14c7 I0405 15:05:59.065916 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0405 15:05:59.065932 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=de13db46b70408355e99cfe5c205063bbd104314847708737aa0149ee5b63a03 I0405 15:05:59.065942 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0405 15:05:59.065961 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=1659299006bd93f376f1bd55db456d7188d47a7e8c1754d93483d6f397ac0cf0 I0405 15:05:59.065970 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0405 15:05:59.065989 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=c950c26f03b6bdb23f93532daec24f13effdcacb753cf0a61418742ba9d0862c I0405 15:05:59.066096 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=c08cd45a9c3caf48cddc43b383758949918989068cfce2d0ae4f10447759c238 I0405 15:05:59.066106 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0405 15:05:59.066112 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0405 15:05:59.066159 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0405 15:05:59.066194 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=2a6df467eaf95186b97e6fa10073d07419cdf32a18bed3916868384e4b9c903e I0405 15:05:59.066223 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=48d4e811b60291063112e501d3b94823732c818005aabc8a4482b977416d19d2 I0405 15:05:59.066233 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0405 15:05:59.066250 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=cccc6fd21132836a4cec84e7d457a6c43c9e33f79fc97ed826264bb9afecfcda I0405 15:05:59.066261 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0405 15:05:59.066278 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=ed09fc0e4bd3ca9464f7d3af829fdeeb15843ea154a8659e832923f3800edecc I0405 15:05:59.066289 1 recorder.go:75] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0405 15:05:59.066301 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=46921d0653ef66e8abfe18b646a5bb35235a9942052b9764d87dae055a3d4d90 I0405 15:05:59.066316 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=f5a60d036fa4c9ad7325f1655ccc3c680d6848a11b42b5f7b944911e3842e7aa I0405 15:05:59.066332 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=14d43815a5e4cab21977594d2aae447e6b1f6e32379f3a7c8f851198f12fed26 I0405 15:05:59.066355 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=a08e304fe70db1b5f9a2b563c4b38010b97be4aba028d842401aef71440f8aed I0405 15:05:59.066366 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0405 15:05:59.066389 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=50322aaf208316b8c0423e55ba1e286f980578d20fd8bebd89d5e5997f161bf0 I0405 15:05:59.066405 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0405 15:05:59.066414 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0405 15:05:59.066421 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.462185653s to process 39 records I0405 15:05:59.075096 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for alertmanager container alertmanager-main-1 pod in namespace openshift-monitoring (previous: false). I0405 15:05:59.250546 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for config-reloader container alertmanager-main-1 pod in namespace openshift-monitoring (previous: false). I0405 15:05:59.452064 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-web container alertmanager-main-1 pod in namespace openshift-monitoring (previous: false). W0405 15:05:59.637434 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0405 15:05:59.650880 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container alertmanager-main-1 pod in namespace openshift-monitoring (previous: false). I0405 15:05:59.850029 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-metric container alertmanager-main-1 pod in namespace openshift-monitoring (previous: false). I0405 15:06:00.050093 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prom-label-proxy container alertmanager-main-1 pod in namespace openshift-monitoring (previous: false). I0405 15:06:00.251653 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for cluster-monitoring-operator container cluster-monitoring-operator-698978dbbf-k8n42 pod in namespace openshift-monitoring (previous: false). I0405 15:06:00.453387 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-state-metrics container kube-state-metrics-7c87d874d5-2lbdh pod in namespace openshift-monitoring (previous: false). W0405 15:06:00.637793 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0405 15:06:00.653098 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-main container kube-state-metrics-7c87d874d5-2lbdh pod in namespace openshift-monitoring (previous: false). I0405 15:06:00.849298 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-self container kube-state-metrics-7c87d874d5-2lbdh pod in namespace openshift-monitoring (previous: false). I0405 15:06:01.050292 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for metrics-server container metrics-server-799f88bbb4-bn8w7 pod in namespace openshift-monitoring (previous: false). I0405 15:06:01.251724 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for metrics-server container metrics-server-799f88bbb4-xn8jz pod in namespace openshift-monitoring (previous: false). I0405 15:06:01.454095 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for monitoring-plugin container monitoring-plugin-67788f859f-mwxv4 pod in namespace openshift-monitoring (previous: false). W0405 15:06:01.637229 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0405 15:06:01.637251 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0405 15:06:01.637267 1 tasks_processing.go:74] worker 28 stopped. E0405 15:06:01.637277 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0405 15:06:01.637289 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0405 15:06:01.637298 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.03584714s to process 1 records I0405 15:06:01.657439 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for monitoring-plugin container monitoring-plugin-67788f859f-zxmm9 pod in namespace openshift-monitoring (previous: false). I0405 15:06:01.855762 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for init-textfile container node-exporter-brnh7 pod in namespace openshift-monitoring (previous: false). I0405 15:06:02.089994 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0405 15:06:02.090011 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-exporter container node-exporter-brnh7 pod in namespace openshift-monitoring (previous: false). I0405 15:06:02.252429 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container node-exporter-brnh7 pod in namespace openshift-monitoring (previous: false). I0405 15:06:02.450642 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for init-textfile container node-exporter-lj8zk pod in namespace openshift-monitoring (previous: false). I0405 15:06:02.650746 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0405 15:06:02.650762 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-exporter container node-exporter-lj8zk pod in namespace openshift-monitoring (previous: false). I0405 15:06:02.854745 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container node-exporter-lj8zk pod in namespace openshift-monitoring (previous: false). I0405 15:06:03.051112 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for init-textfile container node-exporter-tjsn8 pod in namespace openshift-monitoring (previous: false). I0405 15:06:03.250301 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0405 15:06:03.250317 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-exporter container node-exporter-tjsn8 pod in namespace openshift-monitoring (previous: false). I0405 15:06:03.450679 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container node-exporter-tjsn8 pod in namespace openshift-monitoring (previous: false). I0405 15:06:03.650143 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-main container openshift-state-metrics-6cb79d4dbd-b8b2p pod in namespace openshift-monitoring (previous: false). I0405 15:06:03.850384 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-self container openshift-state-metrics-6cb79d4dbd-b8b2p pod in namespace openshift-monitoring (previous: false). I0405 15:06:04.052540 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for openshift-state-metrics container openshift-state-metrics-6cb79d4dbd-b8b2p pod in namespace openshift-monitoring (previous: false). I0405 15:06:04.249392 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for init-config-reloader container prometheus-k8s-0 pod in namespace openshift-monitoring (previous: false). I0405 15:06:04.452742 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prometheus container prometheus-k8s-0 pod in namespace openshift-monitoring (previous: false). I0405 15:06:04.653996 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for config-reloader container prometheus-k8s-0 pod in namespace openshift-monitoring (previous: false). I0405 15:06:04.849602 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for thanos-sidecar container prometheus-k8s-0 pod in namespace openshift-monitoring (previous: false). I0405 15:06:05.050293 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-web container prometheus-k8s-0 pod in namespace openshift-monitoring (previous: false). I0405 15:06:05.249875 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container prometheus-k8s-0 pod in namespace openshift-monitoring (previous: false). I0405 15:06:05.449287 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-thanos container prometheus-k8s-0 pod in namespace openshift-monitoring (previous: false). I0405 15:06:05.649747 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for init-config-reloader container prometheus-k8s-1 pod in namespace openshift-monitoring (previous: false). I0405 15:06:05.851255 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prometheus container prometheus-k8s-1 pod in namespace openshift-monitoring (previous: false). I0405 15:06:06.053380 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for config-reloader container prometheus-k8s-1 pod in namespace openshift-monitoring (previous: false). I0405 15:06:06.250372 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for thanos-sidecar container prometheus-k8s-1 pod in namespace openshift-monitoring (previous: false). I0405 15:06:06.460976 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-web container prometheus-k8s-1 pod in namespace openshift-monitoring (previous: false). I0405 15:06:06.655882 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container prometheus-k8s-1 pod in namespace openshift-monitoring (previous: false). I0405 15:06:06.851602 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-thanos container prometheus-k8s-1 pod in namespace openshift-monitoring (previous: false). I0405 15:06:07.051968 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prometheus-operator container prometheus-operator-5df5b8bf6d-dbzgz pod in namespace openshift-monitoring (previous: false). I0405 15:06:07.252297 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container prometheus-operator-5df5b8bf6d-dbzgz pod in namespace openshift-monitoring (previous: false). I0405 15:06:07.449438 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prometheus-operator-admission-webhook container prometheus-operator-admission-webhook-68c48fd977-bwm7x pod in namespace openshift-monitoring (previous: false). I0405 15:06:07.650440 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prometheus-operator-admission-webhook container prometheus-operator-admission-webhook-68c48fd977-hbff2 pod in namespace openshift-monitoring (previous: false). I0405 15:06:07.850894 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for thanos-query container thanos-querier-6df47f6784-94msb pod in namespace openshift-monitoring (previous: false). I0405 15:06:08.049821 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-web container thanos-querier-6df47f6784-94msb pod in namespace openshift-monitoring (previous: false). I0405 15:06:08.251874 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container thanos-querier-6df47f6784-94msb pod in namespace openshift-monitoring (previous: false). I0405 15:06:08.453549 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prom-label-proxy container thanos-querier-6df47f6784-94msb pod in namespace openshift-monitoring (previous: false). I0405 15:06:08.650810 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-rules container thanos-querier-6df47f6784-94msb pod in namespace openshift-monitoring (previous: false). I0405 15:06:08.849916 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-metrics container thanos-querier-6df47f6784-94msb pod in namespace openshift-monitoring (previous: false). I0405 15:06:09.051979 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for thanos-query container thanos-querier-6df47f6784-tg22l pod in namespace openshift-monitoring (previous: false). I0405 15:06:09.251333 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-web container thanos-querier-6df47f6784-tg22l pod in namespace openshift-monitoring (previous: false). I0405 15:06:09.445766 1 tasks_processing.go:74] worker 61 stopped. I0405 15:06:09.445806 1 recorder.go:75] Recording config/installplans with fingerprint=f17dbfacc3bfddf27ca3b213b39495434cd4c4e9e3dbd69566ffb3845bbcf539 I0405 15:06:09.445817 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.8441604s to process 1 records I0405 15:06:09.450466 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container thanos-querier-6df47f6784-tg22l pod in namespace openshift-monitoring (previous: false). I0405 15:06:09.650670 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prom-label-proxy container thanos-querier-6df47f6784-tg22l pod in namespace openshift-monitoring (previous: false). I0405 15:06:09.852470 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-rules container thanos-querier-6df47f6784-tg22l pod in namespace openshift-monitoring (previous: false). I0405 15:06:10.051658 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-metrics container thanos-querier-6df47f6784-tg22l pod in namespace openshift-monitoring (previous: false). I0405 15:06:10.209855 1 tasks_processing.go:74] worker 14 stopped. I0405 15:06:10.210146 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=04b1dfc65b82e4ffa7a0e08c48682e6aa2f3ebd208f3909e4e17b361a7606d8c I0405 15:06:10.210164 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.608451152s to process 1 records I0405 15:06:10.254607 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for networking-console-plugin container networking-console-plugin-6ddbfdf749-gdhtv pod in namespace openshift-network-console (previous: false). I0405 15:06:10.451366 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for networking-console-plugin container networking-console-plugin-6ddbfdf749-skqm2 pod in namespace openshift-network-console (previous: false). I0405 15:06:10.650606 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console-operator container console-operator-575cd97545-w2qcb pod in namespace openshift-console-operator (previous: true). I0405 15:06:10.852565 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console-operator container console-operator-575cd97545-w2qcb pod in namespace openshift-console-operator (previous: false). I0405 15:06:11.053092 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-59b9d85cdd-chj6c pod in namespace openshift-console (previous: false). I0405 15:06:11.251201 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-6d555b8dcf-z64vd pod in namespace openshift-console (previous: false). I0405 15:06:11.449775 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-6d555b8dcf-zd8bn pod in namespace openshift-console (previous: false). I0405 15:06:11.664945 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-7cd59d44c7-wjqld pod in namespace openshift-console (previous: false). I0405 15:06:11.843218 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for console-7cd59d44c7-wjqld pod in namespace openshift-console for failing operator console (previous: false): "pods \"console-7cd59d44c7-wjqld\" not found" I0405 15:06:11.843234 1 gather_cluster_operator_pods_and_events.go:280] Error: "pods \"console-7cd59d44c7-wjqld\" not found" I0405 15:06:11.843244 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for download-server container downloads-56cb7c9577-m2dmm pod in namespace openshift-console (previous: false). I0405 15:06:12.050638 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for download-server container downloads-56cb7c9577-mszth pod in namespace openshift-console (previous: false). I0405 15:06:12.251204 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-596cbdf8f5-vg5j2 pod in namespace openshift-ingress (previous: false). I0405 15:06:12.451770 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7f88857fbd-7sls6 pod in namespace openshift-ingress (previous: false). I0405 15:06:12.653914 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7f88857fbd-dh6bv pod in namespace openshift-ingress (previous: false). I0405 15:06:12.850083 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-47lbg pod in namespace openshift-ingress-canary (previous: false). I0405 15:06:13.050768 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-sg44f pod in namespace openshift-ingress-canary (previous: false). I0405 15:06:13.250331 1 tasks_processing.go:74] worker 49 stopped. I0405 15:06:13.251140 1 recorder.go:75] Recording events/openshift-monitoring with fingerprint=6a387c039799fbe98fee7bfbd6eb021c2c01a5553a5522a5c6e255a8625706e4 I0405 15:06:13.251192 1 recorder.go:75] Recording events/openshift-network-console with fingerprint=8bb8d2eebe26fc84d8d5cae4b7351a215b169bdb06f1fb1ab5063af28e8a5361 I0405 15:06:13.251311 1 recorder.go:75] Recording events/openshift-console-operator with fingerprint=6dacf8b9b37265b55821896f5a295c803a19bd1e23686dfeaadb2f7893b7538a I0405 15:06:13.251408 1 recorder.go:75] Recording events/openshift-console with fingerprint=adb4393ec1120701eb08c3a27770e1b847d7b96c67a557f4294b731c925a324c I0405 15:06:13.251435 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=2eedb88e33bcf53bf3fdb9d947f8dc1c8095dba64410997d3a73c30909adade1 I0405 15:06:13.251511 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=bbaeec71259d91438c7f31d74c590a0806ded20b9601dde48f0d2ed1e3843f00 I0405 15:06:13.251546 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=4456889ad613c4e46f3aad7896934b9de4d20ea89dd1dfc3882d28835828478d I0405 15:06:13.251557 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-0/init-config-reloader_current.log with fingerprint=067d400c40f03837b66b257dfe3e74cabd062ce79e7696bdad39461b1fb98daa I0405 15:06:13.251568 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-0/alertmanager_current.log with fingerprint=db0649eae1069d638245758d721f16ccb9a40a9b153f498245a71de158b83687 I0405 15:06:13.251613 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-0/config-reloader_current.log with fingerprint=63b2615945f63e8a77a86ed7db6a9b55c037f70a0dfb3f1d79b7181b3da1593c I0405 15:06:13.251622 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-0/kube-rbac-proxy-web_current.log with fingerprint=e9555a3102819481e58aa2a97547c9b080638f63d0cf9b82f5684c5bfb917937 I0405 15:06:13.251628 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-0/kube-rbac-proxy_current.log with fingerprint=8fa85c7f75b49c913d20c3ea41e224a8606294573798542d3929334929bb0232 I0405 15:06:13.251634 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-0/kube-rbac-proxy-metric_current.log with fingerprint=521d2adc682ca076d287fa8a89a129598a11decf03c3749c0e382691ae003691 I0405 15:06:13.251639 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-0/prom-label-proxy_current.log with fingerprint=721d443ccf8be56664b25a7d35cca443a08df97fb6e97f60f3a4411eea4e2008 I0405 15:06:13.251645 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-1/init-config-reloader_current.log with fingerprint=3d31dc2f3112a29e72739940dbef591e6648e0113d04481eb8af564f93cc4bcb I0405 15:06:13.251656 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-1/alertmanager_current.log with fingerprint=f2f45fd17fb6744c3cef0869aa87097cb8f3956edb180699a4a2e279e6289b60 I0405 15:06:13.251669 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-1/config-reloader_current.log with fingerprint=356719c2905dd162d9c6c55aa578c3966f894dc34392c250f5ad8fcfb2cede9e I0405 15:06:13.251677 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-1/kube-rbac-proxy-web_current.log with fingerprint=aadee468265f63c4a4b8f673b43dbb7da9d161c89171574c18ee881f4c407e62 I0405 15:06:13.251685 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-1/kube-rbac-proxy_current.log with fingerprint=2f84eaeb32d5c866931d7f31bb458e75a47dd3303f63d9ec8e916ad091630ebc I0405 15:06:13.251692 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-1/kube-rbac-proxy-metric_current.log with fingerprint=fd222620c5071e190205c95d1047af1cf0afb5aef1b26758d3b8296d4a4a383a I0405 15:06:13.251696 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-1/prom-label-proxy_current.log with fingerprint=21e6d3627b1abff9be63fcd170927c86675f56b5374021a720f6b13401edd4bf I0405 15:06:13.251822 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/cluster-monitoring-operator-698978dbbf-k8n42/cluster-monitoring-operator_current.log with fingerprint=883a5f3f84676656155d8f2aea7930815e4f90452651921e0a6dd7351ee64747 I0405 15:06:13.251849 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/kube-state-metrics-7c87d874d5-2lbdh/kube-state-metrics_current.log with fingerprint=99ddfda19e79f0743957e371363ec6349dc3653ec4e4d4a523e83744dc5b8132 I0405 15:06:13.251861 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/kube-state-metrics-7c87d874d5-2lbdh/kube-rbac-proxy-main_current.log with fingerprint=f7c88a74f63fa2b600405cfd4b8d805df829997f2a89053dbb74771f1c7ae16d I0405 15:06:13.251867 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/kube-state-metrics-7c87d874d5-2lbdh/kube-rbac-proxy-self_current.log with fingerprint=ad1be181aafa18f459a4eabc351ac3f4220f1c1735a62aaa2faf1920f521e5a8 I0405 15:06:13.251875 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/metrics-server-799f88bbb4-bn8w7/metrics-server_current.log with fingerprint=c04ee5300a6c66146f60bfcf9dd14389c5ce08b0f31ffc0dbe07b7bb1ee41617 I0405 15:06:13.251882 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/metrics-server-799f88bbb4-xn8jz/metrics-server_current.log with fingerprint=95e0ae41481a23464b17ca14167ef31e6837aa1264c243ce7ff8d10e38a5d993 I0405 15:06:13.251892 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/monitoring-plugin-67788f859f-mwxv4/monitoring-plugin_current.log with fingerprint=ec75babc54d487da0c69e5efae7f9200d6efc154a9ccae9a9524f84dd46b3064 I0405 15:06:13.251903 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/monitoring-plugin-67788f859f-zxmm9/monitoring-plugin_current.log with fingerprint=64a79a7d6fffb1a305e9dd0eae8490b3cafbd8b449721b9b7412b8e6f8ca037f I0405 15:06:13.251937 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/node-exporter-brnh7/node-exporter_current.log with fingerprint=ddc5fa706abce02f92c0c55e7243c7418a4cc1246641257aab9cba999a6d9207 I0405 15:06:13.251947 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/node-exporter-brnh7/kube-rbac-proxy_current.log with fingerprint=b0a6b024ce0db162249ebf483075086ab87cde74cdcdd7bdf7eb154d9b83a996 I0405 15:06:13.251974 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/node-exporter-lj8zk/node-exporter_current.log with fingerprint=2823145d0fcfa2c4c048f512dd19c3ec973d4dca727271ace1ba2b5f8892d1ec I0405 15:06:13.251983 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/node-exporter-lj8zk/kube-rbac-proxy_current.log with fingerprint=7d24b63602a99eedf5be9f86c9f2bf4d3a031069838ab1cc0d213cc5fdd1cbee I0405 15:06:13.252041 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/node-exporter-tjsn8/node-exporter_current.log with fingerprint=4398da040f834b65748f54b295b67dfab259b8eb29085b3f91ed954862a092d8 I0405 15:06:13.252051 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/node-exporter-tjsn8/kube-rbac-proxy_current.log with fingerprint=2b7c69f16fa10a12717629fa370a61f0cfda2b572f2a6f31633e717b04ca9a7d I0405 15:06:13.252057 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/openshift-state-metrics-6cb79d4dbd-b8b2p/kube-rbac-proxy-main_current.log with fingerprint=9710877a75e9422890ba9b245cc69c3cd53eba9393a379b2fbad69fc8aafb1e4 I0405 15:06:13.252067 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/openshift-state-metrics-6cb79d4dbd-b8b2p/kube-rbac-proxy-self_current.log with fingerprint=a22946012036845441cf62fe30c590c24128127f43807277ca063a65646955c6 I0405 15:06:13.252082 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/openshift-state-metrics-6cb79d4dbd-b8b2p/openshift-state-metrics_current.log with fingerprint=3b2fa77c17ead1fd37f25ad77b526d677892fe6fae0bc886cee89b67629f64a1 I0405 15:06:13.252091 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-0/init-config-reloader_current.log with fingerprint=4d167f4f3580277f1761b0a73332a608877c2d9bbb86c6b2e009c6ace318113c I0405 15:06:13.252198 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-0/prometheus_current.log with fingerprint=592ecd6d488ea95ef12050482053b450fea229334ae4f95ca31cca1aa2859563 I0405 15:06:13.252218 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-0/config-reloader_current.log with fingerprint=87d50db3760f689e2059beb4e949373d31c16f6d44a52453cf3ab6f9bf83b1f7 I0405 15:06:13.252230 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-0/thanos-sidecar_current.log with fingerprint=05b85cf5f0d0385a468dd7f9f33aada687da35e77f31a87f8c309d2657b110e9 I0405 15:06:13.252239 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-0/kube-rbac-proxy-web_current.log with fingerprint=187c612691a1326c91aa7179bbd1c707a61c37959c12ab488dc0b6879c13f749 I0405 15:06:13.252245 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-0/kube-rbac-proxy_current.log with fingerprint=7f1273f177d4459f840c83be7ff9fe16b5a9c8e40bd205cf400d3e2fb21459f5 I0405 15:06:13.252252 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-0/kube-rbac-proxy-thanos_current.log with fingerprint=62d0456196b6a01f92e968efbcbd0ad7b463ef192c7c909bc96e185f005154b1 I0405 15:06:13.252258 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-1/init-config-reloader_current.log with fingerprint=87b9830019176815aeb9de828c58e6a41beaccf2bb62f10af7cbdcc1625874a4 I0405 15:06:13.252359 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-1/prometheus_current.log with fingerprint=6ba3a76a861b29d7ed097601d45cf011add48d6df76e45b50cf72e1339f7a8d3 I0405 15:06:13.252376 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-1/config-reloader_current.log with fingerprint=4a8d6df62540c8acf286ac4a435fe586c8b06accdd8b4cba5e7bf8f9e55c31b2 I0405 15:06:13.252389 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-1/thanos-sidecar_current.log with fingerprint=9ee000c24bd7bbbfd918eef777c1b7ba4e96d569f46d3d66919179b5204587e1 I0405 15:06:13.252395 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-1/kube-rbac-proxy-web_current.log with fingerprint=b8081a46d463a165f2baca0e2921b6e089d1717c9bafd2607c55cb1397ddabc6 I0405 15:06:13.252400 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-1/kube-rbac-proxy_current.log with fingerprint=b3b358b6d99cfdcc23bb1670cbc0eac37a8e63c535e4cda797811079863442ec I0405 15:06:13.252407 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-1/kube-rbac-proxy-thanos_current.log with fingerprint=94a6ec37736d76481de6b4c01b2b1aaf164f76a1ba70af4e90aded51740b20cd I0405 15:06:13.252492 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-operator-5df5b8bf6d-dbzgz/prometheus-operator_current.log with fingerprint=70c67c9f54dc0a146b181f33d6a9aeddc0f8dea57b57838f7cee271eb7beb7c6 I0405 15:06:13.252501 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-operator-5df5b8bf6d-dbzgz/kube-rbac-proxy_current.log with fingerprint=03668a75164d111b47d3605cf673aba4479def7e61810afe272804427a376cc9 I0405 15:06:13.252508 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-operator-admission-webhook-68c48fd977-bwm7x/prometheus-operator-admission-webhook_current.log with fingerprint=7a78305ef3c9d8ecb3078aac174b093b9429548103a9559b91d44c67d258b7bb I0405 15:06:13.252520 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-operator-admission-webhook-68c48fd977-hbff2/prometheus-operator-admission-webhook_current.log with fingerprint=aad6ca0f614eed37063fff35638f4cba29e5f0a79c155dd8e3c211f390772dab I0405 15:06:13.252533 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-6df47f6784-94msb/thanos-query_current.log with fingerprint=c3f9f2a07f26eefea9bc6fdc426d5139cfcd052840d321b7eba400a7bcdf29da I0405 15:06:13.252544 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-6df47f6784-94msb/kube-rbac-proxy-web_current.log with fingerprint=1fdef90d514a38b5fcd8838910db7c688ac7bcbabed43a7788a55e6ef4fd61fd I0405 15:06:13.252550 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-6df47f6784-94msb/kube-rbac-proxy_current.log with fingerprint=9410b89661f33b1d66c9432ac8dc9b70ec23cea7373471cb14b00c4b67084228 I0405 15:06:13.252554 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-6df47f6784-94msb/prom-label-proxy_current.log with fingerprint=481539e0280311e9a37cd6dcc8b16224405e8884009ee2ee19557163cc29606d I0405 15:06:13.252560 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-6df47f6784-94msb/kube-rbac-proxy-rules_current.log with fingerprint=df732ecdc0ff387b31750a85307e4891e3870941569cac0a4cd9f3bc25bd9cfd I0405 15:06:13.252568 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-6df47f6784-94msb/kube-rbac-proxy-metrics_current.log with fingerprint=15923eba00ffe1afdea4e80f1f0e4f4c0311d6c82ccc741b4a658089d3e2c08e I0405 15:06:13.252578 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-6df47f6784-tg22l/thanos-query_current.log with fingerprint=227faf5ea26928a373df2c0399c159cfe1b78dcadc90370f8653e78da0c70140 I0405 15:06:13.252589 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-6df47f6784-tg22l/kube-rbac-proxy-web_current.log with fingerprint=84c3550ac3392713b38bb9d5b62f2857c01261385038fd8b554228502aab7822 I0405 15:06:13.252598 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-6df47f6784-tg22l/kube-rbac-proxy_current.log with fingerprint=cabeb7df87fafe70d44f749375256d9f0df3b429b683a58b138afa6a4db82ef2 I0405 15:06:13.252605 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-6df47f6784-tg22l/prom-label-proxy_current.log with fingerprint=1bc93280a24756168740443a98d002f625ab38e315b850840ef00b094898e3b9 I0405 15:06:13.252612 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-6df47f6784-tg22l/kube-rbac-proxy-rules_current.log with fingerprint=2891e62ef324d58f6171c78aedf29818eff9e0feeece4bac489e05024b4837bf I0405 15:06:13.252619 1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-6df47f6784-tg22l/kube-rbac-proxy-metrics_current.log with fingerprint=77acf3b5b5ff6e12b155cd420b349e84367c54444c7242755141b78f4ef9bb1c I0405 15:06:13.252626 1 recorder.go:75] Recording config/pod/openshift-network-console/logs/networking-console-plugin-6ddbfdf749-gdhtv/networking-console-plugin_current.log with fingerprint=d0a98ec510992a22836bdefa6ae4f5c00938730cb4c3a8c99472a3a0dbcf380c I0405 15:06:13.252632 1 recorder.go:75] Recording config/pod/openshift-network-console/logs/networking-console-plugin-6ddbfdf749-skqm2/networking-console-plugin_current.log with fingerprint=b2e436fe0e6243de77ef368be91c479af7546965e5e87d1d4aa04f02b26118c4 I0405 15:06:13.252782 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-575cd97545-w2qcb with fingerprint=dcd44cb996435419b13e62eb8ec631209ef101cd2d4d5464ea8a78d746a98f2a E0405 15:06:13.252800 1 gather.go:161] error recording gatherer "clusterconfig" function "operators_pods_and_events" result "config/pod/openshift-console-operator/console-operator-575cd97545-w2qcb.json" because of the error: the record with the same name "config/pod/openshift-console-operator/console-operator-575cd97545-w2qcb.json" was already recorded and had the fingerprint "dcd44cb996435419b13e62eb8ec631209ef101cd2d4d5464ea8a78d746a98f2a", overwriting with the record having fingerprint "dcd44cb996435419b13e62eb8ec631209ef101cd2d4d5464ea8a78d746a98f2a" W0405 15:06:13.252813 1 gather.go:155] issue recording gatherer "clusterconfig" function "operators_pods_and_events" result "config/pod/openshift-console-operator/console-operator-575cd97545-w2qcb.json" because of the warning: warning: the record with the same fingerprint "dcd44cb996435419b13e62eb8ec631209ef101cd2d4d5464ea8a78d746a98f2a" was already recorded at path "config/pod/openshift-console-operator/console-operator-575cd97545-w2qcb.json", recording another one with a different path "config/pod/openshift-console-operator/console-operator-575cd97545-w2qcb.json" I0405 15:06:13.252828 1 recorder.go:75] Recording config/pod/openshift-console-operator/logs/console-operator-575cd97545-w2qcb/console-operator_previous.log with fingerprint=b403f5638c299c692a26e90be2dc50920bd214bae8a92d33e3561d5b192abc02 I0405 15:06:13.252986 1 recorder.go:75] Recording config/pod/openshift-console-operator/logs/console-operator-575cd97545-w2qcb/console-operator_current.log with fingerprint=d728db2338432fd61be659b9f0e104ce6ca8350740f88667b0dc0a965cd14df6 I0405 15:06:13.253002 1 recorder.go:75] Recording config/pod/openshift-console/logs/console-59b9d85cdd-chj6c/console_current.log with fingerprint=8d19d6c363638a7cd6bac072fb9f57ab92c98e0d54a99ab0d47823d05b79fee8 I0405 15:06:13.253015 1 recorder.go:75] Recording config/pod/openshift-console/logs/console-6d555b8dcf-z64vd/console_current.log with fingerprint=70bf35c4e3009f2108d50ee8dcdf1204d9d16e5071bbb5e5474292cffe2548e8 I0405 15:06:13.253039 1 recorder.go:75] Recording config/pod/openshift-console/logs/console-6d555b8dcf-zd8bn/console_current.log with fingerprint=a3ce231e3377ad9bff93e3727ecd9d01c9ec6ed7353f109a45171fb5ff02a343 I0405 15:06:13.253048 1 recorder.go:75] Recording config/pod/openshift-console/logs/downloads-56cb7c9577-m2dmm/download-server_current.log with fingerprint=9711e12792feaa0a2816307e80dc779cbc486e4efb6b5f91ad7681e3952072c7 I0405 15:06:13.253055 1 recorder.go:75] Recording config/pod/openshift-console/logs/downloads-56cb7c9577-mszth/download-server_current.log with fingerprint=cddbd6f99293c460f3444ee3c8e8028fd5b688210dc27a4db83c1d318b488033 I0405 15:06:13.253084 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-596cbdf8f5-vg5j2/router_current.log with fingerprint=8ce303e22f9ccd02b98d191a1ac2db4ee92170bfb1b56ed6fabb1bb4b49c323d I0405 15:06:13.253149 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-7f88857fbd-7sls6/router_current.log with fingerprint=05e1ca547b64dc1bc45337d424ae098d8e498bfebe51099deac0f9d1bda31147 I0405 15:06:13.253194 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-7f88857fbd-dh6bv/router_current.log with fingerprint=1b4d4067b7103e57e44e7be3dabb1e987464df177b8233f076f966485f92c5a1 I0405 15:06:13.253202 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-47lbg/serve-healthcheck-canary_current.log with fingerprint=ad4c572a1f99a3d03ae915e512f296e7fc185637b09fe4f5239b9779f2003b0d I0405 15:06:13.253208 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-sg44f/serve-healthcheck-canary_current.log with fingerprint=99cfa83f78978edb88eeb89d297936e958e6eb4dc37a986b755a973c14023d46 I0405 15:06:13.253216 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 16.650206649s to process 83 records E0405 15:06:13.253279 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 16.653s with: function \"machine_healthchecks\" failed with an error, function \"tsdb_status\" failed with an error, function \"metrics\" failed with an error, function \"silenced_alerts\" failed with an error, function \"active_alerts\" failed with an error, function \"support_secret\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error, unable to record function \"operators_pods_and_events\" record \"config/pod/openshift-console-operator/console-operator-575cd97545-w2qcb.json\"" I0405 15:06:13.254385 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "tsdb_status" failed with an error, function "metrics" failed with an error, function "silenced_alerts" failed with an error, function "active_alerts" failed with an error, function "support_secret" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error, unable to record function "operators_pods_and_events" record "config/pod/openshift-console-operator/console-operator-575cd97545-w2qcb.json" I0405 15:06:13.254400 1 periodic.go:209] Running workloads gatherer I0405 15:06:13.254414 1 tasks_processing.go:45] number of workers: 2 I0405 15:06:13.254420 1 tasks_processing.go:69] worker 1 listening for tasks. I0405 15:06:13.254424 1 tasks_processing.go:71] worker 1 working on workload_info task. I0405 15:06:13.254430 1 tasks_processing.go:69] worker 0 listening for tasks. I0405 15:06:13.254446 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0405 15:06:13.261260 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-78.ec2.internal... I0405 15:06:13.261270 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-121.ec2.internal... I0405 15:06:13.261285 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-216.ec2.internal... I0405 15:06:13.283842 1 tasks_processing.go:74] worker 0 stopped. I0405 15:06:13.283857 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 29.388918ms to process 0 records I0405 15:06:18.687780 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 5s I0405 15:06:18.714133 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 25s for image data I0405 15:06:18.722219 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (9ms) I0405 15:06:18.730720 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (8ms) I0405 15:06:18.745985 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (15ms) I0405 15:06:18.754075 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (8ms) I0405 15:06:18.761606 1 gather_workloads_info.go:387] No image sha256:25bda9d34e23ba6bc9df5cf7104bdb237269740a3a76ee025f88b34e68b7e2b5 (8ms) I0405 15:06:18.769198 1 gather_workloads_info.go:387] No image sha256:b99613494e9d6a4a8207323872d63cc02b830fc80a8bf972e62c64381aa4cd17 (8ms) I0405 15:06:18.776504 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (7ms) I0405 15:06:18.784163 1 gather_workloads_info.go:387] No image sha256:76cc47f3775560477ec548c7b6fddbd99112ad6604f790697eef546576051fb7 (8ms) I0405 15:06:18.792248 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (8ms) I0405 15:06:18.800759 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (8ms) I0405 15:06:18.822878 1 gather_workloads_info.go:387] No image sha256:513b1166e376feca472fdd5174f6abf0abf02925d6a21b7b4d89a2ff2fc67bed (22ms) I0405 15:06:18.922676 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (100ms) I0405 15:06:19.023663 1 gather_workloads_info.go:387] No image sha256:101993f6e65d6fda8b90c583b718b720809182961f69bc777295f47e6df4d7ce (101ms) I0405 15:06:19.122682 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (99ms) I0405 15:06:19.223341 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (101ms) I0405 15:06:19.323053 1 gather_workloads_info.go:387] No image sha256:50197f22710766515f67944a779e00dd9ae3d17b18732d7324a970353b11f292 (100ms) I0405 15:06:19.423164 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (100ms) I0405 15:06:19.522509 1 gather_workloads_info.go:398] Found image sha256:32d4561d4bf1b3c4e3a7878f918f9c1422bab85bdf8711fbdf905d59692fee81 (99ms) I0405 15:06:19.622715 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (100ms) I0405 15:06:19.723135 1 gather_workloads_info.go:387] No image sha256:1e65f9f5490fbc930d2dce96f03ddcb28990b839d7dc011ef5de5bec6c5095bf (100ms) I0405 15:06:19.822628 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (99ms) I0405 15:06:19.922866 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (100ms) I0405 15:06:20.022828 1 gather_workloads_info.go:387] No image sha256:90bdf9e678fe18e35401e34e1cb0912d822e9cb32b9e41cc545870540e9a87f2 (100ms) I0405 15:06:20.122834 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (100ms) I0405 15:06:20.223751 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (101ms) I0405 15:06:20.324022 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (100ms) I0405 15:06:20.426440 1 gather_workloads_info.go:387] No image sha256:3612c5a433effd17b7aff7ff6edf4fb27b61153908e3a0294158e4886a1d600d (102ms) I0405 15:06:20.525881 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (99ms) I0405 15:06:20.622818 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (97ms) I0405 15:06:20.722231 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (99ms) I0405 15:06:20.822739 1 gather_workloads_info.go:387] No image sha256:0092c6ff139f8698c91349d507eb3182bc5d6c4ae040f672e347ff504accdea2 (100ms) I0405 15:06:20.923024 1 gather_workloads_info.go:387] No image sha256:0af73ad7a47c9ff53269ae2bc5163bf9e389085220c34e4bd42c92c4e7a85f6d (100ms) I0405 15:06:21.022684 1 gather_workloads_info.go:387] No image sha256:3d6ea9e1633f38070718a1357fcb80e6cb3932aafcc4d65e659795b186c5da15 (100ms) I0405 15:06:21.124378 1 gather_workloads_info.go:387] No image sha256:7bd3e88d6d3f878a89203df590b684c5a77bf08df4717451d3197ab74683a80e (102ms) I0405 15:06:21.223422 1 gather_workloads_info.go:398] Found image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (99ms) I0405 15:06:21.323696 1 gather_workloads_info.go:387] No image sha256:1477f3287cc75352305274f248f781c1b7c2a8696f4f7bc450c45a4a5f5b10ea (100ms) I0405 15:06:21.423708 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (100ms) I0405 15:06:21.523925 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (100ms) I0405 15:06:21.622791 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (99ms) I0405 15:06:21.721620 1 gather_workloads_info.go:387] No image sha256:6e5df2aab9ce759e8f957341a11c087c233307e3c8f8760d21270efc19ccd3ce (99ms) I0405 15:06:21.823323 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (102ms) I0405 15:06:21.922651 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (99ms) I0405 15:06:22.023914 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (101ms) I0405 15:06:22.124100 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (100ms) I0405 15:06:22.222678 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (99ms) I0405 15:06:22.331688 1 gather_workloads_info.go:387] No image sha256:74713675d580a47a56b628469c4c05c41e114e0b935960d718ff0cf7e72f613d (109ms) I0405 15:06:22.422589 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (91ms) I0405 15:06:22.422617 1 tasks_processing.go:74] worker 1 stopped. I0405 15:06:22.422912 1 recorder.go:75] Recording config/workload_info with fingerprint=1874e2f94aeaed45eeea515f77bdd703fe62f1a320be75246cbe86b2ae0737e7 I0405 15:06:22.422931 1 gather.go:177] gatherer "workloads" function "workload_info" took 9.168186079s to process 1 records I0405 15:06:22.422944 1 periodic.go:256] Periodic gather workloads completed in 9.168s I0405 15:06:22.422952 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0405 15:06:22.422957 1 periodic.go:209] Running conditional gatherer I0405 15:06:22.429242 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0405 15:06:22.559835 1 conditional_gatherer.go:338] updating alerts cache for conditional gatherer E0405 15:06:22.562030 1 conditional_gatherer.go:324] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp 172.30.142.222:9091: connect: connection refused I0405 15:06:22.562093 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0405 15:06:22.568806 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0405 15:06:22.568821 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0405 15:06:22.568826 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0405 15:06:22.568830 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0405 15:06:22.568833 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0405 15:06:22.568837 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0405 15:06:22.568840 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0405 15:06:22.568843 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0405 15:06:22.568846 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0405 15:06:22.568849 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0405 15:06:22.568852 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0405 15:06:22.568864 1 tasks_processing.go:45] number of workers: 3 I0405 15:06:22.568870 1 tasks_processing.go:69] worker 2 listening for tasks. I0405 15:06:22.568874 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0405 15:06:22.568879 1 tasks_processing.go:69] worker 0 listening for tasks. I0405 15:06:22.568894 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0405 15:06:22.568896 1 tasks_processing.go:69] worker 1 listening for tasks. I0405 15:06:22.568903 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0405 15:06:22.568907 1 tasks_processing.go:74] worker 1 stopped. I0405 15:06:22.568943 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=9fafdcbf373f1f367f1d69551ea59114592cce1681189be0f3dde774e0530661 I0405 15:06:22.568955 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1µs to process 1 records I0405 15:06:22.568986 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0405 15:06:22.568993 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.189µs to process 1 records I0405 15:06:22.568998 1 tasks_processing.go:74] worker 0 stopped. I0405 15:06:22.569145 1 tasks_processing.go:74] worker 2 stopped. I0405 15:06:22.569163 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 233.643µs to process 0 records I0405 15:06:22.569202 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=Succeeded message= I0405 15:06:22.569221 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I0405 15:06:22.595053 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=e74bbe31c3f5d76db63fe70c6fb3a6a177c7a2d510ae5684a127030721b5eb88 I0405 15:06:22.595205 1 diskrecorder.go:70] Writing 190 records to /var/lib/insights-operator/insights-2026-04-05-150622.tar.gz I0405 15:06:22.608086 1 diskrecorder.go:51] Wrote 190 records to disk in 12ms I0405 15:06:22.608137 1 periodic.go:278] Gathering cluster info every 2h0m0s I0405 15:06:22.608154 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0405 15:07:26.600917 1 diskrecorder.go:223] Found files to send: insights-2026-04-05-150622.tar.gz I0405 15:07:26.600944 1 insightsuploader.go:150] Checking archives to upload periodically every 16m2.993946087s I0405 15:07:26.600954 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0405 15:07:26.611075 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0405 15:07:26.780392 1 requests.go:87] Successfully reported id=2026-04-05T15:07:26Z x-rh-insights-request-id=db4f8fae7ade4f1588c55c8a97e75b11, wrote=93650 I0405 15:07:26.780441 1 insightsuploader.go:187] Uploaded report successfully in 179.482052ms I0405 15:07:26.780462 1 controller.go:128] Initializing last reported time to 2026-04-05T15:07:26Z I0405 15:07:26.780499 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0405 15:07:26.780508 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0405 15:07:26.780514 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0405 15:07:26.786349 1 controller.go:512] The operator is healthy I0405 15:07:56.613200 1 controller.go:512] The operator is healthy I0405 15:08:30.604449 1 insightsreport.go:137] Pulling report from smart-proxy I0405 15:08:30.604477 1 insightsreport.go:149] Retrieving report I0405 15:08:30.612786 1 requests.go:110] Retrieving report for cluster: 0f5da126-cd2c-4c50-accb-0c226e203baa I0405 15:08:30.612799 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/0f5da126-cd2c-4c50-accb-0c226e203baa/reports I0405 15:08:30.615938 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/0f5da126-cd2c-4c50-accb-0c226e203baa/reports I0405 15:08:30.854229 1 insightsreport.go:184] Report retrieved I0405 15:08:30.885431 1 insightsreport.go:239] Report retrieved correctly I0405 15:09:56.614923 1 controller.go:512] The operator is healthy I0405 15:10:56.593041 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0405 15:10:56.599284 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0405 15:10:56.599303 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0405 15:10:56.603820 1 secretconfigobserver.go:119] support secret does not exist I0405 15:11:56.615305 1 controller.go:512] The operator is healthy I0405 15:13:56.614825 1 controller.go:512] The operator is healthy I0405 15:15:56.590745 1 configmapobserver.go:84] configmaps "insights-config" not found I0405 15:15:56.604880 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0405 15:15:56.609945 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0405 15:15:56.609961 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0405 15:15:56.612796 1 controller.go:512] The operator is healthy I0405 15:15:56.614304 1 secretconfigobserver.go:119] support secret does not exist I0405 15:17:56.613646 1 controller.go:512] The operator is healthy I0405 15:19:56.614564 1 controller.go:512] The operator is healthy I0405 15:20:56.614650 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0405 15:20:56.620810 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0405 15:20:56.620833 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0405 15:20:56.625347 1 secretconfigobserver.go:119] support secret does not exist I0405 15:21:56.614257 1 controller.go:512] The operator is healthy I0405 15:23:34.776047 1 insightsuploader.go:146] Nothing to report since 2026-04-05T15:07:26Z I0405 15:23:56.613668 1 controller.go:512] The operator is healthy I0405 15:25:56.590428 1 configmapobserver.go:84] configmaps "insights-config" not found I0405 15:25:56.594912 1 configmapobserver.go:84] configmaps "insights-config" not found I0405 15:25:56.612995 1 controller.go:512] The operator is healthy I0405 15:25:56.625789 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0405 15:25:56.630872 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0405 15:25:56.630888 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0405 15:25:56.635337 1 secretconfigobserver.go:119] support secret does not exist I0405 15:27:56.614084 1 controller.go:512] The operator is healthy I0405 15:29:56.615359 1 controller.go:512] The operator is healthy I0405 15:30:56.635830 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0405 15:30:56.641855 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0405 15:30:56.641873 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0405 15:30:56.646446 1 secretconfigobserver.go:119] support secret does not exist I0405 15:31:56.614142 1 controller.go:512] The operator is healthy I0405 15:33:56.613591 1 controller.go:512] The operator is healthy I0405 15:35:56.591577 1 configmapobserver.go:84] configmaps "insights-config" not found I0405 15:35:56.612738 1 controller.go:512] The operator is healthy I0405 15:35:56.646697 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0405 15:35:56.652071 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0405 15:35:56.652085 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0405 15:35:56.656474 1 secretconfigobserver.go:119] support secret does not exist