W0311 14:00:56.877196 1 cmd.go:257] Using insecure, self-signed certificates I0311 14:00:57.387853 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0311 14:00:57.388172 1 observer_polling.go:159] Starting file observer W0311 14:00:57.413281 1 builder.go:272] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-5ff5cb4f99" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I0311 14:00:57.799911 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I0311 14:00:57.800178 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0311 14:00:57.800691 1 secure_serving.go:57] Forcing use of http/1.1 only W0311 14:00:57.800713 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0311 14:00:57.800717 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0311 14:00:57.800722 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0311 14:00:57.800726 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0311 14:00:57.800729 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0311 14:00:57.800732 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0311 14:00:57.800868 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0311 14:00:57.805650 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I0311 14:00:57.805715 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0311 14:00:57.807853 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0311 14:00:57.807873 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0311 14:00:57.807882 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0311 14:00:57.807920 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0311 14:00:57.807882 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0311 14:00:57.807946 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0311 14:00:57.808107 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-3047820924/tls.crt::/tmp/serving-cert-3047820924/tls.key" I0311 14:00:57.808352 1 secure_serving.go:213] Serving securely on [::]:8443 I0311 14:00:57.808395 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" E0311 14:00:57.809814 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.189bce4137d9a02e openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdditionalRoutingCapabilities\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"CPMSMachineNamePrefix\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"ConsolePluginContentSecurityPolicy\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"GatewayAPI\", \"GatewayAPIController\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MetricsCollectionProfiles\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"OnClusterBuild\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SetEIPForNLBIngressController\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ClusterVersionOperatorConfiguration\", \"DNSNameResolver\", \"DualReplica\", \"DyanmicServiceEndpointIBMCloud\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"Example2\", \"ExternalOIDCWithUIDAndExtraClaimMappings\", \"GCPClusterHostedDNS\", \"GCPCustomAPIEndpoints\", \"HighlyAvailableArbiter\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"KMSEncryptionProvider\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NewOLMCatalogdAPIV1Metas\", \"NewOLMOwnSingleNamespace\", \"NewOLMPreflightPermissionChecks\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"SELinuxChangePolicy\", \"SELinuxMount\", \"ShortCertRotation\", \"SignatureStores\", \"SigstoreImageVerification\", \"SigstoreImageVerificationPKI\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereConfigurableMaxAllowedBlockVolumesPerNode\", \"VSphereHostVMGroupZonal\", \"VSphereMultiDisk\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-03-11 14:00:57.805627438 +0000 UTC m=+0.981579866,LastTimestamp:2026-03-11 14:00:57.805627438 +0000 UTC m=+0.981579866,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" W0311 14:00:57.811047 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0311 14:00:57.811068 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0311 14:00:57.811178 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0311 14:00:57.817355 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0311 14:00:57.817380 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0311 14:00:57.823083 1 secretconfigobserver.go:119] support secret does not exist I0311 14:00:57.828671 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0311 14:00:57.833576 1 secretconfigobserver.go:119] support secret does not exist I0311 14:00:57.836660 1 recorder.go:156] Pruning old reports every 5h36m51s, max age is 288h0m0s I0311 14:00:57.842445 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0311 14:00:57.842476 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0311 14:00:57.842503 1 insightsreport.go:296] Starting report retriever I0311 14:00:57.842499 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0311 14:00:57.842473 1 periodic.go:212] Running clusterconfig gatherer I0311 14:00:57.842620 1 tasks_processing.go:45] number of workers: 32 I0311 14:00:57.842664 1 tasks_processing.go:69] worker 2 listening for tasks. I0311 14:00:57.842673 1 tasks_processing.go:69] worker 14 listening for tasks. I0311 14:00:57.842676 1 tasks_processing.go:69] worker 31 listening for tasks. I0311 14:00:57.842683 1 tasks_processing.go:71] worker 14 working on node_logs task. I0311 14:00:57.842684 1 tasks_processing.go:69] worker 8 listening for tasks. I0311 14:00:57.842691 1 tasks_processing.go:69] worker 0 listening for tasks. I0311 14:00:57.842694 1 tasks_processing.go:71] worker 8 working on machine_config_pools task. I0311 14:00:57.842696 1 tasks_processing.go:69] worker 15 listening for tasks. I0311 14:00:57.842704 1 tasks_processing.go:69] worker 7 listening for tasks. I0311 14:00:57.842709 1 tasks_processing.go:69] worker 16 listening for tasks. I0311 14:00:57.842713 1 tasks_processing.go:69] worker 6 listening for tasks. I0311 14:00:57.842686 1 tasks_processing.go:71] worker 31 working on machines task. I0311 14:00:57.842703 1 tasks_processing.go:69] worker 11 listening for tasks. I0311 14:00:57.842695 1 tasks_processing.go:69] worker 10 listening for tasks. I0311 14:00:57.842725 1 tasks_processing.go:69] worker 18 listening for tasks. I0311 14:00:57.842718 1 tasks_processing.go:69] worker 17 listening for tasks. I0311 14:00:57.842733 1 tasks_processing.go:69] worker 12 listening for tasks. I0311 14:00:57.842737 1 tasks_processing.go:69] worker 19 listening for tasks. I0311 14:00:57.842736 1 tasks_processing.go:69] worker 5 listening for tasks. I0311 14:00:57.842743 1 tasks_processing.go:69] worker 13 listening for tasks. I0311 14:00:57.842745 1 tasks_processing.go:69] worker 3 listening for tasks. I0311 14:00:57.842750 1 tasks_processing.go:69] worker 20 listening for tasks. I0311 14:00:57.842752 1 tasks_processing.go:69] worker 1 listening for tasks. I0311 14:00:57.842756 1 tasks_processing.go:69] worker 4 listening for tasks. I0311 14:00:57.842758 1 tasks_processing.go:69] worker 21 listening for tasks. I0311 14:00:57.842761 1 tasks_processing.go:69] worker 26 listening for tasks. I0311 14:00:57.842768 1 tasks_processing.go:69] worker 27 listening for tasks. I0311 14:00:57.842769 1 tasks_processing.go:69] worker 22 listening for tasks. I0311 14:00:57.842772 1 tasks_processing.go:71] worker 26 working on validating_webhook_configurations task. I0311 14:00:57.842778 1 tasks_processing.go:69] worker 23 listening for tasks. I0311 14:00:57.842785 1 tasks_processing.go:71] worker 23 working on storage_classes task. I0311 14:00:57.842786 1 tasks_processing.go:69] worker 28 listening for tasks. I0311 14:00:57.842797 1 tasks_processing.go:69] worker 29 listening for tasks. I0311 14:00:57.842805 1 tasks_processing.go:69] worker 30 listening for tasks. I0311 14:00:57.842676 1 tasks_processing.go:71] worker 2 working on ingress_certificates task. I0311 14:00:57.842511 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0311 14:00:57.842687 1 tasks_processing.go:69] worker 9 listening for tasks. I0311 14:00:57.843028 1 tasks_processing.go:71] worker 11 working on sap_pods task. I0311 14:00:57.843058 1 tasks_processing.go:71] worker 10 working on overlapping_namespace_uids task. I0311 14:00:57.843232 1 tasks_processing.go:71] worker 3 working on image_registries task. I0311 14:00:57.843301 1 tasks_processing.go:69] worker 25 listening for tasks. I0311 14:00:57.842779 1 tasks_processing.go:71] worker 22 working on infrastructures task. I0311 14:00:57.843405 1 tasks_processing.go:71] worker 20 working on jaegers task. I0311 14:00:57.843471 1 tasks_processing.go:71] worker 25 working on crds task. I0311 14:00:57.843010 1 tasks_processing.go:71] worker 0 working on openstack_dataplanedeployments task. I0311 14:00:57.843608 1 tasks_processing.go:71] worker 4 working on aggregated_monitoring_cr_names task. I0311 14:00:57.843698 1 tasks_processing.go:71] worker 28 working on machine_configs task. I0311 14:00:57.843706 1 tasks_processing.go:71] worker 19 working on certificate_signing_requests task. I0311 14:00:57.843713 1 tasks_processing.go:71] worker 18 working on networks task. I0311 14:00:57.843014 1 tasks_processing.go:71] worker 15 working on active_alerts task. I0311 14:00:57.843005 1 tasks_processing.go:71] worker 17 working on nodenetworkconfigurationpolicies task. I0311 14:00:57.843293 1 tasks_processing.go:69] worker 24 listening for tasks. I0311 14:00:57.843877 1 tasks_processing.go:71] worker 24 working on service_accounts task. I0311 14:00:57.843017 1 tasks_processing.go:71] worker 7 working on tsdb_status task. W0311 14:00:57.843929 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0311 14:00:57.842773 1 tasks_processing.go:71] worker 27 working on cluster_apiserver task. I0311 14:00:57.843025 1 tasks_processing.go:71] worker 6 working on olm_operators task. I0311 14:00:57.843705 1 tasks_processing.go:71] worker 21 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0311 14:00:57.843770 1 tasks_processing.go:71] worker 12 working on sap_datahubs task. I0311 14:00:57.843773 1 tasks_processing.go:71] worker 1 working on nodes task. I0311 14:00:57.843780 1 tasks_processing.go:71] worker 30 working on feature_gates task. I0311 14:00:57.843783 1 tasks_processing.go:71] worker 29 working on image_pruners task. I0311 14:00:57.843790 1 tasks_processing.go:71] worker 5 working on oauths task. W0311 14:00:57.843794 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0311 14:00:57.843795 1 tasks_processing.go:71] worker 13 working on storage_cluster task. I0311 14:00:57.843801 1 tasks_processing.go:71] worker 9 working on monitoring_persistent_volumes task. I0311 14:00:57.843970 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 25.022µs to process 0 records I0311 14:00:57.844922 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 972.927µs to process 0 records I0311 14:00:57.844932 1 tasks_processing.go:71] worker 15 working on nodenetworkstates task. I0311 14:00:57.843022 1 tasks_processing.go:71] worker 16 working on clusterroles task. I0311 14:00:57.844171 1 tasks_processing.go:71] worker 7 working on machine_healthchecks task. I0311 14:00:57.846805 1 tasks_processing.go:71] worker 8 working on mutating_webhook_configurations task. I0311 14:00:57.846819 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 4.096112ms to process 0 records I0311 14:00:57.847599 1 tasks_processing.go:71] worker 31 working on lokistack task. E0311 14:00:57.847611 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0311 14:00:57.847623 1 gather.go:177] gatherer "clusterconfig" function "machines" took 4.869233ms to process 0 records I0311 14:00:57.852043 1 tasks_processing.go:71] worker 17 working on config_maps task. I0311 14:00:57.852053 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 8.199423ms to process 0 records I0311 14:00:57.852227 1 tasks_processing.go:71] worker 12 working on dvo_metrics task. I0311 14:00:57.852235 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 7.924757ms to process 0 records I0311 14:00:57.852514 1 tasks_processing.go:71] worker 31 working on openshift_machine_api_events task. I0311 14:00:57.852539 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 4.903312ms to process 0 records I0311 14:00:57.852568 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 9.479335ms to process 0 records I0311 14:00:57.852574 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 9.875226ms to process 0 records I0311 14:00:57.852577 1 tasks_processing.go:71] worker 11 working on operators_pods_and_events task. I0311 14:00:57.852644 1 tasks_processing.go:71] worker 14 working on container_runtime_configs task. I0311 14:00:57.854106 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I0311 14:00:57.854123 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0311 14:00:57.854127 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0311 14:00:57.854131 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0311 14:00:57.854143 1 controller.go:458] The operator is still being initialized I0311 14:00:57.854148 1 controller.go:481] The operator is healthy I0311 14:00:57.855326 1 tasks_processing.go:71] worker 29 working on pdbs task. I0311 14:00:57.855670 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=203fa48848874ebf86b6ca5f2a378f75cedec0c9f9ffcba45e937589057ee202 I0311 14:00:57.855685 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 10.750813ms to process 1 records I0311 14:00:57.856141 1 tasks_processing.go:71] worker 0 working on pod_network_connectivity_checks task. I0311 14:00:57.856157 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 12.567683ms to process 0 records I0311 14:00:57.856211 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 12.712804ms to process 0 records I0311 14:00:57.856264 1 tasks_processing.go:71] worker 20 working on authentication task. I0311 14:00:57.856333 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=22825fb1950e86b6ed4f5bdef5b3979209695d5c12cfe91c6466bdcbc233943a I0311 14:00:57.856354 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=9f5cb292aa92ca2cacc8daccc0e3be2d3715fb31c0c75446831865e3b4afb766 I0311 14:00:57.856360 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 13.405045ms to process 2 records I0311 14:00:57.856368 1 tasks_processing.go:71] worker 23 working on silenced_alerts task. W0311 14:00:57.856387 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0311 14:00:57.856394 1 tasks_processing.go:71] worker 23 working on support_secret task. I0311 14:00:57.856415 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 19.711µs to process 0 records I0311 14:00:57.859733 1 tasks_processing.go:71] worker 13 working on metrics task. I0311 14:00:57.859737 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 14.971395ms to process 0 records W0311 14:00:57.859769 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0311 14:00:57.859781 1 tasks_processing.go:71] worker 13 working on container_images task. I0311 14:00:57.859795 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 32.767µs to process 0 records I0311 14:00:57.861707 1 tasks_processing.go:71] worker 15 working on openshift_logging task. I0311 14:00:57.861721 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 16.764424ms to process 0 records I0311 14:00:57.865107 1 tasks_processing.go:71] worker 7 working on sap_config task. E0311 14:00:57.865133 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0311 14:00:57.865146 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 20.053482ms to process 0 records I0311 14:00:57.865268 1 tasks_processing.go:71] worker 26 working on cost_management_metrics_configs task. I0311 14:00:57.866352 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=cff26c71ecb427137e65c685ed9f1fc1f8849e3029b6ea5dae5ba8f352bde844 I0311 14:00:57.867129 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=f148fdea119040510558bc26fb7b28757f7f4594f87f17251d3974fb48c8c8ba I0311 14:00:57.867219 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=553f1e7acbc8716beebd205ae2fa9d8d67beaa327e78cb7de854c6dece613f5c I0311 14:00:57.867307 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=da0f2eca110fff79aa2946d463eb7dfe674addb59664de456debe526609e8ce9 I0311 14:00:57.867379 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=4f976788f2e99ac34bf31384081f1aa201936473a8c4baa101a4f9677a5f9f3d I0311 14:00:57.867512 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=ba0d63c34117b4860513a7c1ac0c009f350bcd4d3190aed5ba2226185a30eac3 I0311 14:00:57.867641 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=f01e8a0d0c88cc344be8110c82806e5659d21ccda97629398463dc871ed6e6ed I0311 14:00:57.867891 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=28f43ab00d5b93fe9c48a993ec456a39c14dca8e64048f72f880dadcfaf07ae2 I0311 14:00:57.868237 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=4e5b0a7903aa360f4337fff9852f6d6f8ed7384d820ad1899d4882599dd44e44 I0311 14:00:57.868300 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=3f43290baac3d6db1c754768dc276ef11e6a9faba83ca12778355edad7474812 I0311 14:00:57.868313 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 22.479617ms to process 10 records I0311 14:00:57.868451 1 tasks_processing.go:71] worker 1 working on proxies task. I0311 14:00:57.868746 1 recorder.go:70] Recording config/node/ip-10-0-0-195.ec2.internal with fingerprint=bab8ec7e639f677a1d31f754fc2b83c6e4cd268a900d6eb7bd332b15bb726c59 I0311 14:00:57.868913 1 recorder.go:70] Recording config/node/ip-10-0-1-228.ec2.internal with fingerprint=15c2db412a6666026174c9dcc6e3ceccf11e7f80f559e7f4b4530a35f55eaa55 I0311 14:00:57.868991 1 recorder.go:70] Recording config/node/ip-10-0-2-29.ec2.internal with fingerprint=8946a4c76bd9bda2f481b3f5ad755de5223e04b408ccdcc68d24011a58a61db8 I0311 14:00:57.869004 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 20.89013ms to process 3 records I0311 14:00:57.869164 1 tasks_processing.go:71] worker 18 working on openstack_dataplanenodesets task. I0311 14:00:57.869168 1 recorder.go:70] Recording config/network with fingerprint=5afdbbcd9731361cf21ef6fb3bbec482464c478b708fceaaec7e8748abbc8ec0 I0311 14:00:57.869221 1 gather.go:177] gatherer "clusterconfig" function "networks" took 21.973591ms to process 1 records I0311 14:00:57.869233 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 13.372367ms to process 0 records I0311 14:00:57.869239 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 14.86407ms to process 0 records I0311 14:00:57.869301 1 tasks_processing.go:71] worker 14 working on install_plans task. I0311 14:00:57.869369 1 tasks_processing.go:71] worker 31 working on ingress task. I0311 14:00:57.869385 1 tasks_processing.go:71] worker 27 working on machine_sets task. I0311 14:00:57.869430 1 recorder.go:70] Recording config/apiserver with fingerprint=28049e2f9424807bed29737b200b5b97ce0da0355a41ab21b55328ef19d08940 I0311 14:00:57.869444 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 23.897515ms to process 1 records I0311 14:00:57.869529 1 tasks_processing.go:71] worker 22 working on machine_autoscalers task. I0311 14:00:57.870341 1 recorder.go:70] Recording config/infrastructure with fingerprint=e57dfafa7fca3f606d1f58290fdc01a2dcb8659d389f50be909049595d37f7c6 I0311 14:00:57.870401 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 24.884999ms to process 1 records I0311 14:00:57.870622 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=0a27e7ca5dd31c59f62581590b5a19c9f63aeb312f36d0c3efd6f752b496697e I0311 14:00:57.870706 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=cf4bcf5e107e87f7fa955c1401aeca1010304160dbd4521f9ba54a48b04002a8 I0311 14:00:57.870764 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=57a37c248f32a14de82e594291a7e9f4e834d3bfaaeab0b3787020b2c9fd636a I0311 14:00:57.870799 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 13.551733ms to process 3 records E0311 14:00:57.870818 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0311 14:00:57.870829 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 12.90997ms to process 0 records I0311 14:00:57.870838 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 24.245064ms to process 0 records I0311 14:00:57.870846 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 25.008629ms to process 0 records I0311 14:00:57.870864 1 tasks_processing.go:71] worker 0 working on version task. I0311 14:00:57.871293 1 tasks_processing.go:71] worker 5 working on image task. I0311 14:00:57.871365 1 recorder.go:70] Recording config/oauth with fingerprint=a93c0e16205fb2a425a617555f9e00cc4209f03d2af874038ffba3fa7b5bf45c I0311 14:00:57.871408 1 tasks_processing.go:71] worker 6 working on openstack_version task. I0311 14:00:57.871416 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 24.568822ms to process 1 records I0311 14:00:57.871645 1 recorder.go:70] Recording config/featuregate with fingerprint=74f955ccd870701592d704345a19369fbb2cde0bf602707beae898b666092aef I0311 14:00:57.871689 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 25.781295ms to process 1 records I0311 14:00:57.871393 1 tasks_processing.go:71] worker 29 working on openstack_controlplanes task. I0311 14:00:57.871729 1 tasks_processing.go:71] worker 15 working on ceph_cluster task. I0311 14:00:57.871944 1 tasks_processing.go:71] worker 30 working on operators task. I0311 14:00:57.871400 1 tasks_processing.go:71] worker 9 working on schedulers task. I0311 14:00:57.871722 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 8.558238ms to process 0 records E0311 14:00:57.872047 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0311 14:00:57.872078 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0311 14:00:57.872090 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 26.65901ms to process 1 records I0311 14:00:57.872110 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0311 14:00:57.872121 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 27.663385ms to process 1 records I0311 14:00:57.873924 1 tasks_processing.go:74] worker 10 stopped. I0311 14:00:57.873983 1 tasks_processing.go:74] worker 3 stopped. I0311 14:00:57.874586 1 tasks_processing.go:74] worker 28 stopped. I0311 14:00:57.874143 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=6a8c9319081661dad4e9c2a19606b249f8fdefad82fea8802cea5503e438a5d9 I0311 14:00:57.874724 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 27.549425ms to process 1 records I0311 14:00:57.875060 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=a652aad8d6b9dd9899fe0918b698fb1fe66258b737b94d82457a47e38c744abd I0311 14:00:57.875231 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=466d0d5d39a9ef7fb43dbdac591359deecfd954e98ca25cf0036b9f121c0883a I0311 14:00:57.875381 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=37424313118bc10c3c5e16f5f7537d47184a0307ebb07b52e9f3e734f555a60e I0311 14:00:57.875430 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 24.235194ms to process 3 records I0311 14:00:57.875949 1 tasks_processing.go:74] worker 8 stopped. I0311 14:00:57.876168 1 tasks_processing.go:74] worker 20 stopped. I0311 14:00:57.876439 1 recorder.go:70] Recording config/authentication with fingerprint=eb522dd536697a4379a6a04333653f00a0a76fb98940a78c77a3dc67fe7858c4 I0311 14:00:57.876456 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 15.112174ms to process 1 records I0311 14:00:57.876507 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 6.696734ms to process 0 records I0311 14:00:57.876519 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 9.145996ms to process 0 records I0311 14:00:57.876528 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 31.508392ms to process 0 records E0311 14:00:57.876569 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0311 14:00:57.876582 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 18.812461ms to process 0 records I0311 14:00:57.876591 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 32.287366ms to process 0 records I0311 14:00:57.876602 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 7.402412ms to process 0 records I0311 14:00:57.876629 1 tasks_processing.go:74] worker 4 stopped. I0311 14:00:57.876676 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 7.194203ms to process 0 records I0311 14:00:57.876709 1 tasks_processing.go:74] worker 7 stopped. I0311 14:00:57.876716 1 tasks_processing.go:74] worker 26 stopped. I0311 14:00:57.876740 1 tasks_processing.go:74] worker 19 stopped. I0311 14:00:57.876746 1 tasks_processing.go:74] worker 23 stopped. I0311 14:00:57.876754 1 tasks_processing.go:74] worker 18 stopped. I0311 14:00:57.876763 1 tasks_processing.go:74] worker 27 stopped. I0311 14:00:57.879163 1 tasks_processing.go:74] worker 1 stopped. I0311 14:00:57.879292 1 recorder.go:70] Recording config/proxy with fingerprint=363d034a0fffc0cf5eb318a54b8cd866c1883c1401682b71b1625075cd677318 I0311 14:00:57.879325 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 10.694318ms to process 1 records W0311 14:00:57.879430 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0311 14:00:57.879597 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0311 14:00:57.879882 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0311 14:00:57.880065 1 tasks_processing.go:74] worker 22 stopped. W0311 14:00:57.880067 1 operator.go:287] started I0311 14:00:57.880089 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0311 14:00:57.880110 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 10.521463ms to process 0 records I0311 14:00:57.880418 1 tasks_processing.go:74] worker 15 stopped. I0311 14:00:57.880431 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 8.673788ms to process 0 records I0311 14:00:57.880889 1 tasks_processing.go:74] worker 31 stopped. I0311 14:00:57.881092 1 recorder.go:70] Recording config/ingress with fingerprint=328a75ed3822e314884ed6303810402d35ba2b56a006b48b68b8b5126f705048 I0311 14:00:57.881113 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 11.502199ms to process 1 records I0311 14:00:57.881383 1 tasks_processing.go:74] worker 29 stopped. I0311 14:00:57.881396 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 9.648314ms to process 0 records I0311 14:00:57.882307 1 tasks_processing.go:74] worker 16 stopped. I0311 14:00:57.882501 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=62b06ecc7603b6bdd302a88c544d6f3dda0c719cb5b6940f22e25d45c2f693c6 I0311 14:00:57.882630 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=78f95fcfdcd123e39831d46fdb9faed4378d1b26ef7feb4f5de236fb1292c57a I0311 14:00:57.882640 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 37.285778ms to process 2 records I0311 14:00:57.882651 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 11.016309ms to process 0 records I0311 14:00:57.882663 1 tasks_processing.go:74] worker 6 stopped. I0311 14:00:57.890261 1 tasks_processing.go:74] worker 9 stopped. I0311 14:00:57.890395 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=cf3ab574f37fe39e443f80e12b060cf75f10e9189238bce04da490834ade774c I0311 14:00:57.890414 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 18.261837ms to process 1 records I0311 14:00:57.890775 1 tasks_processing.go:74] worker 25 stopped. I0311 14:00:57.892611 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=6c6a98a836f5627443538766c9bf7e63c5a6eb673df6f16e391d0705a0282054 I0311 14:00:57.893249 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=f008fc9d0f512f4b76df60585b84e978b8424390bc260f6511fc7944cf8f5cbb I0311 14:00:57.893294 1 gather.go:177] gatherer "clusterconfig" function "crds" took 47.278635ms to process 2 records I0311 14:00:57.894569 1 tasks_processing.go:74] worker 5 stopped. I0311 14:00:57.894841 1 recorder.go:70] Recording config/image with fingerprint=efb7800af11ef009581a612f557b702e139a2fe5a8ed9a30ef413e2ad8eec4ac I0311 14:00:57.894863 1 gather.go:177] gatherer "clusterconfig" function "image" took 23.230555ms to process 1 records I0311 14:00:57.894883 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 50.657472ms to process 0 records I0311 14:00:57.894895 1 tasks_processing.go:74] worker 21 stopped. I0311 14:00:57.895742 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0311 14:00:57.895756 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0311 14:00:57.895761 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0311 14:00:57.895767 1 controller.go:203] Source scaController *sca.Controller is not ready I0311 14:00:57.895773 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I0311 14:00:57.895794 1 controller.go:458] The operator is still being initialized I0311 14:00:57.895802 1 controller.go:481] The operator is healthy I0311 14:00:57.897432 1 tasks_processing.go:74] worker 13 stopped. I0311 14:00:57.898841 1 prometheus_rules.go:88] Prometheus rules successfully created I0311 14:00:57.899167 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-sbjdd with fingerprint=9d8e073661c4e0a0d6878f7bc5b54b3a6c49c1eb81b04c30389155c6509a583c I0311 14:00:57.899389 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-t6lg2 with fingerprint=04b8f156d5d366c5688cf4e680d16997e8f1042e572bfe350acf5b97f3296159 I0311 14:00:57.899622 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-wc7bb with fingerprint=70ef4052cb4daae406d35ad3fd2b2c49c853d06ec26e05d48be24c0b594a82cd I0311 14:00:57.899671 1 recorder.go:70] Recording config/running_containers with fingerprint=c7da54d3aac3fba16dbe9c884a5b2b013a54a4236ff052a70af95f7cb454162e I0311 14:00:57.899682 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 37.642738ms to process 4 records I0311 14:00:57.907937 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0311 14:00:57.907972 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0311 14:00:57.907957 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file E0311 14:00:57.908888 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27049f69fe-5f23-4f89-b77e-f572e32d3974%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.13:48813->172.30.0.10:53: read: connection refused I0311 14:00:57.908903 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27049f69fe-5f23-4f89-b77e-f572e32d3974%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.13:48813->172.30.0.10:53: read: connection refused I0311 14:00:57.910680 1 tasks_processing.go:74] worker 17 stopped. E0311 14:00:57.910742 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0311 14:00:57.910774 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0311 14:00:57.910808 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0311 14:00:57.910850 1 recorder.go:70] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=295a2bc7810c628251f1f312c209b5eb4da888326706c635ac0c12aec0969e17 I0311 14:00:57.910908 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0311 14:00:57.910937 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0311 14:00:57.910963 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=fe7abfa7f7aea852d8bca6b7df9b4d5de32045254ff2774f9bd30f0b6dcb7dc4 I0311 14:00:57.910988 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0311 14:00:57.911100 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0311 14:00:57.911139 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0311 14:00:57.911166 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 58.620773ms to process 7 records I0311 14:00:57.912421 1 base_controller.go:82] Caches are synced for ConfigController I0311 14:00:57.912445 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0311 14:00:57.912740 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0311 14:00:57.916665 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.13:41756->172.30.0.10:53: read: connection refused I0311 14:00:57.916679 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.13:41756->172.30.0.10:53: read: connection refused I0311 14:00:57.918959 1 configmapobserver.go:84] configmaps "insights-config" not found I0311 14:00:57.956923 1 tasks_processing.go:74] worker 0 stopped. I0311 14:00:57.957409 1 recorder.go:70] Recording config/version with fingerprint=d208896e678c8d93d5ef97c099dea8248bd1bb97df656907d67794fc371b3a87 I0311 14:00:57.957424 1 recorder.go:70] Recording config/id with fingerprint=88b33fbe93ffc06f1afc2db7b6e6372b9269045bba04ac7b02dfd4114c127a28 I0311 14:00:57.957431 1 gather.go:177] gatherer "clusterconfig" function "version" took 86.0252ms to process 2 records I0311 14:00:57.978650 1 tasks_processing.go:74] worker 2 stopped. E0311 14:00:57.978664 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0311 14:00:57.978671 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2ovi6kukph2dn9f582ta9gknbc93k080-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2ovi6kukph2dn9f582ta9gknbc93k080-primary-cert-bundle-secret" not found I0311 14:00:57.978746 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=63c000c07c8a91c0f45f418753ca63f08b4db0c52ee25f3e8baf3f7bfe96cb53 I0311 14:00:57.978766 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 135.825169ms to process 1 records I0311 14:00:57.980924 1 base_controller.go:82] Caches are synced for LoggingSyncer I0311 14:00:57.980937 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0311 14:00:58.513997 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0311 14:00:58.713884 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" W0311 14:00:58.874718 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0311 14:00:59.086279 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0311 14:00:59.086293 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0311 14:00:59.087203 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-nqqd8 pod in namespace openshift-dns (previous: false). I0311 14:00:59.315985 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-nqqd8 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-nqqd8\" is waiting to start: ContainerCreating" I0311 14:00:59.316002 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-nqqd8\" is waiting to start: ContainerCreating" I0311 14:00:59.316011 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-nqqd8 pod in namespace openshift-dns (previous: false). I0311 14:00:59.491684 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-nqqd8 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-nqqd8\" is waiting to start: ContainerCreating" I0311 14:00:59.491704 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-nqqd8\" is waiting to start: ContainerCreating" I0311 14:00:59.491736 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-pp6hg pod in namespace openshift-dns (previous: false). I0311 14:00:59.515313 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0311 14:00:59.714871 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-pp6hg pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-pp6hg\" is waiting to start: ContainerCreating" I0311 14:00:59.714893 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-pp6hg\" is waiting to start: ContainerCreating" I0311 14:00:59.714900 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-pp6hg pod in namespace openshift-dns (previous: false). W0311 14:00:59.874281 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0311 14:00:59.891205 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-pp6hg pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-pp6hg\" is waiting to start: ContainerCreating" I0311 14:00:59.891222 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-pp6hg\" is waiting to start: ContainerCreating" I0311 14:00:59.891232 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-ch2b5 pod in namespace openshift-dns (previous: false). I0311 14:01:00.091506 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0311 14:01:00.091526 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-czc8b pod in namespace openshift-dns (previous: false). I0311 14:01:00.116927 1 tasks_processing.go:74] worker 30 stopped. I0311 14:01:00.116995 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=dc6299cd653d7201cc8e8be6467d585f3f66514727590599b6094750b26b9489 I0311 14:01:00.117038 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=bf7be1db71cbc7f0b72d3e44250a7586863a2a64799b5f1603113319ac1c6194 I0311 14:01:00.117076 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0311 14:01:00.117106 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=9bdca7568fae3019901f44bb1a733d2810d7e5813a0423c6f484111b7c263f3a I0311 14:01:00.117126 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0311 14:01:00.117149 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=47e2ba2adeed930d1a7790b74d7c9ceac6e206bf7464847e807117d897023ec2 I0311 14:01:00.117183 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=f9fc328fed2ef77cd8399f3527cbc76b8fbaec492440b1c3bf45cabb35251cb8 I0311 14:01:00.117208 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=ad8fdd47d640ff6b0aea33ffa5cf7237fab9ab4dcf520b308857e93c59632a96 I0311 14:01:00.117241 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=2c11d36cfdec2cac96e913beed066b887dd67d693d21e1d331571edaf4bb18af I0311 14:01:00.117252 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=e5ff11d57817f84a678f6fa9565af55bd1120227c16a21933637ab62675a6d70 I0311 14:01:00.117269 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=b4d0fa0562e2cab91067646fc88b257d3dd628b9a6624356427d229c06b913bd I0311 14:01:00.117280 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0311 14:01:00.117297 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=e367a8c787412f0d39bf9cc840394e9ef77b3bb235305331682d1c1290285d6e I0311 14:01:00.117308 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0311 14:01:00.117325 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=e6db9bb58dca4974697219d36ce8075e8b574b66f210af35617fbe9fd85522b3 I0311 14:01:00.117335 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0311 14:01:00.117358 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=db82b75d5bd2c8164324d53eeb779dc0c58a1220c67c459b3b05ad8c99f0970c I0311 14:01:00.117368 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0311 14:01:00.117385 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=a0e8190ed3f6553d4a821cbdcab67c0fa1e478352e3063df9a20f5eda93b94cc I0311 14:01:00.117508 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=0029646e2f4b3c6f9cf9d6f78709d13885710eac84959f6e9fc0797c5036b093 I0311 14:01:00.117533 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0311 14:01:00.117576 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=35c014484b0d0329e97c228841623023b808e7bba611852d15f8c18718126989 I0311 14:01:00.117600 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=b4cf5bc3127cc85cbda8c3ef1201c8b8ad6b102cf377b1293a3a82bcb7fddb16 I0311 14:01:00.117610 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0311 14:01:00.117626 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=a91064280d0b788aff2d2357c2998738e1d8f0d3482ed771349cf5b9a1ad6bc2 I0311 14:01:00.117636 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0311 14:01:00.117649 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=feb07b318ff303c2f434c47557b342f90c08257c5d29037e135b674b6fac4b8d I0311 14:01:00.117666 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=47b608c37568b8efb4ffcf50abdb01acca253662eb206fb5256fc347f4ba303c I0311 14:01:00.117683 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=b7df4d2dcffb04b31b31d12bd0ecf67ef2972fb53858e02c4e8c8ff23e39e6af I0311 14:01:00.117699 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=8ddd450f9e59c51a3b2b749982c2c99fcb8d6f6cef3d50f32fd96b7a2a2fcdaf I0311 14:01:00.117720 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=389a34021368020deb757eecdc57f3f9a69b67c51c81dc150f247634e893bb18 I0311 14:01:00.117731 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0311 14:01:00.117759 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=c1c5ae7b9b13599ba21887fc4f0deaccfceafc75aeb389c9bef7d6835570a443 I0311 14:01:00.117779 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0311 14:01:00.117788 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0311 14:01:00.117795 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.244967897s to process 35 records I0311 14:01:00.329294 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0311 14:01:00.329313 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-zlbgx pod in namespace openshift-dns (previous: false). I0311 14:01:00.490397 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0311 14:01:00.490416 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7b9c98f9bd-fhbbh pod in namespace openshift-image-registry (previous: false). I0311 14:01:00.692957 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7b9c98f9bd-fhbbh pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7b9c98f9bd-fhbbh\" is waiting to start: ContainerCreating" I0311 14:01:00.692976 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7b9c98f9bd-fhbbh\" is waiting to start: ContainerCreating" I0311 14:01:00.692988 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7fbcccbfc5-926kx pod in namespace openshift-image-registry (previous: false). W0311 14:01:00.874711 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0311 14:01:00.885313 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0311 14:01:00.885328 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7fbcccbfc5-m9xps pod in namespace openshift-image-registry (previous: false). I0311 14:01:01.091445 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7fbcccbfc5-m9xps pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7fbcccbfc5-m9xps\" is waiting to start: ContainerCreating" I0311 14:01:01.091463 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7fbcccbfc5-m9xps\" is waiting to start: ContainerCreating" I0311 14:01:01.091476 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-2485t pod in namespace openshift-image-registry (previous: false). I0311 14:01:01.307762 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0311 14:01:01.307800 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-2xlpl pod in namespace openshift-image-registry (previous: false). I0311 14:01:01.497267 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0311 14:01:01.497294 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-85rh5 pod in namespace openshift-image-registry (previous: false). I0311 14:01:01.710259 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0311 14:01:01.710282 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-58578866df-xglwn pod in namespace openshift-ingress (previous: false). W0311 14:01:01.874080 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0311 14:01:01.910015 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-58578866df-xglwn pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-58578866df-xglwn\" is waiting to start: ContainerCreating" I0311 14:01:01.910033 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-58578866df-xglwn\" is waiting to start: ContainerCreating" I0311 14:01:01.910044 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-f994c6c84-85bjs pod in namespace openshift-ingress (previous: false). I0311 14:01:02.096277 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-f994c6c84-85bjs pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-f994c6c84-85bjs\" is waiting to start: ContainerCreating" I0311 14:01:02.096297 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-f994c6c84-85bjs\" is waiting to start: ContainerCreating" I0311 14:01:02.096308 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-f994c6c84-xgqn7 pod in namespace openshift-ingress (previous: false). I0311 14:01:02.292030 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-f994c6c84-xgqn7 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-f994c6c84-xgqn7\" is waiting to start: ContainerCreating" I0311 14:01:02.292049 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-f994c6c84-xgqn7\" is waiting to start: ContainerCreating" I0311 14:01:02.292060 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-8nr9h pod in namespace openshift-ingress-canary (previous: false). I0311 14:01:02.490731 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-8nr9h pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-8nr9h\" is waiting to start: ContainerCreating" I0311 14:01:02.490748 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-8nr9h\" is waiting to start: ContainerCreating" I0311 14:01:02.490760 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-nrnzs pod in namespace openshift-ingress-canary (previous: false). I0311 14:01:02.691396 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-nrnzs pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-nrnzs\" is waiting to start: ContainerCreating" I0311 14:01:02.691413 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-nrnzs\" is waiting to start: ContainerCreating" I0311 14:01:02.691425 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-949fdd477-999cl pod in namespace openshift-kube-storage-version-migrator (previous: false). W0311 14:01:02.869945 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0311 14:01:02.869968 1 tasks_processing.go:74] worker 12 stopped. E0311 14:01:02.869979 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0311 14:01:02.869990 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0311 14:01:02.870005 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0311 14:01:02.870016 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.017725558s to process 1 records I0311 14:01:02.891493 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-949fdd477-999cl pod in namespace openshift-kube-storage-version-migrator (previous: false). I0311 14:01:03.092289 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-7944b9f44d-958fl pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). I0311 14:01:03.292901 1 tasks_processing.go:74] worker 11 stopped. I0311 14:01:03.292993 1 recorder.go:70] Recording events/openshift-dns-operator with fingerprint=e0369810552dee54641a5ccd45a1039cc1f147287c213f17d1786598725ab409 I0311 14:01:03.293037 1 recorder.go:70] Recording events/openshift-dns with fingerprint=a2c18b8fd73c04fa65f82d96e20838c7f2665f5ee0ac88123d784b70fe0008c4 I0311 14:01:03.293116 1 recorder.go:70] Recording events/openshift-image-registry with fingerprint=479ca5a44b3364b697040c729df3f93eac47775dcba5eb321cc542c7615d9e6c I0311 14:01:03.293143 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=b1528a71cbcac51f37285a9634e66b17bbaf1cdb85e3e9cae8b967d6738fefbb I0311 14:01:03.293190 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=3b81827e872bf8f3f28e88b301f602d00246d3130a16460548b288af216aca4b I0311 14:01:03.293205 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=0ec1bd9444e6781359cdf1a1d5d865cd960628866fa199d10b9af0e9a86c7977 I0311 14:01:03.293217 1 recorder.go:70] Recording events/openshift-kube-storage-version-migrator with fingerprint=2ee4e22f296f7492f4a52c0c0a1328a0d85084d84b006f795b9c13dddc24cdbd I0311 14:01:03.293267 1 recorder.go:70] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=cdbe9c08c2a4ac62d6d591c0a45e7c98ae291536a1f45c9236cf16d433e654bd I0311 14:01:03.293282 1 recorder.go:70] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-949fdd477-999cl/migrator_current.log with fingerprint=2d7cb6791877a715ebcdfed3f00d0e02cf36db3398ca4556c1fc6b5e3b64b671 I0311 14:01:03.293290 1 recorder.go:70] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-949fdd477-999cl/graceful-termination_current.log with fingerprint=1728aeb3074cfe6efe74ab289584bf59ce540ad5d3f81a0753f0829543105083 I0311 14:01:03.293362 1 recorder.go:70] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-7944b9f44d-958fl/kube-storage-version-migrator-operator_current.log with fingerprint=a23078e36038271f61f6985af52f49964ebd769b3b985d4f901b4e5ecb54ff71 I0311 14:01:03.293371 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 5.440304717s to process 11 records I0311 14:01:09.731394 1 configmapobserver.go:84] configmaps "insights-config" not found I0311 14:01:10.397760 1 configmapobserver.go:84] configmaps "insights-config" not found I0311 14:01:10.565054 1 tasks_processing.go:74] worker 14 stopped. I0311 14:01:10.565091 1 recorder.go:70] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0311 14:01:10.565102 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.695731972s to process 1 records I0311 14:01:10.599677 1 configmapobserver.go:84] configmaps "insights-config" not found I0311 14:01:11.250871 1 tasks_processing.go:74] worker 24 stopped. I0311 14:01:11.251154 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=1675fe780bd56f847caa71480c9940aaa99dd398e74ecdf1ad178c4833f9a52c I0311 14:01:11.251169 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.406973009s to process 1 records E0311 14:01:11.251223 1 periodic.go:250] "Unhandled Error" err="clusterconfig failed after 13.408s with: function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_configs\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0311 14:01:11.252325 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_configs" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0311 14:01:11.252339 1 periodic.go:212] Running workloads gatherer I0311 14:01:11.252356 1 tasks_processing.go:45] number of workers: 2 I0311 14:01:11.252363 1 tasks_processing.go:69] worker 1 listening for tasks. I0311 14:01:11.252367 1 tasks_processing.go:71] worker 1 working on workload_info task. I0311 14:01:11.252376 1 tasks_processing.go:69] worker 0 listening for tasks. I0311 14:01:11.252459 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0311 14:01:11.276906 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0311 14:01:11.283077 1 tasks_processing.go:74] worker 0 stopped. I0311 14:01:11.283097 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 30.602081ms to process 0 records I0311 14:01:11.288786 1 gather_workloads_info.go:387] No image sha256:a7c71f3c9714cf1717c45e12ec817be6d6209f00989e6a31d634e527f0c8147d (13ms) I0311 14:01:11.302530 1 gather_workloads_info.go:387] No image sha256:bae7a33f8db8a3d4b3c4c05498aba85a0ce463f85322067c48e79663710e616e (14ms) I0311 14:01:11.313474 1 gather_workloads_info.go:387] No image sha256:824a3b8f78e19aa21a9f6444aefe8e0b624886cca18fe828b13acbab55e6e868 (11ms) I0311 14:01:11.324620 1 gather_workloads_info.go:387] No image sha256:ceab8a8c340801fcebf800620d3fef5493d8a443077a21c6e56984051bd3abde (11ms) I0311 14:01:11.335140 1 gather_workloads_info.go:387] No image sha256:23c4fe84047a4e6cbe7f75f470e7d6fe0e61e7910dd17945b1b61bc4b72f3f2a (11ms) I0311 14:01:11.347176 1 gather_workloads_info.go:387] No image sha256:14703f73bb1ca69ea03b726e340b3b68f8e294e1f22c80d1a16666ea3d4a88a3 (12ms) I0311 14:01:11.357823 1 gather_workloads_info.go:387] No image sha256:420c12f61c53e54eab2d99476759c0de339fca98ce0a3a782bc6545cc0e97a9c (11ms) I0311 14:01:11.371107 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (13ms) I0311 14:01:11.383219 1 gather_workloads_info.go:387] No image sha256:6d6ebff54b8adac74f4d1b12ac8aa0f16cd7b28370e0d6aa847d1c457e03a5b6 (12ms) I0311 14:01:11.401451 1 gather_workloads_info.go:387] No image sha256:8b1e32ce43eb1247b0558230b6e0baa85ac62f1a5e2a2089d40b4fea90538529 (18ms) I0311 14:01:11.417336 1 gather_workloads_info.go:387] No image sha256:7941b5d9a758b8667e99cd9236f7f96ec036af61df5cbc96e16077d36700d7c7 (16ms) I0311 14:01:11.488121 1 gather_workloads_info.go:387] No image sha256:373614619b9420b110d1508c5f17e066ce69c4c226fd04d02fbb959d9ba41eb6 (71ms) I0311 14:01:11.588241 1 gather_workloads_info.go:387] No image sha256:f2c46054a8f64a0e949cbf30295f31b4a35a0203c6ad03fa7ec922b4101dcbf8 (100ms) I0311 14:01:11.688036 1 gather_workloads_info.go:387] No image sha256:76f820bd9bd138d29305d545d7d49bfe63e2923f1fb1ec2e8eac81a388359024 (100ms) I0311 14:01:11.788506 1 gather_workloads_info.go:387] No image sha256:6e67c980b7300e769fb4b2adaaf006d0f8274e43b10586701b204ea5153f15fc (100ms) I0311 14:01:11.889090 1 gather_workloads_info.go:387] No image sha256:18956d5fbc8d0369a26cb1e00eb5c3aff1973ae8cbd3983920a0cf2851f05358 (101ms) I0311 14:01:11.987437 1 gather_workloads_info.go:387] No image sha256:4f175ee49f51dc4379e9993fecd1657c7a9c4c3dc096772cb198d0212b9eea47 (98ms) I0311 14:01:12.087822 1 gather_workloads_info.go:387] No image sha256:9697bc2258bdfa9ae8c1866cc7eb0b3b46851998db827b121bdf77417a881eb3 (100ms) I0311 14:01:12.190109 1 gather_workloads_info.go:387] No image sha256:ccdda82b4adfa8ee4a84b3bad19693be6a42a9881a7b83788d835912129c49a4 (102ms) I0311 14:01:12.287629 1 gather_workloads_info.go:387] No image sha256:87efe06afd1f04426fca7f86c0f74c4ee75c311ba199ddabd5b849b877bc59fa (97ms) I0311 14:01:12.389097 1 gather_workloads_info.go:387] No image sha256:752be69b2262be713df12c47f4bac8c2dafed272c401e9a89f8060f053d68054 (101ms) I0311 14:01:12.487588 1 gather_workloads_info.go:387] No image sha256:2fac754deaeade3456361eed52e344318ff16d04819384432759f0ea35530114 (98ms) I0311 14:01:12.588660 1 gather_workloads_info.go:387] No image sha256:f6e156f39b06d196b46d8ed3a03ca337e939dba0060e40de4455b4e77b90929e (101ms) I0311 14:01:12.688631 1 gather_workloads_info.go:387] No image sha256:d28734effaadd66434e77a1a5fbe2e8a4ca2066cd9f8868c22ade9475539bfd7 (100ms) I0311 14:01:12.788248 1 gather_workloads_info.go:387] No image sha256:a9e885d6f0456a2cc10f9e5da71fe9403f5e4c639b9b7ea15bd403b272ccb824 (100ms) I0311 14:01:12.888273 1 gather_workloads_info.go:387] No image sha256:3d0634fe58641d5242649c44ddba70ed67fdd6d2dcb5c2261df5cee8b33de9fd (100ms) I0311 14:01:12.988117 1 gather_workloads_info.go:387] No image sha256:d93441b88bd020cae0a819977b23ca7be19e037d9bf634c16710864a08a4929f (100ms) I0311 14:01:13.088354 1 gather_workloads_info.go:387] No image sha256:0a8a0473029ace3adbb66f490dbe560f0e7782a38cdf32c1f7dd3e092e1d191e (100ms) I0311 14:01:13.188072 1 gather_workloads_info.go:387] No image sha256:2d077e73dd76873ee2a1583aa3b3e76a1b408737f0af2e22b2aa055604d89e81 (100ms) I0311 14:01:13.288896 1 gather_workloads_info.go:387] No image sha256:8ef4bdf07dda423fab73484dbc66d527ce8ba8cc2d4f99210bc1bc24ea08c0cb (101ms) I0311 14:01:13.388001 1 gather_workloads_info.go:387] No image sha256:0a92dd43975f972e3dc707fb37854e046813531553038147e9c90d54a8d9df73 (99ms) I0311 14:01:13.489015 1 gather_workloads_info.go:387] No image sha256:944d9261ba7a143131fe8267c172defc5f37acc1cea3d4d373ec6fc5d8bfcc31 (101ms) I0311 14:01:13.589026 1 gather_workloads_info.go:387] No image sha256:48404bd61d05dc738ccce4d22e36b30dbcdc6015b06b4afb604fd1baeee35bf2 (100ms) I0311 14:01:13.589054 1 tasks_processing.go:74] worker 1 stopped. E0311 14:01:13.589064 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0311 14:01:13.589327 1 recorder.go:70] Recording config/workload_info with fingerprint=484b23dded2110745c992bbc525202680e81c9122b9be57bac5ca2e49b4450e5 I0311 14:01:13.589342 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.336679407s to process 1 records E0311 14:01:13.589367 1 periodic.go:250] "Unhandled Error" err="workloads failed after 2.337s with: function \"workload_info\" failed with an error" I0311 14:01:13.590470 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0311 14:01:13.590486 1 periodic.go:212] Running conditional gatherer I0311 14:01:13.599610 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules I0311 14:01:13.606629 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.13:34180->172.30.0.10:53: read: connection refused E0311 14:01:13.606926 1 conditional_gatherer.go:320] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0311 14:01:13.606986 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I0311 14:01:13.615307 1 conditional_gatherer.go:390] cluster version is '4.19.9' E0311 14:01:13.615320 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0311 14:01:13.615326 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0311 14:01:13.615331 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0311 14:01:13.615336 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0311 14:01:13.615340 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0311 14:01:13.615344 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0311 14:01:13.615347 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0311 14:01:13.615349 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0311 14:01:13.615352 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I0311 14:01:13.615366 1 tasks_processing.go:45] number of workers: 3 I0311 14:01:13.615375 1 tasks_processing.go:69] worker 2 listening for tasks. I0311 14:01:13.615379 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0311 14:01:13.615384 1 tasks_processing.go:69] worker 0 listening for tasks. I0311 14:01:13.615397 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0311 14:01:13.615401 1 tasks_processing.go:69] worker 1 listening for tasks. I0311 14:01:13.615410 1 tasks_processing.go:74] worker 1 stopped. I0311 14:01:13.615403 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0311 14:01:13.615464 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0311 14:01:13.615477 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 692ns to process 1 records I0311 14:01:13.615514 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0311 14:01:13.615528 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 998ns to process 1 records I0311 14:01:13.615534 1 tasks_processing.go:74] worker 0 stopped. I0311 14:01:13.615692 1 tasks_processing.go:74] worker 2 stopped. I0311 14:01:13.615714 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 270.128µs to process 0 records I0311 14:01:13.615757 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.13:34180->172.30.0.10:53: read: connection refused I0311 14:01:13.615784 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0311 14:01:13.639413 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=e63ff4b579fdf97ddc9cb1d064004816ddd437d3a046f4f05820a125243d9226 I0311 14:01:13.639589 1 diskrecorder.go:70] Writing 106 records to /var/lib/insights-operator/insights-2026-03-11-140113.tar.gz I0311 14:01:13.647179 1 diskrecorder.go:51] Wrote 106 records to disk in 7ms I0311 14:01:13.647220 1 periodic.go:281] Gathering cluster info every 2h0m0s I0311 14:01:13.647236 1 periodic.go:282] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0311 14:01:26.024611 1 configmapobserver.go:84] configmaps "insights-config" not found I0311 14:02:07.388816 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="4ce2216fcae5480beb17aa21ff0a789481ecdbce7a42e829c32251617a2e599c") W0311 14:02:07.388850 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0311 14:02:07.388905 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="712c7d5ad30f12b77b38f825bb4c56442c587625a2b98f9c27b7ab47de5e360a") I0311 14:02:07.388905 1 base_controller.go:181] Shutting down ConfigController ... I0311 14:02:07.388918 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0311 14:02:07.388931 1 periodic.go:173] Shutting down I0311 14:02:07.388943 1 base_controller.go:181] Shutting down LoggingSyncer ... I0311 14:02:07.388964 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0311 14:02:07.388967 1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ... I0311 14:02:07.388974 1 base_controller.go:113] All LoggingSyncer workers have been terminated I0311 14:02:07.388969 1 base_controller.go:123] Shutting down worker of ConfigController controller ... I0311 14:02:07.388983 1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0311 14:02:07.388987 1 base_controller.go:113] All ConfigController workers have been terminated I0311 14:02:07.389000 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector